Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 896504 Details for
Bug 1098638
smartcard entries are duplicated every time a template is saved, resulting in unbootable VMs
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm log with multiple failures due to duplicate smartcard entries
vdsm.log (text/x-log), 7.07 MB, created by
James W. Mills
on 2014-05-16 19:16:59 UTC
(
hide
)
Description:
vdsm log with multiple failures due to duplicate smartcard entries
Filename:
MIME Type:
Creator:
James W. Mills
Created:
2014-05-16 19:16:59 UTC
Size:
7.07 MB
patch
obsolete
>Dummy-51::DEBUG::2014-05-16 17:01:02,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:02,077::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343551 s, 29.8 MB/s\n'; <rc> = 0 >Thread-52993::DEBUG::2014-05-16 17:01:03,360::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-52993::DEBUG::2014-05-16 17:01:03,361::task::579::TaskManager.Task::(_updateState) Task=`3583bd75-5cff-42d7-be16-b272e2e85adb`::moving from state init -> state preparing >Thread-52993::INFO::2014-05-16 17:01:03,361::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-52993::INFO::2014-05-16 17:01:03,361::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-52993::DEBUG::2014-05-16 17:01:03,361::task::1168::TaskManager.Task::(prepare) Task=`3583bd75-5cff-42d7-be16-b272e2e85adb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-52993::DEBUG::2014-05-16 17:01:03,361::task::579::TaskManager.Task::(_updateState) Task=`3583bd75-5cff-42d7-be16-b272e2e85adb`::moving from state preparing -> state finished >Thread-52993::DEBUG::2014-05-16 17:01:03,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-52993::DEBUG::2014-05-16 17:01:03,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-52993::DEBUG::2014-05-16 17:01:03,362::task::974::TaskManager.Task::(_decref) Task=`3583bd75-5cff-42d7-be16-b272e2e85adb`::ref 0 aborting False >Thread-52994::DEBUG::2014-05-16 17:01:03,371::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-52994::DEBUG::2014-05-16 17:01:03,371::task::579::TaskManager.Task::(_updateState) Task=`60c53810-2426-45bd-9305-0795231cd473`::moving from state init -> state preparing >Thread-52994::INFO::2014-05-16 17:01:03,371::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-52994::DEBUG::2014-05-16 17:01:03,372::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`43f6ee21-1180-4cd2-a6b8-b868a07c2e7b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-52994::DEBUG::2014-05-16 17:01:03,372::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-52994::DEBUG::2014-05-16 17:01:03,372::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-52994::DEBUG::2014-05-16 17:01:03,372::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`43f6ee21-1180-4cd2-a6b8-b868a07c2e7b`::Granted request >Thread-52994::DEBUG::2014-05-16 17:01:03,372::task::811::TaskManager.Task::(resourceAcquired) Task=`60c53810-2426-45bd-9305-0795231cd473`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-52994::DEBUG::2014-05-16 17:01:03,373::task::974::TaskManager.Task::(_decref) Task=`60c53810-2426-45bd-9305-0795231cd473`::ref 1 aborting False >Thread-52994::INFO::2014-05-16 17:01:03,373::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-52994::DEBUG::2014-05-16 17:01:03,373::task::1168::TaskManager.Task::(prepare) Task=`60c53810-2426-45bd-9305-0795231cd473`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-52994::DEBUG::2014-05-16 17:01:03,374::task::579::TaskManager.Task::(_updateState) Task=`60c53810-2426-45bd-9305-0795231cd473`::moving from state preparing -> state finished >Thread-52994::DEBUG::2014-05-16 17:01:03,374::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-52994::DEBUG::2014-05-16 17:01:03,374::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-52994::DEBUG::2014-05-16 17:01:03,374::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-52994::DEBUG::2014-05-16 17:01:03,374::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-52994::DEBUG::2014-05-16 17:01:03,374::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-52994::DEBUG::2014-05-16 17:01:03,374::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-52994::DEBUG::2014-05-16 17:01:03,375::task::974::TaskManager.Task::(_decref) Task=`60c53810-2426-45bd-9305-0795231cd473`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:01:04,089::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:04,163::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308461 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:06,178::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:06,247::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312291 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:08,259::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:08,331::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356185 s, 28.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:01:09,911::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 17:01:09,911::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:01:09,925::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:01:09,934::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000779804 s, 2.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:01:09,934::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000779804 s, 2.6 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 17:01:09,935::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 17:01:09,935::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 17:01:09,935::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:01:09,935::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:01:09,935::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:01:09,936::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:01:09,936::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:01:09,936::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:01:09,937::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:01:10,089::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:01:10,091::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:01:10,091::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 17:01:10,092::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 17:01:10,093::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 17:01:10,093::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 17:01:10,093::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:01:10,237::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:01:10,257::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:01:10,267::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000477057 s, 8.6 MB/s\n'; <rc> = 0 >Thread-52997::DEBUG::2014-05-16 17:01:10,279::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5414416.000000 / 8.012532 / 262500000.000000 = 0.257426 >Thread-52997::DEBUG::2014-05-16 17:01:10,280::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0068459425013552479, 'statsAge': 1.2823119163513184, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25742607552203539, 'rxDropped': 0} >Thread-52997::DEBUG::2014-05-16 17:01:10,282::task::579::TaskManager.Task::(_updateState) Task=`d759ca14-cf80-4c4e-81cf-012d2d2d0f1f`::moving from state init -> state preparing >Thread-52997::INFO::2014-05-16 17:01:10,283::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-52997::INFO::2014-05-16 17:01:10,284::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108309', 'lastCheck': '10.4', 'valid': True}} >Thread-52997::DEBUG::2014-05-16 17:01:10,285::task::1168::TaskManager.Task::(prepare) Task=`d759ca14-cf80-4c4e-81cf-012d2d2d0f1f`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108309', 'lastCheck': '10.4', 'valid': True}} >Thread-52997::DEBUG::2014-05-16 17:01:10,286::task::579::TaskManager.Task::(_updateState) Task=`d759ca14-cf80-4c4e-81cf-012d2d2d0f1f`::moving from state preparing -> state finished >Thread-52997::DEBUG::2014-05-16 17:01:10,287::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-52997::DEBUG::2014-05-16 17:01:10,288::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-52997::DEBUG::2014-05-16 17:01:10,289::task::974::TaskManager.Task::(_decref) Task=`d759ca14-cf80-4c4e-81cf-012d2d2d0f1f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:01:10,343::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:10,414::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341952 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:12,426::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:12,494::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318188 s, 32.2 MB/s\n'; <rc> = 0 >Thread-53000::DEBUG::2014-05-16 17:01:13,408::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53000::DEBUG::2014-05-16 17:01:13,408::task::579::TaskManager.Task::(_updateState) Task=`19295728-fd2b-4bea-979a-835ea82e2799`::moving from state init -> state preparing >Thread-53000::INFO::2014-05-16 17:01:13,409::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53000::INFO::2014-05-16 17:01:13,409::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53000::DEBUG::2014-05-16 17:01:13,409::task::1168::TaskManager.Task::(prepare) Task=`19295728-fd2b-4bea-979a-835ea82e2799`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53000::DEBUG::2014-05-16 17:01:13,409::task::579::TaskManager.Task::(_updateState) Task=`19295728-fd2b-4bea-979a-835ea82e2799`::moving from state preparing -> state finished >Thread-53000::DEBUG::2014-05-16 17:01:13,409::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53000::DEBUG::2014-05-16 17:01:13,409::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53000::DEBUG::2014-05-16 17:01:13,410::task::974::TaskManager.Task::(_decref) Task=`19295728-fd2b-4bea-979a-835ea82e2799`::ref 0 aborting False >Thread-53001::DEBUG::2014-05-16 17:01:13,433::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53001::DEBUG::2014-05-16 17:01:13,434::task::579::TaskManager.Task::(_updateState) Task=`187b8f7c-317f-441f-9945-c50fdd4f4dcb`::moving from state init -> state preparing >Thread-53001::INFO::2014-05-16 17:01:13,434::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53001::DEBUG::2014-05-16 17:01:13,434::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`515dea1d-2da9-456b-aab8-c724056a924c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53001::DEBUG::2014-05-16 17:01:13,434::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53001::DEBUG::2014-05-16 17:01:13,435::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53001::DEBUG::2014-05-16 17:01:13,435::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`515dea1d-2da9-456b-aab8-c724056a924c`::Granted request >Thread-53001::DEBUG::2014-05-16 17:01:13,435::task::811::TaskManager.Task::(resourceAcquired) Task=`187b8f7c-317f-441f-9945-c50fdd4f4dcb`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53001::DEBUG::2014-05-16 17:01:13,435::task::974::TaskManager.Task::(_decref) Task=`187b8f7c-317f-441f-9945-c50fdd4f4dcb`::ref 1 aborting False >Thread-53001::INFO::2014-05-16 17:01:13,436::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53001::DEBUG::2014-05-16 17:01:13,436::task::1168::TaskManager.Task::(prepare) Task=`187b8f7c-317f-441f-9945-c50fdd4f4dcb`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53001::DEBUG::2014-05-16 17:01:13,436::task::579::TaskManager.Task::(_updateState) Task=`187b8f7c-317f-441f-9945-c50fdd4f4dcb`::moving from state preparing -> state finished >Thread-53001::DEBUG::2014-05-16 17:01:13,436::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53001::DEBUG::2014-05-16 17:01:13,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53001::DEBUG::2014-05-16 17:01:13,437::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53001::DEBUG::2014-05-16 17:01:13,437::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53001::DEBUG::2014-05-16 17:01:13,437::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53001::DEBUG::2014-05-16 17:01:13,437::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53001::DEBUG::2014-05-16 17:01:13,437::task::974::TaskManager.Task::(_decref) Task=`187b8f7c-317f-441f-9945-c50fdd4f4dcb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:01:14,505::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:14,578::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352932 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:16,590::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:16,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359671 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:18,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:18,740::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030632 s, 33.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:01:20,334::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:01:20,345::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000930188 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:20,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:20,822::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346268 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:22,829::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:22,900::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344868 s, 29.7 MB/s\n'; <rc> = 0 >Thread-53005::DEBUG::2014-05-16 17:01:23,468::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53005::DEBUG::2014-05-16 17:01:23,469::task::579::TaskManager.Task::(_updateState) Task=`98734e7e-6f86-4dfb-814b-dba03017295c`::moving from state init -> state preparing >Thread-53005::INFO::2014-05-16 17:01:23,469::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53005::INFO::2014-05-16 17:01:23,469::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53005::DEBUG::2014-05-16 17:01:23,469::task::1168::TaskManager.Task::(prepare) Task=`98734e7e-6f86-4dfb-814b-dba03017295c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53005::DEBUG::2014-05-16 17:01:23,469::task::579::TaskManager.Task::(_updateState) Task=`98734e7e-6f86-4dfb-814b-dba03017295c`::moving from state preparing -> state finished >Thread-53005::DEBUG::2014-05-16 17:01:23,470::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53005::DEBUG::2014-05-16 17:01:23,470::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53005::DEBUG::2014-05-16 17:01:23,470::task::974::TaskManager.Task::(_decref) Task=`98734e7e-6f86-4dfb-814b-dba03017295c`::ref 0 aborting False >Thread-53006::DEBUG::2014-05-16 17:01:23,490::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53006::DEBUG::2014-05-16 17:01:23,491::task::579::TaskManager.Task::(_updateState) Task=`c0ff2103-50da-4077-b92d-b6c9e4150e62`::moving from state init -> state preparing >Thread-53006::INFO::2014-05-16 17:01:23,491::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53006::DEBUG::2014-05-16 17:01:23,491::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d297c392-8c31-49ca-9c07-69d24dab673b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53006::DEBUG::2014-05-16 17:01:23,491::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53006::DEBUG::2014-05-16 17:01:23,492::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53006::DEBUG::2014-05-16 17:01:23,492::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d297c392-8c31-49ca-9c07-69d24dab673b`::Granted request >Thread-53006::DEBUG::2014-05-16 17:01:23,492::task::811::TaskManager.Task::(resourceAcquired) Task=`c0ff2103-50da-4077-b92d-b6c9e4150e62`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53006::DEBUG::2014-05-16 17:01:23,492::task::974::TaskManager.Task::(_decref) Task=`c0ff2103-50da-4077-b92d-b6c9e4150e62`::ref 1 aborting False >Thread-53006::INFO::2014-05-16 17:01:23,493::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53006::DEBUG::2014-05-16 17:01:23,493::task::1168::TaskManager.Task::(prepare) Task=`c0ff2103-50da-4077-b92d-b6c9e4150e62`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53006::DEBUG::2014-05-16 17:01:23,493::task::579::TaskManager.Task::(_updateState) Task=`c0ff2103-50da-4077-b92d-b6c9e4150e62`::moving from state preparing -> state finished >Thread-53006::DEBUG::2014-05-16 17:01:23,493::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53006::DEBUG::2014-05-16 17:01:23,494::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53006::DEBUG::2014-05-16 17:01:23,494::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53006::DEBUG::2014-05-16 17:01:23,494::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53006::DEBUG::2014-05-16 17:01:23,494::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53006::DEBUG::2014-05-16 17:01:23,494::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53006::DEBUG::2014-05-16 17:01:23,495::task::974::TaskManager.Task::(_decref) Task=`c0ff2103-50da-4077-b92d-b6c9e4150e62`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:01:24,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:24,978::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303685 s, 33.7 MB/s\n'; <rc> = 0 >Thread-53007::DEBUG::2014-05-16 17:01:25,487::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4339340.000000 / 8.008973 / 262500000.000000 = 0.206404 >Thread-53007::DEBUG::2014-05-16 17:01:25,487::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053781582779166568, 'statsAge': 0.47470307350158691, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20640373352049091, 'rxDropped': 0} >Thread-53007::DEBUG::2014-05-16 17:01:25,488::task::579::TaskManager.Task::(_updateState) Task=`94dd6b3f-40bb-4a21-91ce-218fd6763311`::moving from state init -> state preparing >Thread-53007::INFO::2014-05-16 17:01:25,488::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53007::INFO::2014-05-16 17:01:25,488::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000930188', 'lastCheck': '5.1', 'valid': True}} >Thread-53007::DEBUG::2014-05-16 17:01:25,489::task::1168::TaskManager.Task::(prepare) Task=`94dd6b3f-40bb-4a21-91ce-218fd6763311`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000930188', 'lastCheck': '5.1', 'valid': True}} >Thread-53007::DEBUG::2014-05-16 17:01:25,489::task::579::TaskManager.Task::(_updateState) Task=`94dd6b3f-40bb-4a21-91ce-218fd6763311`::moving from state preparing -> state finished >Thread-53007::DEBUG::2014-05-16 17:01:25,489::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53007::DEBUG::2014-05-16 17:01:25,489::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53007::DEBUG::2014-05-16 17:01:25,489::task::974::TaskManager.Task::(_decref) Task=`94dd6b3f-40bb-4a21-91ce-218fd6763311`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:01:26,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:27,062::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035012 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:29,073::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:29,144::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349333 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:01:30,379::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:01:30,390::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108816 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:31,156::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:31,226::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345925 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:33,238::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:33,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313673 s, 32.6 MB/s\n'; <rc> = 0 >Thread-53011::DEBUG::2014-05-16 17:01:33,533::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53011::DEBUG::2014-05-16 17:01:33,534::task::579::TaskManager.Task::(_updateState) Task=`708b3ebb-6a49-4b88-904a-91b41d60c9d9`::moving from state init -> state preparing >Thread-53011::INFO::2014-05-16 17:01:33,534::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53011::INFO::2014-05-16 17:01:33,534::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53011::DEBUG::2014-05-16 17:01:33,535::task::1168::TaskManager.Task::(prepare) Task=`708b3ebb-6a49-4b88-904a-91b41d60c9d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53011::DEBUG::2014-05-16 17:01:33,535::task::579::TaskManager.Task::(_updateState) Task=`708b3ebb-6a49-4b88-904a-91b41d60c9d9`::moving from state preparing -> state finished >Thread-53011::DEBUG::2014-05-16 17:01:33,535::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53011::DEBUG::2014-05-16 17:01:33,535::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53011::DEBUG::2014-05-16 17:01:33,535::task::974::TaskManager.Task::(_decref) Task=`708b3ebb-6a49-4b88-904a-91b41d60c9d9`::ref 0 aborting False >Thread-53012::DEBUG::2014-05-16 17:01:33,544::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53012::DEBUG::2014-05-16 17:01:33,545::task::579::TaskManager.Task::(_updateState) Task=`abf2595e-8c16-4f52-a45f-e1bd81ad5d76`::moving from state init -> state preparing >Thread-53012::INFO::2014-05-16 17:01:33,545::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53012::DEBUG::2014-05-16 17:01:33,545::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b3dc5ff0-d9eb-40eb-9fef-6073d2d809ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53012::DEBUG::2014-05-16 17:01:33,545::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53012::DEBUG::2014-05-16 17:01:33,546::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53012::DEBUG::2014-05-16 17:01:33,546::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b3dc5ff0-d9eb-40eb-9fef-6073d2d809ce`::Granted request >Thread-53012::DEBUG::2014-05-16 17:01:33,546::task::811::TaskManager.Task::(resourceAcquired) Task=`abf2595e-8c16-4f52-a45f-e1bd81ad5d76`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53012::DEBUG::2014-05-16 17:01:33,546::task::974::TaskManager.Task::(_decref) Task=`abf2595e-8c16-4f52-a45f-e1bd81ad5d76`::ref 1 aborting False >Thread-53012::INFO::2014-05-16 17:01:33,547::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53012::DEBUG::2014-05-16 17:01:33,547::task::1168::TaskManager.Task::(prepare) Task=`abf2595e-8c16-4f52-a45f-e1bd81ad5d76`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53012::DEBUG::2014-05-16 17:01:33,547::task::579::TaskManager.Task::(_updateState) Task=`abf2595e-8c16-4f52-a45f-e1bd81ad5d76`::moving from state preparing -> state finished >Thread-53012::DEBUG::2014-05-16 17:01:33,547::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53012::DEBUG::2014-05-16 17:01:33,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53012::DEBUG::2014-05-16 17:01:33,548::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53012::DEBUG::2014-05-16 17:01:33,548::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53012::DEBUG::2014-05-16 17:01:33,548::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53012::DEBUG::2014-05-16 17:01:33,548::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53012::DEBUG::2014-05-16 17:01:33,548::task::974::TaskManager.Task::(_decref) Task=`abf2595e-8c16-4f52-a45f-e1bd81ad5d76`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:01:35,317::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:35,389::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356322 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:37,401::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:37,474::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367851 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:39,485::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:39,553::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031084 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:01:40,427::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:01:40,437::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000877943 s, 4.7 MB/s\n'; <rc> = 0 >Thread-53015::DEBUG::2014-05-16 17:01:40,666::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4311046.000000 / 8.008198 / 262500000.000000 = 0.205078 >Thread-53015::DEBUG::2014-05-16 17:01:40,666::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053554645130064948, 'statsAge': 1.6367611885070801, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20507775685680049, 'rxDropped': 0} >Thread-53015::DEBUG::2014-05-16 17:01:40,666::task::579::TaskManager.Task::(_updateState) Task=`438bfde6-f2b3-4cd0-a0d0-1f8573cbb4bc`::moving from state init -> state preparing >Thread-53015::INFO::2014-05-16 17:01:40,667::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53015::INFO::2014-05-16 17:01:40,667::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000877943', 'lastCheck': '0.2', 'valid': True}} >Thread-53015::DEBUG::2014-05-16 17:01:40,667::task::1168::TaskManager.Task::(prepare) Task=`438bfde6-f2b3-4cd0-a0d0-1f8573cbb4bc`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000877943', 'lastCheck': '0.2', 'valid': True}} >Thread-53015::DEBUG::2014-05-16 17:01:40,667::task::579::TaskManager.Task::(_updateState) Task=`438bfde6-f2b3-4cd0-a0d0-1f8573cbb4bc`::moving from state preparing -> state finished >Thread-53015::DEBUG::2014-05-16 17:01:40,667::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53015::DEBUG::2014-05-16 17:01:40,668::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53015::DEBUG::2014-05-16 17:01:40,668::task::974::TaskManager.Task::(_decref) Task=`438bfde6-f2b3-4cd0-a0d0-1f8573cbb4bc`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:01:41,565::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:41,641::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0407548 s, 25.1 MB/s\n'; <rc> = 0 >Thread-53017::DEBUG::2014-05-16 17:01:43,645::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53017::DEBUG::2014-05-16 17:01:43,645::task::579::TaskManager.Task::(_updateState) Task=`fcce9f7f-6d1b-4c0a-8d9d-2f5bc1415bab`::moving from state init -> state preparing >Thread-53017::INFO::2014-05-16 17:01:43,645::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53017::INFO::2014-05-16 17:01:43,646::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53017::DEBUG::2014-05-16 17:01:43,646::task::1168::TaskManager.Task::(prepare) Task=`fcce9f7f-6d1b-4c0a-8d9d-2f5bc1415bab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53017::DEBUG::2014-05-16 17:01:43,646::task::579::TaskManager.Task::(_updateState) Task=`fcce9f7f-6d1b-4c0a-8d9d-2f5bc1415bab`::moving from state preparing -> state finished >Thread-53017::DEBUG::2014-05-16 17:01:43,646::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53017::DEBUG::2014-05-16 17:01:43,646::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53017::DEBUG::2014-05-16 17:01:43,646::task::974::TaskManager.Task::(_decref) Task=`fcce9f7f-6d1b-4c0a-8d9d-2f5bc1415bab`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:01:43,653::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-53018::DEBUG::2014-05-16 17:01:43,661::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53018::DEBUG::2014-05-16 17:01:43,662::task::579::TaskManager.Task::(_updateState) Task=`2f44957a-c7ff-4939-9f8f-d26cdb496c79`::moving from state init -> state preparing >Thread-53018::INFO::2014-05-16 17:01:43,662::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53018::DEBUG::2014-05-16 17:01:43,663::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6dc0281b-9630-48a5-8e47-639518b9c93d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53018::DEBUG::2014-05-16 17:01:43,663::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53018::DEBUG::2014-05-16 17:01:43,663::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53018::DEBUG::2014-05-16 17:01:43,663::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6dc0281b-9630-48a5-8e47-639518b9c93d`::Granted request >Thread-53018::DEBUG::2014-05-16 17:01:43,663::task::811::TaskManager.Task::(resourceAcquired) Task=`2f44957a-c7ff-4939-9f8f-d26cdb496c79`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53018::DEBUG::2014-05-16 17:01:43,664::task::974::TaskManager.Task::(_decref) Task=`2f44957a-c7ff-4939-9f8f-d26cdb496c79`::ref 1 aborting False >Thread-53018::INFO::2014-05-16 17:01:43,664::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53018::DEBUG::2014-05-16 17:01:43,664::task::1168::TaskManager.Task::(prepare) Task=`2f44957a-c7ff-4939-9f8f-d26cdb496c79`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53018::DEBUG::2014-05-16 17:01:43,664::task::579::TaskManager.Task::(_updateState) Task=`2f44957a-c7ff-4939-9f8f-d26cdb496c79`::moving from state preparing -> state finished >Thread-53018::DEBUG::2014-05-16 17:01:43,665::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53018::DEBUG::2014-05-16 17:01:43,665::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53018::DEBUG::2014-05-16 17:01:43,665::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53018::DEBUG::2014-05-16 17:01:43,665::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53018::DEBUG::2014-05-16 17:01:43,665::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53018::DEBUG::2014-05-16 17:01:43,665::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53018::DEBUG::2014-05-16 17:01:43,666::task::974::TaskManager.Task::(_decref) Task=`2f44957a-c7ff-4939-9f8f-d26cdb496c79`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:01:43,719::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029887 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:45,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:45,798::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303795 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:47,810::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:47,880::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342145 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:49,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:49,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347813 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:01:50,475::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:01:50,485::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0008752 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:51,974::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:52,046::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03514 s, 29.1 MB/s\n'; <rc> = 0 >Thread-53023::DEBUG::2014-05-16 17:01:53,744::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53023::DEBUG::2014-05-16 17:01:53,744::task::579::TaskManager.Task::(_updateState) Task=`80edd771-16fc-4e63-be28-19cc61b11fe6`::moving from state init -> state preparing >Thread-53023::INFO::2014-05-16 17:01:53,744::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53023::INFO::2014-05-16 17:01:53,745::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53023::DEBUG::2014-05-16 17:01:53,745::task::1168::TaskManager.Task::(prepare) Task=`80edd771-16fc-4e63-be28-19cc61b11fe6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53023::DEBUG::2014-05-16 17:01:53,745::task::579::TaskManager.Task::(_updateState) Task=`80edd771-16fc-4e63-be28-19cc61b11fe6`::moving from state preparing -> state finished >Thread-53023::DEBUG::2014-05-16 17:01:53,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53023::DEBUG::2014-05-16 17:01:53,745::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53023::DEBUG::2014-05-16 17:01:53,745::task::974::TaskManager.Task::(_decref) Task=`80edd771-16fc-4e63-be28-19cc61b11fe6`::ref 0 aborting False >Thread-53024::DEBUG::2014-05-16 17:01:53,765::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53024::DEBUG::2014-05-16 17:01:53,765::task::579::TaskManager.Task::(_updateState) Task=`d8c84d08-569f-48d5-9ac1-db9202f4979c`::moving from state init -> state preparing >Thread-53024::INFO::2014-05-16 17:01:53,765::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53024::DEBUG::2014-05-16 17:01:53,766::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2d1c9804-9463-4459-aff0-b80d7a3a2a24`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53024::DEBUG::2014-05-16 17:01:53,766::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53024::DEBUG::2014-05-16 17:01:53,766::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53024::DEBUG::2014-05-16 17:01:53,766::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2d1c9804-9463-4459-aff0-b80d7a3a2a24`::Granted request >Thread-53024::DEBUG::2014-05-16 17:01:53,767::task::811::TaskManager.Task::(resourceAcquired) Task=`d8c84d08-569f-48d5-9ac1-db9202f4979c`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53024::DEBUG::2014-05-16 17:01:53,767::task::974::TaskManager.Task::(_decref) Task=`d8c84d08-569f-48d5-9ac1-db9202f4979c`::ref 1 aborting False >Thread-53024::INFO::2014-05-16 17:01:53,768::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53024::DEBUG::2014-05-16 17:01:53,768::task::1168::TaskManager.Task::(prepare) Task=`d8c84d08-569f-48d5-9ac1-db9202f4979c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53024::DEBUG::2014-05-16 17:01:53,768::task::579::TaskManager.Task::(_updateState) Task=`d8c84d08-569f-48d5-9ac1-db9202f4979c`::moving from state preparing -> state finished >Thread-53024::DEBUG::2014-05-16 17:01:53,768::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53024::DEBUG::2014-05-16 17:01:53,768::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53024::DEBUG::2014-05-16 17:01:53,768::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53024::DEBUG::2014-05-16 17:01:53,769::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53024::DEBUG::2014-05-16 17:01:53,769::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53024::DEBUG::2014-05-16 17:01:53,769::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53024::DEBUG::2014-05-16 17:01:53,769::task::974::TaskManager.Task::(_decref) Task=`d8c84d08-569f-48d5-9ac1-db9202f4979c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:01:54,058::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:54,125::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305892 s, 33.5 MB/s\n'; <rc> = 0 >Thread-53025::DEBUG::2014-05-16 17:01:55,847::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317546.000000 / 8.008348 / 262500000.000000 = 0.205383 >Thread-53025::DEBUG::2014-05-16 17:01:55,847::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053717279431958077, 'statsAge': 0.80153298377990723, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2053831115992463, 'rxDropped': 0} >Thread-53025::DEBUG::2014-05-16 17:01:55,848::task::579::TaskManager.Task::(_updateState) Task=`ac0d61ad-dbb0-4653-9de0-6458b737d568`::moving from state init -> state preparing >Thread-53025::INFO::2014-05-16 17:01:55,848::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53025::INFO::2014-05-16 17:01:55,848::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0008752', 'lastCheck': '5.3', 'valid': True}} >Thread-53025::DEBUG::2014-05-16 17:01:55,848::task::1168::TaskManager.Task::(prepare) Task=`ac0d61ad-dbb0-4653-9de0-6458b737d568`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0008752', 'lastCheck': '5.3', 'valid': True}} >Thread-53025::DEBUG::2014-05-16 17:01:55,848::task::579::TaskManager.Task::(_updateState) Task=`ac0d61ad-dbb0-4653-9de0-6458b737d568`::moving from state preparing -> state finished >Thread-53025::DEBUG::2014-05-16 17:01:55,849::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53025::DEBUG::2014-05-16 17:01:55,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53025::DEBUG::2014-05-16 17:01:55,849::task::974::TaskManager.Task::(_decref) Task=`ac0d61ad-dbb0-4653-9de0-6458b737d568`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:01:56,136::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:56,207::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350842 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:01:58,219::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:01:58,286::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031106 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:00,298::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:00,365::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307849 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:02:00,522::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:02:00,532::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00075918 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:02,377::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:02,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355728 s, 28.8 MB/s\n'; <rc> = 0 >Thread-53029::DEBUG::2014-05-16 17:02:03,819::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53029::DEBUG::2014-05-16 17:02:03,820::task::579::TaskManager.Task::(_updateState) Task=`6d22314b-c7b8-4a50-91f7-e72c55a3e65a`::moving from state init -> state preparing >Thread-53029::INFO::2014-05-16 17:02:03,820::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53029::INFO::2014-05-16 17:02:03,820::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53029::DEBUG::2014-05-16 17:02:03,820::task::1168::TaskManager.Task::(prepare) Task=`6d22314b-c7b8-4a50-91f7-e72c55a3e65a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53029::DEBUG::2014-05-16 17:02:03,820::task::579::TaskManager.Task::(_updateState) Task=`6d22314b-c7b8-4a50-91f7-e72c55a3e65a`::moving from state preparing -> state finished >Thread-53029::DEBUG::2014-05-16 17:02:03,820::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53029::DEBUG::2014-05-16 17:02:03,821::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53029::DEBUG::2014-05-16 17:02:03,821::task::974::TaskManager.Task::(_decref) Task=`6d22314b-c7b8-4a50-91f7-e72c55a3e65a`::ref 0 aborting False >Thread-53030::DEBUG::2014-05-16 17:02:03,831::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53030::DEBUG::2014-05-16 17:02:03,831::task::579::TaskManager.Task::(_updateState) Task=`7b7cf442-b0d4-4e7a-8824-243bf11550a9`::moving from state init -> state preparing >Thread-53030::INFO::2014-05-16 17:02:03,831::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53030::DEBUG::2014-05-16 17:02:03,831::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9fd7c08b-a6b2-41e2-865c-8f9928d8d261`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53030::DEBUG::2014-05-16 17:02:03,831::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53030::DEBUG::2014-05-16 17:02:03,832::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53030::DEBUG::2014-05-16 17:02:03,832::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9fd7c08b-a6b2-41e2-865c-8f9928d8d261`::Granted request >Thread-53030::DEBUG::2014-05-16 17:02:03,832::task::811::TaskManager.Task::(resourceAcquired) Task=`7b7cf442-b0d4-4e7a-8824-243bf11550a9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53030::DEBUG::2014-05-16 17:02:03,832::task::974::TaskManager.Task::(_decref) Task=`7b7cf442-b0d4-4e7a-8824-243bf11550a9`::ref 1 aborting False >Thread-53030::INFO::2014-05-16 17:02:03,833::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53030::DEBUG::2014-05-16 17:02:03,833::task::1168::TaskManager.Task::(prepare) Task=`7b7cf442-b0d4-4e7a-8824-243bf11550a9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53030::DEBUG::2014-05-16 17:02:03,833::task::579::TaskManager.Task::(_updateState) Task=`7b7cf442-b0d4-4e7a-8824-243bf11550a9`::moving from state preparing -> state finished >Thread-53030::DEBUG::2014-05-16 17:02:03,833::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53030::DEBUG::2014-05-16 17:02:03,833::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53030::DEBUG::2014-05-16 17:02:03,834::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53030::DEBUG::2014-05-16 17:02:03,834::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53030::DEBUG::2014-05-16 17:02:03,834::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53030::DEBUG::2014-05-16 17:02:03,834::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53030::DEBUG::2014-05-16 17:02:03,834::task::974::TaskManager.Task::(_decref) Task=`7b7cf442-b0d4-4e7a-8824-243bf11550a9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:02:04,460::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:04,527::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304709 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:06,538::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:06,616::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395963 s, 25.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:08,627::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:08,699::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352133 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:02:10,567::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:02:10,578::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:10,711::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:10,781::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344678 s, 29.7 MB/s\n'; <rc> = 0 >Thread-53033::DEBUG::2014-05-16 17:02:11,078::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413891.000000 / 8.008892 / 262500000.000000 = 0.257518 >Thread-53033::DEBUG::2014-05-16 17:02:11,078::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065881058429282692, 'statsAge': 0.014807939529418945, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25751810005542636, 'rxDropped': 0} >Thread-53033::DEBUG::2014-05-16 17:02:11,078::task::579::TaskManager.Task::(_updateState) Task=`ea00f2c1-5dde-4974-baaf-621fd6a7da93`::moving from state init -> state preparing >Thread-53033::INFO::2014-05-16 17:02:11,079::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53033::INFO::2014-05-16 17:02:11,079::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108', 'lastCheck': '0.5', 'valid': True}} >Thread-53033::DEBUG::2014-05-16 17:02:11,079::task::1168::TaskManager.Task::(prepare) Task=`ea00f2c1-5dde-4974-baaf-621fd6a7da93`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108', 'lastCheck': '0.5', 'valid': True}} >Thread-53033::DEBUG::2014-05-16 17:02:11,079::task::579::TaskManager.Task::(_updateState) Task=`ea00f2c1-5dde-4974-baaf-621fd6a7da93`::moving from state preparing -> state finished >Thread-53033::DEBUG::2014-05-16 17:02:11,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53033::DEBUG::2014-05-16 17:02:11,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53033::DEBUG::2014-05-16 17:02:11,080::task::974::TaskManager.Task::(_decref) Task=`ea00f2c1-5dde-4974-baaf-621fd6a7da93`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:02:12,792::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:12,859::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311256 s, 32.9 MB/s\n'; <rc> = 0 >Thread-53035::DEBUG::2014-05-16 17:02:13,885::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53035::DEBUG::2014-05-16 17:02:13,886::task::579::TaskManager.Task::(_updateState) Task=`c6ae55c1-169d-443e-b4e3-857c40efff43`::moving from state init -> state preparing >Thread-53035::INFO::2014-05-16 17:02:13,886::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53035::INFO::2014-05-16 17:02:13,886::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53035::DEBUG::2014-05-16 17:02:13,886::task::1168::TaskManager.Task::(prepare) Task=`c6ae55c1-169d-443e-b4e3-857c40efff43`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53035::DEBUG::2014-05-16 17:02:13,887::task::579::TaskManager.Task::(_updateState) Task=`c6ae55c1-169d-443e-b4e3-857c40efff43`::moving from state preparing -> state finished >Thread-53035::DEBUG::2014-05-16 17:02:13,887::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53035::DEBUG::2014-05-16 17:02:13,887::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53035::DEBUG::2014-05-16 17:02:13,887::task::974::TaskManager.Task::(_decref) Task=`c6ae55c1-169d-443e-b4e3-857c40efff43`::ref 0 aborting False >Thread-53036::DEBUG::2014-05-16 17:02:13,915::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53036::DEBUG::2014-05-16 17:02:13,915::task::579::TaskManager.Task::(_updateState) Task=`65156499-325a-4ed5-b208-094bf6dff578`::moving from state init -> state preparing >Thread-53036::INFO::2014-05-16 17:02:13,915::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53036::DEBUG::2014-05-16 17:02:13,915::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`815dd4bf-26ff-429d-833f-e4432c6b0877`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53036::DEBUG::2014-05-16 17:02:13,916::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53036::DEBUG::2014-05-16 17:02:13,916::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53036::DEBUG::2014-05-16 17:02:13,916::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`815dd4bf-26ff-429d-833f-e4432c6b0877`::Granted request >Thread-53036::DEBUG::2014-05-16 17:02:13,916::task::811::TaskManager.Task::(resourceAcquired) Task=`65156499-325a-4ed5-b208-094bf6dff578`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53036::DEBUG::2014-05-16 17:02:13,917::task::974::TaskManager.Task::(_decref) Task=`65156499-325a-4ed5-b208-094bf6dff578`::ref 1 aborting False >Thread-53036::INFO::2014-05-16 17:02:13,917::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53036::DEBUG::2014-05-16 17:02:13,917::task::1168::TaskManager.Task::(prepare) Task=`65156499-325a-4ed5-b208-094bf6dff578`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53036::DEBUG::2014-05-16 17:02:13,918::task::579::TaskManager.Task::(_updateState) Task=`65156499-325a-4ed5-b208-094bf6dff578`::moving from state preparing -> state finished >Thread-53036::DEBUG::2014-05-16 17:02:13,918::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53036::DEBUG::2014-05-16 17:02:13,918::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53036::DEBUG::2014-05-16 17:02:13,918::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53036::DEBUG::2014-05-16 17:02:13,918::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53036::DEBUG::2014-05-16 17:02:13,918::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53036::DEBUG::2014-05-16 17:02:13,919::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53036::DEBUG::2014-05-16 17:02:13,919::task::974::TaskManager.Task::(_decref) Task=`65156499-325a-4ed5-b208-094bf6dff578`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:02:14,870::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:14,937::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305584 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:16,949::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:17,022::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035976 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:19,034::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:19,106::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331074 s, 30.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:02:20,615::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:02:20,625::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111559 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:21,118::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:21,185::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310569 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:23,197::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:23,268::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357751 s, 28.6 MB/s\n'; <rc> = 0 >Thread-53041::DEBUG::2014-05-16 17:02:23,977::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53041::DEBUG::2014-05-16 17:02:23,978::task::579::TaskManager.Task::(_updateState) Task=`06dbc76d-d6ec-4872-bb82-c74cb72b9a09`::moving from state init -> state preparing >Thread-53041::INFO::2014-05-16 17:02:23,978::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53041::INFO::2014-05-16 17:02:23,978::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53041::DEBUG::2014-05-16 17:02:23,978::task::1168::TaskManager.Task::(prepare) Task=`06dbc76d-d6ec-4872-bb82-c74cb72b9a09`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53041::DEBUG::2014-05-16 17:02:23,979::task::579::TaskManager.Task::(_updateState) Task=`06dbc76d-d6ec-4872-bb82-c74cb72b9a09`::moving from state preparing -> state finished >Thread-53041::DEBUG::2014-05-16 17:02:23,979::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53041::DEBUG::2014-05-16 17:02:23,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53041::DEBUG::2014-05-16 17:02:23,979::task::974::TaskManager.Task::(_decref) Task=`06dbc76d-d6ec-4872-bb82-c74cb72b9a09`::ref 0 aborting False >Thread-53042::DEBUG::2014-05-16 17:02:23,990::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53042::DEBUG::2014-05-16 17:02:23,990::task::579::TaskManager.Task::(_updateState) Task=`8be7efbb-c321-473d-8982-5affe5f1729e`::moving from state init -> state preparing >Thread-53042::INFO::2014-05-16 17:02:23,990::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53042::DEBUG::2014-05-16 17:02:23,991::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8af16270-9983-4684-b6af-7c181a64093f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53042::DEBUG::2014-05-16 17:02:23,991::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53042::DEBUG::2014-05-16 17:02:23,991::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53042::DEBUG::2014-05-16 17:02:23,991::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8af16270-9983-4684-b6af-7c181a64093f`::Granted request >Thread-53042::DEBUG::2014-05-16 17:02:23,992::task::811::TaskManager.Task::(resourceAcquired) Task=`8be7efbb-c321-473d-8982-5affe5f1729e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53042::DEBUG::2014-05-16 17:02:23,992::task::974::TaskManager.Task::(_decref) Task=`8be7efbb-c321-473d-8982-5affe5f1729e`::ref 1 aborting False >Thread-53042::INFO::2014-05-16 17:02:23,992::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53042::DEBUG::2014-05-16 17:02:23,992::task::1168::TaskManager.Task::(prepare) Task=`8be7efbb-c321-473d-8982-5affe5f1729e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53042::DEBUG::2014-05-16 17:02:23,993::task::579::TaskManager.Task::(_updateState) Task=`8be7efbb-c321-473d-8982-5affe5f1729e`::moving from state preparing -> state finished >Thread-53042::DEBUG::2014-05-16 17:02:23,993::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53042::DEBUG::2014-05-16 17:02:23,993::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53042::DEBUG::2014-05-16 17:02:23,993::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53042::DEBUG::2014-05-16 17:02:23,993::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53042::DEBUG::2014-05-16 17:02:23,993::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53042::DEBUG::2014-05-16 17:02:23,993::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53042::DEBUG::2014-05-16 17:02:23,994::task::974::TaskManager.Task::(_decref) Task=`8be7efbb-c321-473d-8982-5affe5f1729e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:02:25,280::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:25,347::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303366 s, 33.8 MB/s\n'; <rc> = 0 >Thread-53043::DEBUG::2014-05-16 17:02:26,352::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5415337.000000 / 8.011658 / 262500000.000000 = 0.257498 >Thread-53043::DEBUG::2014-05-16 17:02:26,352::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.006638326337726836, 'statsAge': 1.2709250450134277, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25749795308840923, 'rxDropped': 0} >Thread-53043::DEBUG::2014-05-16 17:02:26,353::task::579::TaskManager.Task::(_updateState) Task=`0114dd9d-a99f-46a9-a3e6-3718417cda1c`::moving from state init -> state preparing >Thread-53043::INFO::2014-05-16 17:02:26,353::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53043::INFO::2014-05-16 17:02:26,353::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111559', 'lastCheck': '5.7', 'valid': True}} >Thread-53043::DEBUG::2014-05-16 17:02:26,354::task::1168::TaskManager.Task::(prepare) Task=`0114dd9d-a99f-46a9-a3e6-3718417cda1c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111559', 'lastCheck': '5.7', 'valid': True}} >Thread-53043::DEBUG::2014-05-16 17:02:26,354::task::579::TaskManager.Task::(_updateState) Task=`0114dd9d-a99f-46a9-a3e6-3718417cda1c`::moving from state preparing -> state finished >Thread-53043::DEBUG::2014-05-16 17:02:26,354::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53043::DEBUG::2014-05-16 17:02:26,354::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53043::DEBUG::2014-05-16 17:02:26,354::task::974::TaskManager.Task::(_decref) Task=`0114dd9d-a99f-46a9-a3e6-3718417cda1c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:02:27,358::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:27,426::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319271 s, 32.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:29,438::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:29,516::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041374 s, 24.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:02:30,659::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:02:30,669::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000795658 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:31,528::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:31,601::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357905 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:33,613::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:33,689::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301724 s, 33.9 MB/s\n'; <rc> = 0 >Thread-53047::DEBUG::2014-05-16 17:02:34,034::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53047::DEBUG::2014-05-16 17:02:34,034::task::579::TaskManager.Task::(_updateState) Task=`1f11c0b5-0ab9-4418-8da4-8edfab4adc4d`::moving from state init -> state preparing >Thread-53047::INFO::2014-05-16 17:02:34,035::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53047::INFO::2014-05-16 17:02:34,035::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53047::DEBUG::2014-05-16 17:02:34,035::task::1168::TaskManager.Task::(prepare) Task=`1f11c0b5-0ab9-4418-8da4-8edfab4adc4d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53047::DEBUG::2014-05-16 17:02:34,035::task::579::TaskManager.Task::(_updateState) Task=`1f11c0b5-0ab9-4418-8da4-8edfab4adc4d`::moving from state preparing -> state finished >Thread-53047::DEBUG::2014-05-16 17:02:34,035::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53047::DEBUG::2014-05-16 17:02:34,036::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53047::DEBUG::2014-05-16 17:02:34,036::task::974::TaskManager.Task::(_decref) Task=`1f11c0b5-0ab9-4418-8da4-8edfab4adc4d`::ref 0 aborting False >Thread-53048::DEBUG::2014-05-16 17:02:34,057::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53048::DEBUG::2014-05-16 17:02:34,057::task::579::TaskManager.Task::(_updateState) Task=`b7f41027-04aa-4f25-8b4d-c86664d07c6b`::moving from state init -> state preparing >Thread-53048::INFO::2014-05-16 17:02:34,057::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53048::DEBUG::2014-05-16 17:02:34,057::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f67462a2-322b-43db-aa23-a0541744051c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53048::DEBUG::2014-05-16 17:02:34,058::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53048::DEBUG::2014-05-16 17:02:34,058::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53048::DEBUG::2014-05-16 17:02:34,058::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f67462a2-322b-43db-aa23-a0541744051c`::Granted request >Thread-53048::DEBUG::2014-05-16 17:02:34,058::task::811::TaskManager.Task::(resourceAcquired) Task=`b7f41027-04aa-4f25-8b4d-c86664d07c6b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53048::DEBUG::2014-05-16 17:02:34,058::task::974::TaskManager.Task::(_decref) Task=`b7f41027-04aa-4f25-8b4d-c86664d07c6b`::ref 1 aborting False >Thread-53048::INFO::2014-05-16 17:02:34,059::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53048::DEBUG::2014-05-16 17:02:34,059::task::1168::TaskManager.Task::(prepare) Task=`b7f41027-04aa-4f25-8b4d-c86664d07c6b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53048::DEBUG::2014-05-16 17:02:34,060::task::579::TaskManager.Task::(_updateState) Task=`b7f41027-04aa-4f25-8b4d-c86664d07c6b`::moving from state preparing -> state finished >Thread-53048::DEBUG::2014-05-16 17:02:34,060::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53048::DEBUG::2014-05-16 17:02:34,060::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53048::DEBUG::2014-05-16 17:02:34,060::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53048::DEBUG::2014-05-16 17:02:34,060::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53048::DEBUG::2014-05-16 17:02:34,060::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53048::DEBUG::2014-05-16 17:02:34,061::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53048::DEBUG::2014-05-16 17:02:34,061::task::974::TaskManager.Task::(_decref) Task=`b7f41027-04aa-4f25-8b4d-c86664d07c6b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:02:35,701::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:35,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355961 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:37,785::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:37,858::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356402 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:39,870::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:39,937::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313063 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:02:40,706::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:02:40,716::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000726937 s, 5.6 MB/s\n'; <rc> = 0 >Thread-53051::DEBUG::2014-05-16 17:02:41,566::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4311770.000000 / 8.008171 / 262500000.000000 = 0.205113 >Thread-53051::DEBUG::2014-05-16 17:02:41,566::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052995395097680678, 'statsAge': 0.46807312965393066, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20511288169215347, 'rxDropped': 0} >Thread-53051::DEBUG::2014-05-16 17:02:41,567::task::579::TaskManager.Task::(_updateState) Task=`f9614744-1258-4cab-82d0-7ce75417f70b`::moving from state init -> state preparing >Thread-53051::INFO::2014-05-16 17:02:41,567::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53051::INFO::2014-05-16 17:02:41,567::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000726937', 'lastCheck': '0.8', 'valid': True}} >Thread-53051::DEBUG::2014-05-16 17:02:41,567::task::1168::TaskManager.Task::(prepare) Task=`f9614744-1258-4cab-82d0-7ce75417f70b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000726937', 'lastCheck': '0.8', 'valid': True}} >Thread-53051::DEBUG::2014-05-16 17:02:41,567::task::579::TaskManager.Task::(_updateState) Task=`f9614744-1258-4cab-82d0-7ce75417f70b`::moving from state preparing -> state finished >Thread-53051::DEBUG::2014-05-16 17:02:41,567::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53051::DEBUG::2014-05-16 17:02:41,568::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53051::DEBUG::2014-05-16 17:02:41,568::task::974::TaskManager.Task::(_decref) Task=`f9614744-1258-4cab-82d0-7ce75417f70b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:02:41,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:42,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312969 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:44,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-53053::DEBUG::2014-05-16 17:02:44,105::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53053::DEBUG::2014-05-16 17:02:44,107::task::579::TaskManager.Task::(_updateState) Task=`357b06f3-e4f6-4276-9ab6-03c101d8cde7`::moving from state init -> state preparing >Thread-53053::INFO::2014-05-16 17:02:44,109::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53053::INFO::2014-05-16 17:02:44,111::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53053::DEBUG::2014-05-16 17:02:44,112::task::1168::TaskManager.Task::(prepare) Task=`357b06f3-e4f6-4276-9ab6-03c101d8cde7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53053::DEBUG::2014-05-16 17:02:44,113::task::579::TaskManager.Task::(_updateState) Task=`357b06f3-e4f6-4276-9ab6-03c101d8cde7`::moving from state preparing -> state finished >Thread-53053::DEBUG::2014-05-16 17:02:44,115::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53053::DEBUG::2014-05-16 17:02:44,116::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53053::DEBUG::2014-05-16 17:02:44,117::task::974::TaskManager.Task::(_decref) Task=`357b06f3-e4f6-4276-9ab6-03c101d8cde7`::ref 0 aborting False >Thread-53054::DEBUG::2014-05-16 17:02:44,132::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53054::DEBUG::2014-05-16 17:02:44,134::task::579::TaskManager.Task::(_updateState) Task=`b1851a06-ab9c-4cd5-b755-dafc4bc110da`::moving from state init -> state preparing >Thread-53054::INFO::2014-05-16 17:02:44,135::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53054::DEBUG::2014-05-16 17:02:44,139::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a3469c18-592c-4228-8804-8e76f73dc603`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53054::DEBUG::2014-05-16 17:02:44,140::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53054::DEBUG::2014-05-16 17:02:44,142::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53054::DEBUG::2014-05-16 17:02:44,143::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a3469c18-592c-4228-8804-8e76f73dc603`::Granted request >Thread-53054::DEBUG::2014-05-16 17:02:44,146::task::811::TaskManager.Task::(resourceAcquired) Task=`b1851a06-ab9c-4cd5-b755-dafc4bc110da`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53054::DEBUG::2014-05-16 17:02:44,147::task::974::TaskManager.Task::(_decref) Task=`b1851a06-ab9c-4cd5-b755-dafc4bc110da`::ref 1 aborting False >Thread-53054::INFO::2014-05-16 17:02:44,152::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53054::DEBUG::2014-05-16 17:02:44,153::task::1168::TaskManager.Task::(prepare) Task=`b1851a06-ab9c-4cd5-b755-dafc4bc110da`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53054::DEBUG::2014-05-16 17:02:44,155::task::579::TaskManager.Task::(_updateState) Task=`b1851a06-ab9c-4cd5-b755-dafc4bc110da`::moving from state preparing -> state finished >Thread-53054::DEBUG::2014-05-16 17:02:44,156::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53054::DEBUG::2014-05-16 17:02:44,157::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53054::DEBUG::2014-05-16 17:02:44,159::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53054::DEBUG::2014-05-16 17:02:44,161::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53054::DEBUG::2014-05-16 17:02:44,162::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53054::DEBUG::2014-05-16 17:02:44,163::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53054::DEBUG::2014-05-16 17:02:44,165::task::974::TaskManager.Task::(_decref) Task=`b1851a06-ab9c-4cd5-b755-dafc4bc110da`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:02:44,182::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355611 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:46,262::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:46,329::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306786 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:48,340::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:48,410::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318437 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:50,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:50,492::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353415 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:02:50,754::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:02:50,764::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000799873 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:52,504::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:52,575::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354064 s, 28.9 MB/s\n'; <rc> = 0 >Thread-53059::DEBUG::2014-05-16 17:02:54,202::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53059::DEBUG::2014-05-16 17:02:54,203::task::579::TaskManager.Task::(_updateState) Task=`87a407f1-4cd2-4b01-8695-80b6bbcb5905`::moving from state init -> state preparing >Thread-53059::INFO::2014-05-16 17:02:54,203::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53059::INFO::2014-05-16 17:02:54,203::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53059::DEBUG::2014-05-16 17:02:54,203::task::1168::TaskManager.Task::(prepare) Task=`87a407f1-4cd2-4b01-8695-80b6bbcb5905`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53059::DEBUG::2014-05-16 17:02:54,204::task::579::TaskManager.Task::(_updateState) Task=`87a407f1-4cd2-4b01-8695-80b6bbcb5905`::moving from state preparing -> state finished >Thread-53059::DEBUG::2014-05-16 17:02:54,204::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53059::DEBUG::2014-05-16 17:02:54,204::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53059::DEBUG::2014-05-16 17:02:54,204::task::974::TaskManager.Task::(_decref) Task=`87a407f1-4cd2-4b01-8695-80b6bbcb5905`::ref 0 aborting False >Thread-53060::DEBUG::2014-05-16 17:02:54,213::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53060::DEBUG::2014-05-16 17:02:54,213::task::579::TaskManager.Task::(_updateState) Task=`68a035af-9912-4f2b-8ea3-84c7db453543`::moving from state init -> state preparing >Thread-53060::INFO::2014-05-16 17:02:54,213::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53060::DEBUG::2014-05-16 17:02:54,214::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`57dde486-d5b5-46d3-84ef-11f6dde66dfd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53060::DEBUG::2014-05-16 17:02:54,214::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53060::DEBUG::2014-05-16 17:02:54,214::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53060::DEBUG::2014-05-16 17:02:54,214::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`57dde486-d5b5-46d3-84ef-11f6dde66dfd`::Granted request >Thread-53060::DEBUG::2014-05-16 17:02:54,214::task::811::TaskManager.Task::(resourceAcquired) Task=`68a035af-9912-4f2b-8ea3-84c7db453543`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53060::DEBUG::2014-05-16 17:02:54,214::task::974::TaskManager.Task::(_decref) Task=`68a035af-9912-4f2b-8ea3-84c7db453543`::ref 1 aborting False >Thread-53060::INFO::2014-05-16 17:02:54,215::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53060::DEBUG::2014-05-16 17:02:54,215::task::1168::TaskManager.Task::(prepare) Task=`68a035af-9912-4f2b-8ea3-84c7db453543`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53060::DEBUG::2014-05-16 17:02:54,215::task::579::TaskManager.Task::(_updateState) Task=`68a035af-9912-4f2b-8ea3-84c7db453543`::moving from state preparing -> state finished >Thread-53060::DEBUG::2014-05-16 17:02:54,215::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53060::DEBUG::2014-05-16 17:02:54,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53060::DEBUG::2014-05-16 17:02:54,216::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53060::DEBUG::2014-05-16 17:02:54,216::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53060::DEBUG::2014-05-16 17:02:54,216::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53060::DEBUG::2014-05-16 17:02:54,216::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53060::DEBUG::2014-05-16 17:02:54,216::task::974::TaskManager.Task::(_decref) Task=`68a035af-9912-4f2b-8ea3-84c7db453543`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:02:54,587::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:54,654::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302705 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:56,665::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-53061::DEBUG::2014-05-16 17:02:56,711::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4320858.000000 / 8.008544 / 262500000.000000 = 0.205536 >Thread-53061::DEBUG::2014-05-16 17:02:56,712::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005371596489634041, 'statsAge': 1.5979290008544922, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20553563161955976, 'rxDropped': 0} >Thread-53061::DEBUG::2014-05-16 17:02:56,714::task::579::TaskManager.Task::(_updateState) Task=`1323ed66-0559-4a4c-bdac-b458bd2ac14e`::moving from state init -> state preparing >Thread-53061::INFO::2014-05-16 17:02:56,715::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53061::INFO::2014-05-16 17:02:56,716::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799873', 'lastCheck': '5.9', 'valid': True}} >Thread-53061::DEBUG::2014-05-16 17:02:56,717::task::1168::TaskManager.Task::(prepare) Task=`1323ed66-0559-4a4c-bdac-b458bd2ac14e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799873', 'lastCheck': '5.9', 'valid': True}} >Thread-53061::DEBUG::2014-05-16 17:02:56,718::task::579::TaskManager.Task::(_updateState) Task=`1323ed66-0559-4a4c-bdac-b458bd2ac14e`::moving from state preparing -> state finished >Thread-53061::DEBUG::2014-05-16 17:02:56,719::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53061::DEBUG::2014-05-16 17:02:56,720::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53061::DEBUG::2014-05-16 17:02:56,721::task::974::TaskManager.Task::(_decref) Task=`1323ed66-0559-4a4c-bdac-b458bd2ac14e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:02:56,777::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0446846 s, 22.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:02:58,791::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:02:58,858::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305156 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:03:00,799::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:03:00,809::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108373 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:00,870::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:00,941::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345801 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:02,952::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:03,019::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317047 s, 32.3 MB/s\n'; <rc> = 0 >Thread-53065::DEBUG::2014-05-16 17:03:04,256::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53065::DEBUG::2014-05-16 17:03:04,256::task::579::TaskManager.Task::(_updateState) Task=`94059f1d-310a-4cf1-8bf6-8d4da8207a1c`::moving from state init -> state preparing >Thread-53065::INFO::2014-05-16 17:03:04,256::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53065::INFO::2014-05-16 17:03:04,257::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53065::DEBUG::2014-05-16 17:03:04,257::task::1168::TaskManager.Task::(prepare) Task=`94059f1d-310a-4cf1-8bf6-8d4da8207a1c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53065::DEBUG::2014-05-16 17:03:04,257::task::579::TaskManager.Task::(_updateState) Task=`94059f1d-310a-4cf1-8bf6-8d4da8207a1c`::moving from state preparing -> state finished >Thread-53065::DEBUG::2014-05-16 17:03:04,257::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53065::DEBUG::2014-05-16 17:03:04,257::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53065::DEBUG::2014-05-16 17:03:04,257::task::974::TaskManager.Task::(_decref) Task=`94059f1d-310a-4cf1-8bf6-8d4da8207a1c`::ref 0 aborting False >Thread-53066::DEBUG::2014-05-16 17:03:04,267::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53066::DEBUG::2014-05-16 17:03:04,267::task::579::TaskManager.Task::(_updateState) Task=`0f2df816-87d3-4ab4-944c-9b20b2e779c7`::moving from state init -> state preparing >Thread-53066::INFO::2014-05-16 17:03:04,267::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53066::DEBUG::2014-05-16 17:03:04,267::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`97e88f9c-c227-430e-b5d1-b19ea1358635`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53066::DEBUG::2014-05-16 17:03:04,268::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53066::DEBUG::2014-05-16 17:03:04,268::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53066::DEBUG::2014-05-16 17:03:04,268::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`97e88f9c-c227-430e-b5d1-b19ea1358635`::Granted request >Thread-53066::DEBUG::2014-05-16 17:03:04,268::task::811::TaskManager.Task::(resourceAcquired) Task=`0f2df816-87d3-4ab4-944c-9b20b2e779c7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53066::DEBUG::2014-05-16 17:03:04,268::task::974::TaskManager.Task::(_decref) Task=`0f2df816-87d3-4ab4-944c-9b20b2e779c7`::ref 1 aborting False >Thread-53066::INFO::2014-05-16 17:03:04,269::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53066::DEBUG::2014-05-16 17:03:04,269::task::1168::TaskManager.Task::(prepare) Task=`0f2df816-87d3-4ab4-944c-9b20b2e779c7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53066::DEBUG::2014-05-16 17:03:04,269::task::579::TaskManager.Task::(_updateState) Task=`0f2df816-87d3-4ab4-944c-9b20b2e779c7`::moving from state preparing -> state finished >Thread-53066::DEBUG::2014-05-16 17:03:04,270::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53066::DEBUG::2014-05-16 17:03:04,270::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53066::DEBUG::2014-05-16 17:03:04,270::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53066::DEBUG::2014-05-16 17:03:04,270::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53066::DEBUG::2014-05-16 17:03:04,270::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53066::DEBUG::2014-05-16 17:03:04,270::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53066::DEBUG::2014-05-16 17:03:04,271::task::974::TaskManager.Task::(_decref) Task=`0f2df816-87d3-4ab4-944c-9b20b2e779c7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:03:05,031::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:05,101::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339592 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:07,113::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:07,185::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035663 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:09,196::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:09,263::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303826 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:03:10,847::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:03:10,857::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107286 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:11,275::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:11,345::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347967 s, 29.4 MB/s\n'; <rc> = 0 >Thread-53069::DEBUG::2014-05-16 17:03:11,920::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5411069.000000 / 8.008427 / 262500000.000000 = 0.257399 >Thread-53069::DEBUG::2014-05-16 17:03:11,920::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0067475588361832388, 'statsAge': 0.79028987884521484, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25739881030502509, 'rxDropped': 0} >Thread-53069::DEBUG::2014-05-16 17:03:11,921::task::579::TaskManager.Task::(_updateState) Task=`39652bc9-d008-404b-b589-53101a385e0b`::moving from state init -> state preparing >Thread-53069::INFO::2014-05-16 17:03:11,922::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53069::INFO::2014-05-16 17:03:11,922::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107286', 'lastCheck': '1.0', 'valid': True}} >Thread-53069::DEBUG::2014-05-16 17:03:11,922::task::1168::TaskManager.Task::(prepare) Task=`39652bc9-d008-404b-b589-53101a385e0b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107286', 'lastCheck': '1.0', 'valid': True}} >Thread-53069::DEBUG::2014-05-16 17:03:11,922::task::579::TaskManager.Task::(_updateState) Task=`39652bc9-d008-404b-b589-53101a385e0b`::moving from state preparing -> state finished >Thread-53069::DEBUG::2014-05-16 17:03:11,922::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53069::DEBUG::2014-05-16 17:03:11,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53069::DEBUG::2014-05-16 17:03:11,923::task::974::TaskManager.Task::(_decref) Task=`39652bc9-d008-404b-b589-53101a385e0b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:03:13,356::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:13,425::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317666 s, 32.2 MB/s\n'; <rc> = 0 >Thread-53071::DEBUG::2014-05-16 17:03:14,331::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53071::DEBUG::2014-05-16 17:03:14,333::task::579::TaskManager.Task::(_updateState) Task=`02af7ad6-89b1-41d7-aeea-13ca354dd93a`::moving from state init -> state preparing >Thread-53071::INFO::2014-05-16 17:03:14,334::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53071::INFO::2014-05-16 17:03:14,335::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53071::DEBUG::2014-05-16 17:03:14,336::task::1168::TaskManager.Task::(prepare) Task=`02af7ad6-89b1-41d7-aeea-13ca354dd93a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53071::DEBUG::2014-05-16 17:03:14,337::task::579::TaskManager.Task::(_updateState) Task=`02af7ad6-89b1-41d7-aeea-13ca354dd93a`::moving from state preparing -> state finished >Thread-53071::DEBUG::2014-05-16 17:03:14,337::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53071::DEBUG::2014-05-16 17:03:14,338::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53071::DEBUG::2014-05-16 17:03:14,339::task::974::TaskManager.Task::(_decref) Task=`02af7ad6-89b1-41d7-aeea-13ca354dd93a`::ref 0 aborting False >Thread-53072::DEBUG::2014-05-16 17:03:14,350::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53072::DEBUG::2014-05-16 17:03:14,350::task::579::TaskManager.Task::(_updateState) Task=`5ab5f0b9-6488-40ac-9d23-bff415e8c4de`::moving from state init -> state preparing >Thread-53072::INFO::2014-05-16 17:03:14,350::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53072::DEBUG::2014-05-16 17:03:14,350::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8c67971f-f6c6-47cb-be9d-6d3714702d2a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53072::DEBUG::2014-05-16 17:03:14,351::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53072::DEBUG::2014-05-16 17:03:14,351::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53072::DEBUG::2014-05-16 17:03:14,351::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8c67971f-f6c6-47cb-be9d-6d3714702d2a`::Granted request >Thread-53072::DEBUG::2014-05-16 17:03:14,351::task::811::TaskManager.Task::(resourceAcquired) Task=`5ab5f0b9-6488-40ac-9d23-bff415e8c4de`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53072::DEBUG::2014-05-16 17:03:14,351::task::974::TaskManager.Task::(_decref) Task=`5ab5f0b9-6488-40ac-9d23-bff415e8c4de`::ref 1 aborting False >Thread-53072::INFO::2014-05-16 17:03:14,352::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53072::DEBUG::2014-05-16 17:03:14,352::task::1168::TaskManager.Task::(prepare) Task=`5ab5f0b9-6488-40ac-9d23-bff415e8c4de`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53072::DEBUG::2014-05-16 17:03:14,352::task::579::TaskManager.Task::(_updateState) Task=`5ab5f0b9-6488-40ac-9d23-bff415e8c4de`::moving from state preparing -> state finished >Thread-53072::DEBUG::2014-05-16 17:03:14,353::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53072::DEBUG::2014-05-16 17:03:14,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53072::DEBUG::2014-05-16 17:03:14,353::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53072::DEBUG::2014-05-16 17:03:14,353::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53072::DEBUG::2014-05-16 17:03:14,353::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53072::DEBUG::2014-05-16 17:03:14,353::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53072::DEBUG::2014-05-16 17:03:14,354::task::974::TaskManager.Task::(_decref) Task=`5ab5f0b9-6488-40ac-9d23-bff415e8c4de`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:03:15,437::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:15,504::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307786 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:17,515::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:17,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364061 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:19,599::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:19,666::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311518 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:03:20,892::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:03:20,903::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113177 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:21,678::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:21,750::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359353 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:23,762::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:23,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353021 s, 29.0 MB/s\n'; <rc> = 0 >Thread-53077::DEBUG::2014-05-16 17:03:24,397::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53077::DEBUG::2014-05-16 17:03:24,398::task::579::TaskManager.Task::(_updateState) Task=`d8c9bcb6-e89e-4044-8b33-c4f4d158019e`::moving from state init -> state preparing >Thread-53077::INFO::2014-05-16 17:03:24,398::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53077::INFO::2014-05-16 17:03:24,398::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53077::DEBUG::2014-05-16 17:03:24,398::task::1168::TaskManager.Task::(prepare) Task=`d8c9bcb6-e89e-4044-8b33-c4f4d158019e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53077::DEBUG::2014-05-16 17:03:24,398::task::579::TaskManager.Task::(_updateState) Task=`d8c9bcb6-e89e-4044-8b33-c4f4d158019e`::moving from state preparing -> state finished >Thread-53077::DEBUG::2014-05-16 17:03:24,398::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53077::DEBUG::2014-05-16 17:03:24,399::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53077::DEBUG::2014-05-16 17:03:24,399::task::974::TaskManager.Task::(_decref) Task=`d8c9bcb6-e89e-4044-8b33-c4f4d158019e`::ref 0 aborting False >Thread-53078::DEBUG::2014-05-16 17:03:24,408::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53078::DEBUG::2014-05-16 17:03:24,408::task::579::TaskManager.Task::(_updateState) Task=`bcc11bd1-bc98-4d93-b458-dca51965d814`::moving from state init -> state preparing >Thread-53078::INFO::2014-05-16 17:03:24,409::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53078::DEBUG::2014-05-16 17:03:24,409::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e3f7ccdd-16f1-4dc9-81fb-6b4a54a2c62f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53078::DEBUG::2014-05-16 17:03:24,409::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53078::DEBUG::2014-05-16 17:03:24,409::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53078::DEBUG::2014-05-16 17:03:24,410::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e3f7ccdd-16f1-4dc9-81fb-6b4a54a2c62f`::Granted request >Thread-53078::DEBUG::2014-05-16 17:03:24,410::task::811::TaskManager.Task::(resourceAcquired) Task=`bcc11bd1-bc98-4d93-b458-dca51965d814`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53078::DEBUG::2014-05-16 17:03:24,410::task::974::TaskManager.Task::(_decref) Task=`bcc11bd1-bc98-4d93-b458-dca51965d814`::ref 1 aborting False >Thread-53078::INFO::2014-05-16 17:03:24,411::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53078::DEBUG::2014-05-16 17:03:24,411::task::1168::TaskManager.Task::(prepare) Task=`bcc11bd1-bc98-4d93-b458-dca51965d814`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53078::DEBUG::2014-05-16 17:03:24,411::task::579::TaskManager.Task::(_updateState) Task=`bcc11bd1-bc98-4d93-b458-dca51965d814`::moving from state preparing -> state finished >Thread-53078::DEBUG::2014-05-16 17:03:24,411::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53078::DEBUG::2014-05-16 17:03:24,411::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53078::DEBUG::2014-05-16 17:03:24,411::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53078::DEBUG::2014-05-16 17:03:24,411::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53078::DEBUG::2014-05-16 17:03:24,412::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53078::DEBUG::2014-05-16 17:03:24,412::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53078::DEBUG::2014-05-16 17:03:24,412::task::974::TaskManager.Task::(_decref) Task=`bcc11bd1-bc98-4d93-b458-dca51965d814`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:03:25,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:25,912::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302121 s, 33.9 MB/s\n'; <rc> = 0 >Thread-53079::DEBUG::2014-05-16 17:03:27,094::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314920.000000 / 8.008483 / 262500000.000000 = 0.205255 >Thread-53079::DEBUG::2014-05-16 17:03:27,095::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053477579873105474, 'statsAge': 1.9502780437469482, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20525473567990277, 'rxDropped': 0} >Thread-53079::DEBUG::2014-05-16 17:03:27,095::task::579::TaskManager.Task::(_updateState) Task=`ce90ba4b-3752-4dd0-b3da-7853ba6f5a19`::moving from state init -> state preparing >Thread-53079::INFO::2014-05-16 17:03:27,095::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53079::INFO::2014-05-16 17:03:27,096::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113177', 'lastCheck': '6.2', 'valid': True}} >Thread-53079::DEBUG::2014-05-16 17:03:27,096::task::1168::TaskManager.Task::(prepare) Task=`ce90ba4b-3752-4dd0-b3da-7853ba6f5a19`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113177', 'lastCheck': '6.2', 'valid': True}} >Thread-53079::DEBUG::2014-05-16 17:03:27,096::task::579::TaskManager.Task::(_updateState) Task=`ce90ba4b-3752-4dd0-b3da-7853ba6f5a19`::moving from state preparing -> state finished >Thread-53079::DEBUG::2014-05-16 17:03:27,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53079::DEBUG::2014-05-16 17:03:27,096::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53079::DEBUG::2014-05-16 17:03:27,097::task::974::TaskManager.Task::(_decref) Task=`ce90ba4b-3752-4dd0-b3da-7853ba6f5a19`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:03:27,924::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:27,996::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353329 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:30,008::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:30,076::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312155 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:03:30,939::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:03:30,949::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000779936 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:32,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:32,159::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357379 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:34,171::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:34,238::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03102 s, 33.0 MB/s\n'; <rc> = 0 >Thread-53083::DEBUG::2014-05-16 17:03:34,465::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53083::DEBUG::2014-05-16 17:03:34,466::task::579::TaskManager.Task::(_updateState) Task=`d972280f-d036-4ddf-90b1-a2104c8d3ae5`::moving from state init -> state preparing >Thread-53083::INFO::2014-05-16 17:03:34,466::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53083::INFO::2014-05-16 17:03:34,466::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53083::DEBUG::2014-05-16 17:03:34,467::task::1168::TaskManager.Task::(prepare) Task=`d972280f-d036-4ddf-90b1-a2104c8d3ae5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53083::DEBUG::2014-05-16 17:03:34,467::task::579::TaskManager.Task::(_updateState) Task=`d972280f-d036-4ddf-90b1-a2104c8d3ae5`::moving from state preparing -> state finished >Thread-53083::DEBUG::2014-05-16 17:03:34,467::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53083::DEBUG::2014-05-16 17:03:34,467::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53083::DEBUG::2014-05-16 17:03:34,467::task::974::TaskManager.Task::(_decref) Task=`d972280f-d036-4ddf-90b1-a2104c8d3ae5`::ref 0 aborting False >Thread-53084::DEBUG::2014-05-16 17:03:34,481::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53084::DEBUG::2014-05-16 17:03:34,481::task::579::TaskManager.Task::(_updateState) Task=`aebcec26-3786-4c0a-bf5b-d2dfbeb1e141`::moving from state init -> state preparing >Thread-53084::INFO::2014-05-16 17:03:34,481::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53084::DEBUG::2014-05-16 17:03:34,482::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9e08fe48-cdaf-4f5c-a6a6-702a5a6dd3f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53084::DEBUG::2014-05-16 17:03:34,482::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53084::DEBUG::2014-05-16 17:03:34,482::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53084::DEBUG::2014-05-16 17:03:34,482::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9e08fe48-cdaf-4f5c-a6a6-702a5a6dd3f0`::Granted request >Thread-53084::DEBUG::2014-05-16 17:03:34,483::task::811::TaskManager.Task::(resourceAcquired) Task=`aebcec26-3786-4c0a-bf5b-d2dfbeb1e141`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53084::DEBUG::2014-05-16 17:03:34,483::task::974::TaskManager.Task::(_decref) Task=`aebcec26-3786-4c0a-bf5b-d2dfbeb1e141`::ref 1 aborting False >Thread-53084::INFO::2014-05-16 17:03:34,484::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53084::DEBUG::2014-05-16 17:03:34,484::task::1168::TaskManager.Task::(prepare) Task=`aebcec26-3786-4c0a-bf5b-d2dfbeb1e141`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53084::DEBUG::2014-05-16 17:03:34,484::task::579::TaskManager.Task::(_updateState) Task=`aebcec26-3786-4c0a-bf5b-d2dfbeb1e141`::moving from state preparing -> state finished >Thread-53084::DEBUG::2014-05-16 17:03:34,484::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53084::DEBUG::2014-05-16 17:03:34,485::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53084::DEBUG::2014-05-16 17:03:34,485::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53084::DEBUG::2014-05-16 17:03:34,485::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53084::DEBUG::2014-05-16 17:03:34,485::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53084::DEBUG::2014-05-16 17:03:34,485::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53084::DEBUG::2014-05-16 17:03:34,485::task::974::TaskManager.Task::(_decref) Task=`aebcec26-3786-4c0a-bf5b-d2dfbeb1e141`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:03:36,250::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:36,317::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304967 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:38,329::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:38,401::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03653 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:40,413::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:40,479::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302873 s, 33.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:03:40,986::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:03:40,996::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759391 s, 5.4 MB/s\n'; <rc> = 0 >Thread-53087::DEBUG::2014-05-16 17:03:42,301::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315590.000000 / 8.008246 / 262500000.000000 = 0.205293 >Thread-53087::DEBUG::2014-05-16 17:03:42,301::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053795027336046332, 'statsAge': 1.1403100490570068, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20529268169461137, 'rxDropped': 0} >Thread-53087::DEBUG::2014-05-16 17:03:42,302::task::579::TaskManager.Task::(_updateState) Task=`92cdd25d-3405-4072-8160-88804dd7338c`::moving from state init -> state preparing >Thread-53087::INFO::2014-05-16 17:03:42,302::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53087::INFO::2014-05-16 17:03:42,302::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759391', 'lastCheck': '1.3', 'valid': True}} >Thread-53087::DEBUG::2014-05-16 17:03:42,302::task::1168::TaskManager.Task::(prepare) Task=`92cdd25d-3405-4072-8160-88804dd7338c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759391', 'lastCheck': '1.3', 'valid': True}} >Thread-53087::DEBUG::2014-05-16 17:03:42,303::task::579::TaskManager.Task::(_updateState) Task=`92cdd25d-3405-4072-8160-88804dd7338c`::moving from state preparing -> state finished >Thread-53087::DEBUG::2014-05-16 17:03:42,303::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53087::DEBUG::2014-05-16 17:03:42,303::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53087::DEBUG::2014-05-16 17:03:42,303::task::974::TaskManager.Task::(_decref) Task=`92cdd25d-3405-4072-8160-88804dd7338c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:03:42,491::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:42,562::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351185 s, 29.2 MB/s\n'; <rc> = 0 >Thread-53089::DEBUG::2014-05-16 17:03:44,530::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53089::DEBUG::2014-05-16 17:03:44,530::task::579::TaskManager.Task::(_updateState) Task=`8f264947-08f2-4d94-a1e4-c2c0b8478e56`::moving from state init -> state preparing >Thread-53089::INFO::2014-05-16 17:03:44,531::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53089::INFO::2014-05-16 17:03:44,531::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53089::DEBUG::2014-05-16 17:03:44,531::task::1168::TaskManager.Task::(prepare) Task=`8f264947-08f2-4d94-a1e4-c2c0b8478e56`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53089::DEBUG::2014-05-16 17:03:44,531::task::579::TaskManager.Task::(_updateState) Task=`8f264947-08f2-4d94-a1e4-c2c0b8478e56`::moving from state preparing -> state finished >Thread-53089::DEBUG::2014-05-16 17:03:44,531::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53089::DEBUG::2014-05-16 17:03:44,532::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53089::DEBUG::2014-05-16 17:03:44,532::task::974::TaskManager.Task::(_decref) Task=`8f264947-08f2-4d94-a1e4-c2c0b8478e56`::ref 0 aborting False >Thread-53090::DEBUG::2014-05-16 17:03:44,545::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53090::DEBUG::2014-05-16 17:03:44,545::task::579::TaskManager.Task::(_updateState) Task=`9d05e230-45d1-47f8-a441-fab04b6eb2a6`::moving from state init -> state preparing >Thread-53090::INFO::2014-05-16 17:03:44,545::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53090::DEBUG::2014-05-16 17:03:44,546::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`edf9a6e3-5dc2-4406-9901-4ed12159c8a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53090::DEBUG::2014-05-16 17:03:44,546::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53090::DEBUG::2014-05-16 17:03:44,546::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53090::DEBUG::2014-05-16 17:03:44,546::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`edf9a6e3-5dc2-4406-9901-4ed12159c8a8`::Granted request >Thread-53090::DEBUG::2014-05-16 17:03:44,547::task::811::TaskManager.Task::(resourceAcquired) Task=`9d05e230-45d1-47f8-a441-fab04b6eb2a6`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53090::DEBUG::2014-05-16 17:03:44,547::task::974::TaskManager.Task::(_decref) Task=`9d05e230-45d1-47f8-a441-fab04b6eb2a6`::ref 1 aborting False >Thread-53090::INFO::2014-05-16 17:03:44,547::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53090::DEBUG::2014-05-16 17:03:44,548::task::1168::TaskManager.Task::(prepare) Task=`9d05e230-45d1-47f8-a441-fab04b6eb2a6`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53090::DEBUG::2014-05-16 17:03:44,548::task::579::TaskManager.Task::(_updateState) Task=`9d05e230-45d1-47f8-a441-fab04b6eb2a6`::moving from state preparing -> state finished >Thread-53090::DEBUG::2014-05-16 17:03:44,548::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53090::DEBUG::2014-05-16 17:03:44,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53090::DEBUG::2014-05-16 17:03:44,548::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53090::DEBUG::2014-05-16 17:03:44,548::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53090::DEBUG::2014-05-16 17:03:44,549::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53090::DEBUG::2014-05-16 17:03:44,549::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53090::DEBUG::2014-05-16 17:03:44,549::task::974::TaskManager.Task::(_decref) Task=`9d05e230-45d1-47f8-a441-fab04b6eb2a6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:03:44,574::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:44,645::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349894 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:46,656::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:46,723::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303234 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:48,736::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:48,802::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303367 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:50,813::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:50,953::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10289 s, 10.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:03:51,033::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:03:51,043::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721453 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:52,964::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:53,038::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035894 s, 28.5 MB/s\n'; <rc> = 0 >Thread-53095::DEBUG::2014-05-16 17:03:54,582::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53095::DEBUG::2014-05-16 17:03:54,582::task::579::TaskManager.Task::(_updateState) Task=`b43f7ef6-4a42-4b19-b1da-f6276215cd79`::moving from state init -> state preparing >Thread-53095::INFO::2014-05-16 17:03:54,582::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53095::INFO::2014-05-16 17:03:54,583::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53095::DEBUG::2014-05-16 17:03:54,583::task::1168::TaskManager.Task::(prepare) Task=`b43f7ef6-4a42-4b19-b1da-f6276215cd79`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53095::DEBUG::2014-05-16 17:03:54,583::task::579::TaskManager.Task::(_updateState) Task=`b43f7ef6-4a42-4b19-b1da-f6276215cd79`::moving from state preparing -> state finished >Thread-53095::DEBUG::2014-05-16 17:03:54,583::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53095::DEBUG::2014-05-16 17:03:54,583::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53095::DEBUG::2014-05-16 17:03:54,583::task::974::TaskManager.Task::(_decref) Task=`b43f7ef6-4a42-4b19-b1da-f6276215cd79`::ref 0 aborting False >Thread-53096::DEBUG::2014-05-16 17:03:54,592::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53096::DEBUG::2014-05-16 17:03:54,592::task::579::TaskManager.Task::(_updateState) Task=`fe4c71bf-7756-4704-9c5f-454cad13a6ed`::moving from state init -> state preparing >Thread-53096::INFO::2014-05-16 17:03:54,592::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53096::DEBUG::2014-05-16 17:03:54,593::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8e124fbd-2fa8-4416-9e77-613a956c4583`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53096::DEBUG::2014-05-16 17:03:54,593::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53096::DEBUG::2014-05-16 17:03:54,593::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53096::DEBUG::2014-05-16 17:03:54,593::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8e124fbd-2fa8-4416-9e77-613a956c4583`::Granted request >Thread-53096::DEBUG::2014-05-16 17:03:54,593::task::811::TaskManager.Task::(resourceAcquired) Task=`fe4c71bf-7756-4704-9c5f-454cad13a6ed`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53096::DEBUG::2014-05-16 17:03:54,594::task::974::TaskManager.Task::(_decref) Task=`fe4c71bf-7756-4704-9c5f-454cad13a6ed`::ref 1 aborting False >Thread-53096::INFO::2014-05-16 17:03:54,594::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53096::DEBUG::2014-05-16 17:03:54,594::task::1168::TaskManager.Task::(prepare) Task=`fe4c71bf-7756-4704-9c5f-454cad13a6ed`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53096::DEBUG::2014-05-16 17:03:54,594::task::579::TaskManager.Task::(_updateState) Task=`fe4c71bf-7756-4704-9c5f-454cad13a6ed`::moving from state preparing -> state finished >Thread-53096::DEBUG::2014-05-16 17:03:54,595::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53096::DEBUG::2014-05-16 17:03:54,595::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53096::DEBUG::2014-05-16 17:03:54,595::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53096::DEBUG::2014-05-16 17:03:54,595::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53096::DEBUG::2014-05-16 17:03:54,595::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53096::DEBUG::2014-05-16 17:03:54,595::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53096::DEBUG::2014-05-16 17:03:54,596::task::974::TaskManager.Task::(_decref) Task=`fe4c71bf-7756-4704-9c5f-454cad13a6ed`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:03:55,050::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:55,117::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308098 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:03:57,129::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:57,205::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353254 s, 29.0 MB/s\n'; <rc> = 0 >Thread-53097::DEBUG::2014-05-16 17:03:57,469::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3243509.000000 / 8.008510 / 262500000.000000 = 0.154289 >Thread-53097::DEBUG::2014-05-16 17:03:57,469::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.004097641198536772, 'statsAge': 0.29130196571350098, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15428868735604942, 'rxDropped': 0} >Thread-53097::DEBUG::2014-05-16 17:03:57,469::task::579::TaskManager.Task::(_updateState) Task=`dd8b76db-3363-41cb-8cf7-e3b6f14636b2`::moving from state init -> state preparing >Thread-53097::INFO::2014-05-16 17:03:57,470::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53097::INFO::2014-05-16 17:03:57,470::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721453', 'lastCheck': '6.4', 'valid': True}} >Thread-53097::DEBUG::2014-05-16 17:03:57,470::task::1168::TaskManager.Task::(prepare) Task=`dd8b76db-3363-41cb-8cf7-e3b6f14636b2`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721453', 'lastCheck': '6.4', 'valid': True}} >Thread-53097::DEBUG::2014-05-16 17:03:57,470::task::579::TaskManager.Task::(_updateState) Task=`dd8b76db-3363-41cb-8cf7-e3b6f14636b2`::moving from state preparing -> state finished >Thread-53097::DEBUG::2014-05-16 17:03:57,470::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53097::DEBUG::2014-05-16 17:03:57,471::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53097::DEBUG::2014-05-16 17:03:57,471::task::974::TaskManager.Task::(_decref) Task=`dd8b76db-3363-41cb-8cf7-e3b6f14636b2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:03:59,217::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:03:59,288::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350408 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:04:01,076::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:04:01,086::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000948175 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:01,300::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:01,370::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350998 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:03,382::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:03,450::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315909 s, 32.4 MB/s\n'; <rc> = 0 >Thread-53101::DEBUG::2014-05-16 17:04:04,642::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53101::DEBUG::2014-05-16 17:04:04,643::task::579::TaskManager.Task::(_updateState) Task=`d6f5d227-9e23-4dc3-954b-286df911a563`::moving from state init -> state preparing >Thread-53101::INFO::2014-05-16 17:04:04,643::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53101::INFO::2014-05-16 17:04:04,643::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53101::DEBUG::2014-05-16 17:04:04,643::task::1168::TaskManager.Task::(prepare) Task=`d6f5d227-9e23-4dc3-954b-286df911a563`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53101::DEBUG::2014-05-16 17:04:04,643::task::579::TaskManager.Task::(_updateState) Task=`d6f5d227-9e23-4dc3-954b-286df911a563`::moving from state preparing -> state finished >Thread-53101::DEBUG::2014-05-16 17:04:04,644::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53101::DEBUG::2014-05-16 17:04:04,644::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53101::DEBUG::2014-05-16 17:04:04,644::task::974::TaskManager.Task::(_decref) Task=`d6f5d227-9e23-4dc3-954b-286df911a563`::ref 0 aborting False >Thread-53102::DEBUG::2014-05-16 17:04:04,653::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53102::DEBUG::2014-05-16 17:04:04,653::task::579::TaskManager.Task::(_updateState) Task=`967b5100-5b5b-458d-862d-4a9ce6f42334`::moving from state init -> state preparing >Thread-53102::INFO::2014-05-16 17:04:04,653::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53102::DEBUG::2014-05-16 17:04:04,653::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`220ecb48-8cfc-4c1c-9dd2-9ca3c6417198`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53102::DEBUG::2014-05-16 17:04:04,654::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53102::DEBUG::2014-05-16 17:04:04,654::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53102::DEBUG::2014-05-16 17:04:04,654::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`220ecb48-8cfc-4c1c-9dd2-9ca3c6417198`::Granted request >Thread-53102::DEBUG::2014-05-16 17:04:04,654::task::811::TaskManager.Task::(resourceAcquired) Task=`967b5100-5b5b-458d-862d-4a9ce6f42334`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53102::DEBUG::2014-05-16 17:04:04,654::task::974::TaskManager.Task::(_decref) Task=`967b5100-5b5b-458d-862d-4a9ce6f42334`::ref 1 aborting False >Thread-53102::INFO::2014-05-16 17:04:04,655::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53102::DEBUG::2014-05-16 17:04:04,655::task::1168::TaskManager.Task::(prepare) Task=`967b5100-5b5b-458d-862d-4a9ce6f42334`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53102::DEBUG::2014-05-16 17:04:04,655::task::579::TaskManager.Task::(_updateState) Task=`967b5100-5b5b-458d-862d-4a9ce6f42334`::moving from state preparing -> state finished >Thread-53102::DEBUG::2014-05-16 17:04:04,656::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53102::DEBUG::2014-05-16 17:04:04,656::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53102::DEBUG::2014-05-16 17:04:04,656::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53102::DEBUG::2014-05-16 17:04:04,656::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53102::DEBUG::2014-05-16 17:04:04,656::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53102::DEBUG::2014-05-16 17:04:04,656::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53102::DEBUG::2014-05-16 17:04:04,657::task::974::TaskManager.Task::(_decref) Task=`967b5100-5b5b-458d-862d-4a9ce6f42334`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:04:05,461::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:05,532::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358578 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:07,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:07,616::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360885 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:09,628::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:09,702::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314908 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:04:11,123::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:04:11,133::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000936121 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:11,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:11,786::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360638 s, 28.4 MB/s\n'; <rc> = 0 >Thread-53105::DEBUG::2014-05-16 17:04:12,720::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5412061.000000 / 8.008251 / 262500000.000000 = 0.257452 >Thread-53105::DEBUG::2014-05-16 17:04:12,720::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066330636258991969, 'statsAge': 1.5248880386352539, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25745166281965914, 'rxDropped': 0} >Thread-53105::DEBUG::2014-05-16 17:04:12,721::task::579::TaskManager.Task::(_updateState) Task=`4189e067-7177-41c1-8852-253a03c12283`::moving from state init -> state preparing >Thread-53105::INFO::2014-05-16 17:04:12,721::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53105::INFO::2014-05-16 17:04:12,721::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000936121', 'lastCheck': '1.6', 'valid': True}} >Thread-53105::DEBUG::2014-05-16 17:04:12,722::task::1168::TaskManager.Task::(prepare) Task=`4189e067-7177-41c1-8852-253a03c12283`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000936121', 'lastCheck': '1.6', 'valid': True}} >Thread-53105::DEBUG::2014-05-16 17:04:12,722::task::579::TaskManager.Task::(_updateState) Task=`4189e067-7177-41c1-8852-253a03c12283`::moving from state preparing -> state finished >Thread-53105::DEBUG::2014-05-16 17:04:12,722::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53105::DEBUG::2014-05-16 17:04:12,722::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53105::DEBUG::2014-05-16 17:04:12,722::task::974::TaskManager.Task::(_decref) Task=`4189e067-7177-41c1-8852-253a03c12283`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:04:13,798::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:13,870::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354332 s, 28.9 MB/s\n'; <rc> = 0 >Thread-53107::DEBUG::2014-05-16 17:04:14,699::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53107::DEBUG::2014-05-16 17:04:14,700::task::579::TaskManager.Task::(_updateState) Task=`9448eeb5-6316-4f5f-838c-99c8aaeadff8`::moving from state init -> state preparing >Thread-53107::INFO::2014-05-16 17:04:14,700::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53107::INFO::2014-05-16 17:04:14,700::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53107::DEBUG::2014-05-16 17:04:14,701::task::1168::TaskManager.Task::(prepare) Task=`9448eeb5-6316-4f5f-838c-99c8aaeadff8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53107::DEBUG::2014-05-16 17:04:14,701::task::579::TaskManager.Task::(_updateState) Task=`9448eeb5-6316-4f5f-838c-99c8aaeadff8`::moving from state preparing -> state finished >Thread-53107::DEBUG::2014-05-16 17:04:14,701::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53107::DEBUG::2014-05-16 17:04:14,701::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53107::DEBUG::2014-05-16 17:04:14,701::task::974::TaskManager.Task::(_decref) Task=`9448eeb5-6316-4f5f-838c-99c8aaeadff8`::ref 0 aborting False >Thread-53108::DEBUG::2014-05-16 17:04:14,710::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53108::DEBUG::2014-05-16 17:04:14,711::task::579::TaskManager.Task::(_updateState) Task=`c76e9f92-4e18-4246-920b-92b4d90ee1a4`::moving from state init -> state preparing >Thread-53108::INFO::2014-05-16 17:04:14,711::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53108::DEBUG::2014-05-16 17:04:14,711::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9e96d6ba-022a-4cd5-a0e2-cba78b53bccc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53108::DEBUG::2014-05-16 17:04:14,712::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53108::DEBUG::2014-05-16 17:04:14,712::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53108::DEBUG::2014-05-16 17:04:14,712::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9e96d6ba-022a-4cd5-a0e2-cba78b53bccc`::Granted request >Thread-53108::DEBUG::2014-05-16 17:04:14,712::task::811::TaskManager.Task::(resourceAcquired) Task=`c76e9f92-4e18-4246-920b-92b4d90ee1a4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53108::DEBUG::2014-05-16 17:04:14,712::task::974::TaskManager.Task::(_decref) Task=`c76e9f92-4e18-4246-920b-92b4d90ee1a4`::ref 1 aborting False >Thread-53108::INFO::2014-05-16 17:04:14,713::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53108::DEBUG::2014-05-16 17:04:14,713::task::1168::TaskManager.Task::(prepare) Task=`c76e9f92-4e18-4246-920b-92b4d90ee1a4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53108::DEBUG::2014-05-16 17:04:14,713::task::579::TaskManager.Task::(_updateState) Task=`c76e9f92-4e18-4246-920b-92b4d90ee1a4`::moving from state preparing -> state finished >Thread-53108::DEBUG::2014-05-16 17:04:14,714::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53108::DEBUG::2014-05-16 17:04:14,714::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53108::DEBUG::2014-05-16 17:04:14,714::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53108::DEBUG::2014-05-16 17:04:14,714::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53108::DEBUG::2014-05-16 17:04:14,714::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53108::DEBUG::2014-05-16 17:04:14,714::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53108::DEBUG::2014-05-16 17:04:14,715::task::974::TaskManager.Task::(_decref) Task=`c76e9f92-4e18-4246-920b-92b4d90ee1a4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:04:15,881::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:15,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306017 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:17,959::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:18,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317441 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:20,039::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:20,110::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350698 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:04:21,167::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:04:21,177::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000853479 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:22,122::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:22,197::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388269 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:24,208::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:24,275::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310001 s, 33.0 MB/s\n'; <rc> = 0 >Thread-53112::DEBUG::2014-05-16 17:04:24,743::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53112::DEBUG::2014-05-16 17:04:24,743::task::579::TaskManager.Task::(_updateState) Task=`b1b7f54a-e269-46b5-a96e-9d4319fc4a53`::moving from state init -> state preparing >Thread-53112::INFO::2014-05-16 17:04:24,743::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53112::INFO::2014-05-16 17:04:24,744::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53112::DEBUG::2014-05-16 17:04:24,744::task::1168::TaskManager.Task::(prepare) Task=`b1b7f54a-e269-46b5-a96e-9d4319fc4a53`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53112::DEBUG::2014-05-16 17:04:24,744::task::579::TaskManager.Task::(_updateState) Task=`b1b7f54a-e269-46b5-a96e-9d4319fc4a53`::moving from state preparing -> state finished >Thread-53112::DEBUG::2014-05-16 17:04:24,744::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53112::DEBUG::2014-05-16 17:04:24,744::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53112::DEBUG::2014-05-16 17:04:24,745::task::974::TaskManager.Task::(_decref) Task=`b1b7f54a-e269-46b5-a96e-9d4319fc4a53`::ref 0 aborting False >Thread-53113::DEBUG::2014-05-16 17:04:24,753::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53113::DEBUG::2014-05-16 17:04:24,753::task::579::TaskManager.Task::(_updateState) Task=`59a44c7b-cf3a-47b9-9467-4b4d0dc188ed`::moving from state init -> state preparing >Thread-53113::INFO::2014-05-16 17:04:24,754::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53113::DEBUG::2014-05-16 17:04:24,754::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d1030d16-3a72-44d6-92e6-0ff3bd8a0a7a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53113::DEBUG::2014-05-16 17:04:24,754::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53113::DEBUG::2014-05-16 17:04:24,754::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53113::DEBUG::2014-05-16 17:04:24,754::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d1030d16-3a72-44d6-92e6-0ff3bd8a0a7a`::Granted request >Thread-53113::DEBUG::2014-05-16 17:04:24,755::task::811::TaskManager.Task::(resourceAcquired) Task=`59a44c7b-cf3a-47b9-9467-4b4d0dc188ed`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53113::DEBUG::2014-05-16 17:04:24,755::task::974::TaskManager.Task::(_decref) Task=`59a44c7b-cf3a-47b9-9467-4b4d0dc188ed`::ref 1 aborting False >Thread-53113::INFO::2014-05-16 17:04:24,756::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53113::DEBUG::2014-05-16 17:04:24,756::task::1168::TaskManager.Task::(prepare) Task=`59a44c7b-cf3a-47b9-9467-4b4d0dc188ed`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53113::DEBUG::2014-05-16 17:04:24,756::task::579::TaskManager.Task::(_updateState) Task=`59a44c7b-cf3a-47b9-9467-4b4d0dc188ed`::moving from state preparing -> state finished >Thread-53113::DEBUG::2014-05-16 17:04:24,756::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53113::DEBUG::2014-05-16 17:04:24,756::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53113::DEBUG::2014-05-16 17:04:24,756::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53113::DEBUG::2014-05-16 17:04:24,757::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53113::DEBUG::2014-05-16 17:04:24,757::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53113::DEBUG::2014-05-16 17:04:24,757::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53113::DEBUG::2014-05-16 17:04:24,757::task::974::TaskManager.Task::(_decref) Task=`59a44c7b-cf3a-47b9-9467-4b4d0dc188ed`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:04:26,287::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:26,358::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354638 s, 28.9 MB/s\n'; <rc> = 0 >Thread-53115::DEBUG::2014-05-16 17:04:28,014::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318775.000000 / 8.008425 / 262500000.000000 = 0.205440 >Thread-53115::DEBUG::2014-05-16 17:04:28,014::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054007884869036278, 'statsAge': 0.8020169734954834, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20543959887196322, 'rxDropped': 0} >Thread-53115::DEBUG::2014-05-16 17:04:28,014::task::579::TaskManager.Task::(_updateState) Task=`8eca4b12-d8f1-4946-a846-0c7877de998f`::moving from state init -> state preparing >Thread-53115::INFO::2014-05-16 17:04:28,014::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53115::INFO::2014-05-16 17:04:28,015::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000853479', 'lastCheck': '6.8', 'valid': True}} >Thread-53115::DEBUG::2014-05-16 17:04:28,015::task::1168::TaskManager.Task::(prepare) Task=`8eca4b12-d8f1-4946-a846-0c7877de998f`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000853479', 'lastCheck': '6.8', 'valid': True}} >Thread-53115::DEBUG::2014-05-16 17:04:28,015::task::579::TaskManager.Task::(_updateState) Task=`8eca4b12-d8f1-4946-a846-0c7877de998f`::moving from state preparing -> state finished >Thread-53115::DEBUG::2014-05-16 17:04:28,015::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53115::DEBUG::2014-05-16 17:04:28,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53115::DEBUG::2014-05-16 17:04:28,015::task::974::TaskManager.Task::(_decref) Task=`8eca4b12-d8f1-4946-a846-0c7877de998f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:04:28,370::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:28,440::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344699 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:30,453::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:30,520::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310068 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:04:31,214::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:04:31,228::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734505 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:32,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:32,602::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346879 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:34,613::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:34,682::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313952 s, 32.6 MB/s\n'; <rc> = 0 >Thread-53119::DEBUG::2014-05-16 17:04:34,879::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53119::DEBUG::2014-05-16 17:04:34,880::task::579::TaskManager.Task::(_updateState) Task=`687abc08-c233-4c54-9ced-f3adbd461aab`::moving from state init -> state preparing >Thread-53119::INFO::2014-05-16 17:04:34,880::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53119::INFO::2014-05-16 17:04:34,880::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53119::DEBUG::2014-05-16 17:04:34,880::task::1168::TaskManager.Task::(prepare) Task=`687abc08-c233-4c54-9ced-f3adbd461aab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53119::DEBUG::2014-05-16 17:04:34,880::task::579::TaskManager.Task::(_updateState) Task=`687abc08-c233-4c54-9ced-f3adbd461aab`::moving from state preparing -> state finished >Thread-53119::DEBUG::2014-05-16 17:04:34,881::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53119::DEBUG::2014-05-16 17:04:34,881::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53119::DEBUG::2014-05-16 17:04:34,881::task::974::TaskManager.Task::(_decref) Task=`687abc08-c233-4c54-9ced-f3adbd461aab`::ref 0 aborting False >Thread-53120::DEBUG::2014-05-16 17:04:34,889::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53120::DEBUG::2014-05-16 17:04:34,890::task::579::TaskManager.Task::(_updateState) Task=`ae622ddd-0b35-4551-87e6-ab4f07147870`::moving from state init -> state preparing >Thread-53120::INFO::2014-05-16 17:04:34,890::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53120::DEBUG::2014-05-16 17:04:34,890::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`985d335d-55eb-4efb-9fb0-b88bfcc34399`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53120::DEBUG::2014-05-16 17:04:34,890::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53120::DEBUG::2014-05-16 17:04:34,891::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53120::DEBUG::2014-05-16 17:04:34,891::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`985d335d-55eb-4efb-9fb0-b88bfcc34399`::Granted request >Thread-53120::DEBUG::2014-05-16 17:04:34,891::task::811::TaskManager.Task::(resourceAcquired) Task=`ae622ddd-0b35-4551-87e6-ab4f07147870`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53120::DEBUG::2014-05-16 17:04:34,891::task::974::TaskManager.Task::(_decref) Task=`ae622ddd-0b35-4551-87e6-ab4f07147870`::ref 1 aborting False >Thread-53120::INFO::2014-05-16 17:04:34,892::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53120::DEBUG::2014-05-16 17:04:34,892::task::1168::TaskManager.Task::(prepare) Task=`ae622ddd-0b35-4551-87e6-ab4f07147870`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53120::DEBUG::2014-05-16 17:04:34,892::task::579::TaskManager.Task::(_updateState) Task=`ae622ddd-0b35-4551-87e6-ab4f07147870`::moving from state preparing -> state finished >Thread-53120::DEBUG::2014-05-16 17:04:34,892::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53120::DEBUG::2014-05-16 17:04:34,893::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53120::DEBUG::2014-05-16 17:04:34,893::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53120::DEBUG::2014-05-16 17:04:34,893::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53120::DEBUG::2014-05-16 17:04:34,893::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53120::DEBUG::2014-05-16 17:04:34,893::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53120::DEBUG::2014-05-16 17:04:34,893::task::974::TaskManager.Task::(_decref) Task=`ae622ddd-0b35-4551-87e6-ab4f07147870`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:04:36,693::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:36,760::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311625 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:38,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:38,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352137 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:40,855::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:40,934::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309128 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:04:41,265::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:04:41,276::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000777635 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:42,949::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:43,021::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357247 s, 28.7 MB/s\n'; <rc> = 0 >Thread-53123::DEBUG::2014-05-16 17:04:43,487::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3239263.000000 / 8.008424 / 262500000.000000 = 0.154088 >Thread-53123::DEBUG::2014-05-16 17:04:43,487::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0040957823569230233, 'statsAge': 0.24987196922302246, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15408836316036265, 'rxDropped': 0} >Thread-53123::DEBUG::2014-05-16 17:04:43,488::task::579::TaskManager.Task::(_updateState) Task=`d038c5da-dcf5-429d-96c5-4b947913ad55`::moving from state init -> state preparing >Thread-53123::INFO::2014-05-16 17:04:43,488::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53123::INFO::2014-05-16 17:04:43,488::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777635', 'lastCheck': '2.2', 'valid': True}} >Thread-53123::DEBUG::2014-05-16 17:04:43,488::task::1168::TaskManager.Task::(prepare) Task=`d038c5da-dcf5-429d-96c5-4b947913ad55`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777635', 'lastCheck': '2.2', 'valid': True}} >Thread-53123::DEBUG::2014-05-16 17:04:43,488::task::579::TaskManager.Task::(_updateState) Task=`d038c5da-dcf5-429d-96c5-4b947913ad55`::moving from state preparing -> state finished >Thread-53123::DEBUG::2014-05-16 17:04:43,489::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53123::DEBUG::2014-05-16 17:04:43,489::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53123::DEBUG::2014-05-16 17:04:43,489::task::974::TaskManager.Task::(_decref) Task=`d038c5da-dcf5-429d-96c5-4b947913ad55`::ref 0 aborting False >Thread-53125::DEBUG::2014-05-16 17:04:44,937::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53125::DEBUG::2014-05-16 17:04:44,938::task::579::TaskManager.Task::(_updateState) Task=`26db7e77-3e54-4beb-a5fb-1f454b032d8b`::moving from state init -> state preparing >Thread-53125::INFO::2014-05-16 17:04:44,938::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53125::INFO::2014-05-16 17:04:44,938::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53125::DEBUG::2014-05-16 17:04:44,938::task::1168::TaskManager.Task::(prepare) Task=`26db7e77-3e54-4beb-a5fb-1f454b032d8b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53125::DEBUG::2014-05-16 17:04:44,938::task::579::TaskManager.Task::(_updateState) Task=`26db7e77-3e54-4beb-a5fb-1f454b032d8b`::moving from state preparing -> state finished >Thread-53125::DEBUG::2014-05-16 17:04:44,938::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53125::DEBUG::2014-05-16 17:04:44,939::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53125::DEBUG::2014-05-16 17:04:44,939::task::974::TaskManager.Task::(_decref) Task=`26db7e77-3e54-4beb-a5fb-1f454b032d8b`::ref 0 aborting False >Thread-53126::DEBUG::2014-05-16 17:04:44,947::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53126::DEBUG::2014-05-16 17:04:44,947::task::579::TaskManager.Task::(_updateState) Task=`d67f45c3-a2b8-42f6-b0dc-abeeb80080a4`::moving from state init -> state preparing >Thread-53126::INFO::2014-05-16 17:04:44,947::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53126::DEBUG::2014-05-16 17:04:44,948::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`93d94f0d-db33-4c3e-b4c2-d80f6794ae4b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53126::DEBUG::2014-05-16 17:04:44,948::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53126::DEBUG::2014-05-16 17:04:44,948::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53126::DEBUG::2014-05-16 17:04:44,948::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`93d94f0d-db33-4c3e-b4c2-d80f6794ae4b`::Granted request >Thread-53126::DEBUG::2014-05-16 17:04:44,948::task::811::TaskManager.Task::(resourceAcquired) Task=`d67f45c3-a2b8-42f6-b0dc-abeeb80080a4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53126::DEBUG::2014-05-16 17:04:44,949::task::974::TaskManager.Task::(_decref) Task=`d67f45c3-a2b8-42f6-b0dc-abeeb80080a4`::ref 1 aborting False >Thread-53126::INFO::2014-05-16 17:04:44,949::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53126::DEBUG::2014-05-16 17:04:44,949::task::1168::TaskManager.Task::(prepare) Task=`d67f45c3-a2b8-42f6-b0dc-abeeb80080a4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53126::DEBUG::2014-05-16 17:04:44,949::task::579::TaskManager.Task::(_updateState) Task=`d67f45c3-a2b8-42f6-b0dc-abeeb80080a4`::moving from state preparing -> state finished >Thread-53126::DEBUG::2014-05-16 17:04:44,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53126::DEBUG::2014-05-16 17:04:44,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53126::DEBUG::2014-05-16 17:04:44,950::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53126::DEBUG::2014-05-16 17:04:44,950::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53126::DEBUG::2014-05-16 17:04:44,950::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53126::DEBUG::2014-05-16 17:04:44,950::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53126::DEBUG::2014-05-16 17:04:44,950::task::974::TaskManager.Task::(_decref) Task=`d67f45c3-a2b8-42f6-b0dc-abeeb80080a4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:04:45,033::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:45,100::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317176 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:47,112::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:47,184::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356854 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:49,195::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:49,267::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030451 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:51,278::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 17:04:51,316::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:04:51,340::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672549 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:51,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.163468 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:53,491::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:53,562::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359332 s, 28.5 MB/s\n'; <rc> = 0 >Thread-53130::DEBUG::2014-05-16 17:04:55,032::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53130::DEBUG::2014-05-16 17:04:55,032::task::579::TaskManager.Task::(_updateState) Task=`14a56211-6d6a-408b-9adb-236addd434a7`::moving from state init -> state preparing >Thread-53130::INFO::2014-05-16 17:04:55,032::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53130::INFO::2014-05-16 17:04:55,033::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53130::DEBUG::2014-05-16 17:04:55,033::task::1168::TaskManager.Task::(prepare) Task=`14a56211-6d6a-408b-9adb-236addd434a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53130::DEBUG::2014-05-16 17:04:55,033::task::579::TaskManager.Task::(_updateState) Task=`14a56211-6d6a-408b-9adb-236addd434a7`::moving from state preparing -> state finished >Thread-53130::DEBUG::2014-05-16 17:04:55,033::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53130::DEBUG::2014-05-16 17:04:55,033::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53130::DEBUG::2014-05-16 17:04:55,033::task::974::TaskManager.Task::(_decref) Task=`14a56211-6d6a-408b-9adb-236addd434a7`::ref 0 aborting False >Thread-53131::DEBUG::2014-05-16 17:04:55,062::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53131::DEBUG::2014-05-16 17:04:55,063::task::579::TaskManager.Task::(_updateState) Task=`397a47ef-c04c-488f-99c1-4c8512675971`::moving from state init -> state preparing >Thread-53131::INFO::2014-05-16 17:04:55,063::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53131::DEBUG::2014-05-16 17:04:55,063::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fa0e8876-d3d5-4ecf-8b32-fa6a80662421`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53131::DEBUG::2014-05-16 17:04:55,063::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53131::DEBUG::2014-05-16 17:04:55,063::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53131::DEBUG::2014-05-16 17:04:55,063::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fa0e8876-d3d5-4ecf-8b32-fa6a80662421`::Granted request >Thread-53131::DEBUG::2014-05-16 17:04:55,064::task::811::TaskManager.Task::(resourceAcquired) Task=`397a47ef-c04c-488f-99c1-4c8512675971`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53131::DEBUG::2014-05-16 17:04:55,064::task::974::TaskManager.Task::(_decref) Task=`397a47ef-c04c-488f-99c1-4c8512675971`::ref 1 aborting False >Thread-53131::INFO::2014-05-16 17:04:55,064::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53131::DEBUG::2014-05-16 17:04:55,065::task::1168::TaskManager.Task::(prepare) Task=`397a47ef-c04c-488f-99c1-4c8512675971`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53131::DEBUG::2014-05-16 17:04:55,065::task::579::TaskManager.Task::(_updateState) Task=`397a47ef-c04c-488f-99c1-4c8512675971`::moving from state preparing -> state finished >Thread-53131::DEBUG::2014-05-16 17:04:55,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53131::DEBUG::2014-05-16 17:04:55,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53131::DEBUG::2014-05-16 17:04:55,065::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53131::DEBUG::2014-05-16 17:04:55,065::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53131::DEBUG::2014-05-16 17:04:55,065::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53131::DEBUG::2014-05-16 17:04:55,066::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53131::DEBUG::2014-05-16 17:04:55,066::task::974::TaskManager.Task::(_decref) Task=`397a47ef-c04c-488f-99c1-4c8512675971`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:04:55,574::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:55,641::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310692 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:04:57,658::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:57,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359994 s, 28.4 MB/s\n'; <rc> = 0 >Thread-53133::DEBUG::2014-05-16 17:04:58,667::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318971.000000 / 8.010851 / 262500000.000000 = 0.205387 >Thread-53133::DEBUG::2014-05-16 17:04:58,667::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053748999989250267, 'statsAge': 1.4073929786682129, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20538670061098527, 'rxDropped': 0} >Thread-53133::DEBUG::2014-05-16 17:04:58,668::task::579::TaskManager.Task::(_updateState) Task=`abdda736-ccfc-4fe1-afab-a8687fc34a86`::moving from state init -> state preparing >Thread-53133::INFO::2014-05-16 17:04:58,668::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53133::INFO::2014-05-16 17:04:58,668::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672549', 'lastCheck': '7.2', 'valid': True}} >Thread-53133::DEBUG::2014-05-16 17:04:58,669::task::1168::TaskManager.Task::(prepare) Task=`abdda736-ccfc-4fe1-afab-a8687fc34a86`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672549', 'lastCheck': '7.2', 'valid': True}} >Thread-53133::DEBUG::2014-05-16 17:04:58,669::task::579::TaskManager.Task::(_updateState) Task=`abdda736-ccfc-4fe1-afab-a8687fc34a86`::moving from state preparing -> state finished >Thread-53133::DEBUG::2014-05-16 17:04:58,669::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53133::DEBUG::2014-05-16 17:04:58,669::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53133::DEBUG::2014-05-16 17:04:58,669::task::974::TaskManager.Task::(_decref) Task=`abdda736-ccfc-4fe1-afab-a8687fc34a86`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:04:59,742::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:04:59,813::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349222 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:05:01,457::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:05:01,467::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100292 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:01,825::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:01,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365953 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:03,910::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:03,977::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308651 s, 33.2 MB/s\n'; <rc> = 0 >Thread-53137::DEBUG::2014-05-16 17:05:05,141::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53137::DEBUG::2014-05-16 17:05:05,142::task::579::TaskManager.Task::(_updateState) Task=`05faa42f-0db0-4886-9635-d21c15869968`::moving from state init -> state preparing >Thread-53137::INFO::2014-05-16 17:05:05,142::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53137::INFO::2014-05-16 17:05:05,142::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53137::DEBUG::2014-05-16 17:05:05,143::task::1168::TaskManager.Task::(prepare) Task=`05faa42f-0db0-4886-9635-d21c15869968`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53137::DEBUG::2014-05-16 17:05:05,143::task::579::TaskManager.Task::(_updateState) Task=`05faa42f-0db0-4886-9635-d21c15869968`::moving from state preparing -> state finished >Thread-53137::DEBUG::2014-05-16 17:05:05,143::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53137::DEBUG::2014-05-16 17:05:05,143::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53137::DEBUG::2014-05-16 17:05:05,143::task::974::TaskManager.Task::(_decref) Task=`05faa42f-0db0-4886-9635-d21c15869968`::ref 0 aborting False >Thread-53138::DEBUG::2014-05-16 17:05:05,154::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53138::DEBUG::2014-05-16 17:05:05,154::task::579::TaskManager.Task::(_updateState) Task=`61bccd98-9c8e-44c3-94ff-03738f3af581`::moving from state init -> state preparing >Thread-53138::INFO::2014-05-16 17:05:05,154::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53138::DEBUG::2014-05-16 17:05:05,155::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cb368057-435b-4070-841e-0618339c4b1a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53138::DEBUG::2014-05-16 17:05:05,155::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53138::DEBUG::2014-05-16 17:05:05,155::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53138::DEBUG::2014-05-16 17:05:05,155::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cb368057-435b-4070-841e-0618339c4b1a`::Granted request >Thread-53138::DEBUG::2014-05-16 17:05:05,156::task::811::TaskManager.Task::(resourceAcquired) Task=`61bccd98-9c8e-44c3-94ff-03738f3af581`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53138::DEBUG::2014-05-16 17:05:05,156::task::974::TaskManager.Task::(_decref) Task=`61bccd98-9c8e-44c3-94ff-03738f3af581`::ref 1 aborting False >Thread-53138::INFO::2014-05-16 17:05:05,156::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53138::DEBUG::2014-05-16 17:05:05,157::task::1168::TaskManager.Task::(prepare) Task=`61bccd98-9c8e-44c3-94ff-03738f3af581`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53138::DEBUG::2014-05-16 17:05:05,157::task::579::TaskManager.Task::(_updateState) Task=`61bccd98-9c8e-44c3-94ff-03738f3af581`::moving from state preparing -> state finished >Thread-53138::DEBUG::2014-05-16 17:05:05,157::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53138::DEBUG::2014-05-16 17:05:05,157::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53138::DEBUG::2014-05-16 17:05:05,157::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53138::DEBUG::2014-05-16 17:05:05,157::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53138::DEBUG::2014-05-16 17:05:05,158::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53138::DEBUG::2014-05-16 17:05:05,158::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53138::DEBUG::2014-05-16 17:05:05,158::task::974::TaskManager.Task::(_decref) Task=`61bccd98-9c8e-44c3-94ff-03738f3af581`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:05:05,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:06,056::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307769 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:08,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:08,139::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340402 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:10,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:10,217::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308628 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:05:11,504::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:05:11,515::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000900963 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:12,228::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:12,296::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312909 s, 32.7 MB/s\n'; <rc> = 0 >Thread-53141::DEBUG::2014-05-16 17:05:13,839::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5422051.000000 / 8.008376 / 262500000.000000 = 0.257923 >Thread-53141::DEBUG::2014-05-16 17:05:13,839::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.006809727457714001, 'statsAge': 0.56210803985595703, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25792286329285707, 'rxDropped': 0} >Thread-53141::DEBUG::2014-05-16 17:05:13,839::task::579::TaskManager.Task::(_updateState) Task=`3bdde6f6-f0ab-423b-9473-45fdead08508`::moving from state init -> state preparing >Thread-53141::INFO::2014-05-16 17:05:13,839::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53141::INFO::2014-05-16 17:05:13,840::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000900963', 'lastCheck': '2.3', 'valid': True}} >Thread-53141::DEBUG::2014-05-16 17:05:13,840::task::1168::TaskManager.Task::(prepare) Task=`3bdde6f6-f0ab-423b-9473-45fdead08508`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000900963', 'lastCheck': '2.3', 'valid': True}} >Thread-53141::DEBUG::2014-05-16 17:05:13,840::task::579::TaskManager.Task::(_updateState) Task=`3bdde6f6-f0ab-423b-9473-45fdead08508`::moving from state preparing -> state finished >Thread-53141::DEBUG::2014-05-16 17:05:13,840::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53141::DEBUG::2014-05-16 17:05:13,840::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53141::DEBUG::2014-05-16 17:05:13,841::task::974::TaskManager.Task::(_decref) Task=`3bdde6f6-f0ab-423b-9473-45fdead08508`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:05:14,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:14,379::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353477 s, 29.0 MB/s\n'; <rc> = 0 >Thread-53143::DEBUG::2014-05-16 17:05:15,202::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53143::DEBUG::2014-05-16 17:05:15,203::task::579::TaskManager.Task::(_updateState) Task=`dd4de9ea-b9e8-4607-89b0-ee28898f7dfb`::moving from state init -> state preparing >Thread-53143::INFO::2014-05-16 17:05:15,203::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53143::INFO::2014-05-16 17:05:15,203::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53143::DEBUG::2014-05-16 17:05:15,203::task::1168::TaskManager.Task::(prepare) Task=`dd4de9ea-b9e8-4607-89b0-ee28898f7dfb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53143::DEBUG::2014-05-16 17:05:15,204::task::579::TaskManager.Task::(_updateState) Task=`dd4de9ea-b9e8-4607-89b0-ee28898f7dfb`::moving from state preparing -> state finished >Thread-53143::DEBUG::2014-05-16 17:05:15,204::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53143::DEBUG::2014-05-16 17:05:15,204::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53143::DEBUG::2014-05-16 17:05:15,204::task::974::TaskManager.Task::(_decref) Task=`dd4de9ea-b9e8-4607-89b0-ee28898f7dfb`::ref 0 aborting False >Thread-53144::DEBUG::2014-05-16 17:05:15,213::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53144::DEBUG::2014-05-16 17:05:15,214::task::579::TaskManager.Task::(_updateState) Task=`24dffd24-54e2-435f-867a-2cf19fa45696`::moving from state init -> state preparing >Thread-53144::INFO::2014-05-16 17:05:15,214::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53144::DEBUG::2014-05-16 17:05:15,215::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`77faccd7-13ba-47e7-874c-b7f7ce16bbb9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53144::DEBUG::2014-05-16 17:05:15,215::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53144::DEBUG::2014-05-16 17:05:15,215::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53144::DEBUG::2014-05-16 17:05:15,215::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`77faccd7-13ba-47e7-874c-b7f7ce16bbb9`::Granted request >Thread-53144::DEBUG::2014-05-16 17:05:15,215::task::811::TaskManager.Task::(resourceAcquired) Task=`24dffd24-54e2-435f-867a-2cf19fa45696`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53144::DEBUG::2014-05-16 17:05:15,216::task::974::TaskManager.Task::(_decref) Task=`24dffd24-54e2-435f-867a-2cf19fa45696`::ref 1 aborting False >Thread-53144::INFO::2014-05-16 17:05:15,216::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53144::DEBUG::2014-05-16 17:05:15,216::task::1168::TaskManager.Task::(prepare) Task=`24dffd24-54e2-435f-867a-2cf19fa45696`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53144::DEBUG::2014-05-16 17:05:15,216::task::579::TaskManager.Task::(_updateState) Task=`24dffd24-54e2-435f-867a-2cf19fa45696`::moving from state preparing -> state finished >Thread-53144::DEBUG::2014-05-16 17:05:15,217::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53144::DEBUG::2014-05-16 17:05:15,217::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53144::DEBUG::2014-05-16 17:05:15,217::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53144::DEBUG::2014-05-16 17:05:15,217::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53144::DEBUG::2014-05-16 17:05:15,217::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53144::DEBUG::2014-05-16 17:05:15,217::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53144::DEBUG::2014-05-16 17:05:15,217::task::974::TaskManager.Task::(_decref) Task=`24dffd24-54e2-435f-867a-2cf19fa45696`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:05:16,391::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:16,457::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302777 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:18,469::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:18,536::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316258 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:20,548::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:20,618::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348771 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:05:21,548::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:05:21,558::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000823841 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:22,630::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:22,704::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361168 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:24,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:24,784::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316421 s, 32.4 MB/s\n'; <rc> = 0 >Thread-53148::DEBUG::2014-05-16 17:05:25,276::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53148::DEBUG::2014-05-16 17:05:25,277::task::579::TaskManager.Task::(_updateState) Task=`7433879c-5398-4ef7-84c4-827900558950`::moving from state init -> state preparing >Thread-53148::INFO::2014-05-16 17:05:25,277::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53148::INFO::2014-05-16 17:05:25,277::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53148::DEBUG::2014-05-16 17:05:25,277::task::1168::TaskManager.Task::(prepare) Task=`7433879c-5398-4ef7-84c4-827900558950`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53148::DEBUG::2014-05-16 17:05:25,278::task::579::TaskManager.Task::(_updateState) Task=`7433879c-5398-4ef7-84c4-827900558950`::moving from state preparing -> state finished >Thread-53148::DEBUG::2014-05-16 17:05:25,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53148::DEBUG::2014-05-16 17:05:25,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53148::DEBUG::2014-05-16 17:05:25,278::task::974::TaskManager.Task::(_decref) Task=`7433879c-5398-4ef7-84c4-827900558950`::ref 0 aborting False >Thread-53149::DEBUG::2014-05-16 17:05:25,286::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53149::DEBUG::2014-05-16 17:05:25,287::task::579::TaskManager.Task::(_updateState) Task=`8cd71f5e-b04a-4d83-b442-0a9400e399ca`::moving from state init -> state preparing >Thread-53149::INFO::2014-05-16 17:05:25,287::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53149::DEBUG::2014-05-16 17:05:25,287::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`81ab28fb-a0a0-4db6-a5b4-48d82884dfa3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53149::DEBUG::2014-05-16 17:05:25,287::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53149::DEBUG::2014-05-16 17:05:25,288::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53149::DEBUG::2014-05-16 17:05:25,288::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`81ab28fb-a0a0-4db6-a5b4-48d82884dfa3`::Granted request >Thread-53149::DEBUG::2014-05-16 17:05:25,288::task::811::TaskManager.Task::(resourceAcquired) Task=`8cd71f5e-b04a-4d83-b442-0a9400e399ca`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53149::DEBUG::2014-05-16 17:05:25,288::task::974::TaskManager.Task::(_decref) Task=`8cd71f5e-b04a-4d83-b442-0a9400e399ca`::ref 1 aborting False >Thread-53149::INFO::2014-05-16 17:05:25,291::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53149::DEBUG::2014-05-16 17:05:25,291::task::1168::TaskManager.Task::(prepare) Task=`8cd71f5e-b04a-4d83-b442-0a9400e399ca`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53149::DEBUG::2014-05-16 17:05:25,292::task::579::TaskManager.Task::(_updateState) Task=`8cd71f5e-b04a-4d83-b442-0a9400e399ca`::moving from state preparing -> state finished >Thread-53149::DEBUG::2014-05-16 17:05:25,293::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53149::DEBUG::2014-05-16 17:05:25,293::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53149::DEBUG::2014-05-16 17:05:25,294::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53149::DEBUG::2014-05-16 17:05:25,294::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53149::DEBUG::2014-05-16 17:05:25,294::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53149::DEBUG::2014-05-16 17:05:25,295::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53149::DEBUG::2014-05-16 17:05:25,295::task::974::TaskManager.Task::(_decref) Task=`8cd71f5e-b04a-4d83-b442-0a9400e399ca`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:05:26,796::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:26,867::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353151 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:28,878::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:28,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343392 s, 29.8 MB/s\n'; <rc> = 0 >Thread-53151::DEBUG::2014-05-16 17:05:29,120::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3245941.000000 / 8.011778 / 262500000.000000 = 0.154341 >Thread-53151::DEBUG::2014-05-16 17:05:29,120::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041648206632232919, 'statsAge': 1.8251669406890869, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15434138769726771, 'rxDropped': 0} >Thread-53151::DEBUG::2014-05-16 17:05:29,120::task::579::TaskManager.Task::(_updateState) Task=`3df069de-3cdb-4ebd-9a7a-5b38ec6f334b`::moving from state init -> state preparing >Thread-53151::INFO::2014-05-16 17:05:29,121::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53151::INFO::2014-05-16 17:05:29,121::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823841', 'lastCheck': '7.5', 'valid': True}} >Thread-53151::DEBUG::2014-05-16 17:05:29,121::task::1168::TaskManager.Task::(prepare) Task=`3df069de-3cdb-4ebd-9a7a-5b38ec6f334b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823841', 'lastCheck': '7.5', 'valid': True}} >Thread-53151::DEBUG::2014-05-16 17:05:29,121::task::579::TaskManager.Task::(_updateState) Task=`3df069de-3cdb-4ebd-9a7a-5b38ec6f334b`::moving from state preparing -> state finished >Thread-53151::DEBUG::2014-05-16 17:05:29,121::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53151::DEBUG::2014-05-16 17:05:29,121::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53151::DEBUG::2014-05-16 17:05:29,122::task::974::TaskManager.Task::(_decref) Task=`3df069de-3cdb-4ebd-9a7a-5b38ec6f334b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:05:30,960::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:31,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309113 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:05:31,595::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:05:31,605::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000711653 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:33,039::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:33,106::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309943 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:35,117::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:35,189::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035232 s, 29.1 MB/s\n'; <rc> = 0 >Thread-53155::DEBUG::2014-05-16 17:05:35,354::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53155::DEBUG::2014-05-16 17:05:35,354::task::579::TaskManager.Task::(_updateState) Task=`bd297e37-66cc-4b98-8625-7bd7ad1f7b1b`::moving from state init -> state preparing >Thread-53155::INFO::2014-05-16 17:05:35,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53155::INFO::2014-05-16 17:05:35,355::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53155::DEBUG::2014-05-16 17:05:35,355::task::1168::TaskManager.Task::(prepare) Task=`bd297e37-66cc-4b98-8625-7bd7ad1f7b1b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53155::DEBUG::2014-05-16 17:05:35,355::task::579::TaskManager.Task::(_updateState) Task=`bd297e37-66cc-4b98-8625-7bd7ad1f7b1b`::moving from state preparing -> state finished >Thread-53155::DEBUG::2014-05-16 17:05:35,355::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53155::DEBUG::2014-05-16 17:05:35,355::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53155::DEBUG::2014-05-16 17:05:35,356::task::974::TaskManager.Task::(_decref) Task=`bd297e37-66cc-4b98-8625-7bd7ad1f7b1b`::ref 0 aborting False >Thread-53156::DEBUG::2014-05-16 17:05:35,383::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53156::DEBUG::2014-05-16 17:05:35,383::task::579::TaskManager.Task::(_updateState) Task=`45ab9c19-0167-46ee-842e-f05ff4aca64f`::moving from state init -> state preparing >Thread-53156::INFO::2014-05-16 17:05:35,383::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53156::DEBUG::2014-05-16 17:05:35,384::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6821e300-c87c-4f13-85c4-0a2c35fee37c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53156::DEBUG::2014-05-16 17:05:35,384::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53156::DEBUG::2014-05-16 17:05:35,384::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53156::DEBUG::2014-05-16 17:05:35,384::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6821e300-c87c-4f13-85c4-0a2c35fee37c`::Granted request >Thread-53156::DEBUG::2014-05-16 17:05:35,384::task::811::TaskManager.Task::(resourceAcquired) Task=`45ab9c19-0167-46ee-842e-f05ff4aca64f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53156::DEBUG::2014-05-16 17:05:35,385::task::974::TaskManager.Task::(_decref) Task=`45ab9c19-0167-46ee-842e-f05ff4aca64f`::ref 1 aborting False >Thread-53156::INFO::2014-05-16 17:05:35,385::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53156::DEBUG::2014-05-16 17:05:35,385::task::1168::TaskManager.Task::(prepare) Task=`45ab9c19-0167-46ee-842e-f05ff4aca64f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53156::DEBUG::2014-05-16 17:05:35,386::task::579::TaskManager.Task::(_updateState) Task=`45ab9c19-0167-46ee-842e-f05ff4aca64f`::moving from state preparing -> state finished >Thread-53156::DEBUG::2014-05-16 17:05:35,386::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53156::DEBUG::2014-05-16 17:05:35,386::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53156::DEBUG::2014-05-16 17:05:35,386::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53156::DEBUG::2014-05-16 17:05:35,386::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53156::DEBUG::2014-05-16 17:05:35,386::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53156::DEBUG::2014-05-16 17:05:35,387::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53156::DEBUG::2014-05-16 17:05:35,387::task::974::TaskManager.Task::(_decref) Task=`45ab9c19-0167-46ee-842e-f05ff4aca64f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:05:37,200::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:37,267::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311812 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:39,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:39,350::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351054 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:41,362::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:41,434::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342539 s, 29.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:05:41,642::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:05:41,652::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000750377 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:43,446::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:43,519::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357921 s, 28.6 MB/s\n'; <rc> = 0 >Thread-53159::DEBUG::2014-05-16 17:05:44,275::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313844.000000 / 8.010270 / 262500000.000000 = 0.205158 >Thread-53159::DEBUG::2014-05-16 17:05:44,275::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053823284512195422, 'statsAge': 0.96188998222351074, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20515776852742429, 'rxDropped': 0} >Thread-53159::DEBUG::2014-05-16 17:05:44,276::task::579::TaskManager.Task::(_updateState) Task=`c696fd33-8760-4f06-a94b-fc08b2a35f5c`::moving from state init -> state preparing >Thread-53159::INFO::2014-05-16 17:05:44,276::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53159::INFO::2014-05-16 17:05:44,276::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750377', 'lastCheck': '2.6', 'valid': True}} >Thread-53159::DEBUG::2014-05-16 17:05:44,276::task::1168::TaskManager.Task::(prepare) Task=`c696fd33-8760-4f06-a94b-fc08b2a35f5c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750377', 'lastCheck': '2.6', 'valid': True}} >Thread-53159::DEBUG::2014-05-16 17:05:44,276::task::579::TaskManager.Task::(_updateState) Task=`c696fd33-8760-4f06-a94b-fc08b2a35f5c`::moving from state preparing -> state finished >Thread-53159::DEBUG::2014-05-16 17:05:44,277::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53159::DEBUG::2014-05-16 17:05:44,277::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53159::DEBUG::2014-05-16 17:05:44,277::task::974::TaskManager.Task::(_decref) Task=`c696fd33-8760-4f06-a94b-fc08b2a35f5c`::ref 0 aborting False >Thread-53161::DEBUG::2014-05-16 17:05:45,424::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53161::DEBUG::2014-05-16 17:05:45,424::task::579::TaskManager.Task::(_updateState) Task=`e08bb05d-fbe9-412b-af7f-1afa051e8fb8`::moving from state init -> state preparing >Thread-53161::INFO::2014-05-16 17:05:45,424::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53161::INFO::2014-05-16 17:05:45,425::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53161::DEBUG::2014-05-16 17:05:45,425::task::1168::TaskManager.Task::(prepare) Task=`e08bb05d-fbe9-412b-af7f-1afa051e8fb8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53161::DEBUG::2014-05-16 17:05:45,425::task::579::TaskManager.Task::(_updateState) Task=`e08bb05d-fbe9-412b-af7f-1afa051e8fb8`::moving from state preparing -> state finished >Thread-53161::DEBUG::2014-05-16 17:05:45,425::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53161::DEBUG::2014-05-16 17:05:45,425::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53161::DEBUG::2014-05-16 17:05:45,425::task::974::TaskManager.Task::(_decref) Task=`e08bb05d-fbe9-412b-af7f-1afa051e8fb8`::ref 0 aborting False >Thread-53162::DEBUG::2014-05-16 17:05:45,434::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53162::DEBUG::2014-05-16 17:05:45,435::task::579::TaskManager.Task::(_updateState) Task=`5d01183a-29c7-4297-a0be-c41638eae991`::moving from state init -> state preparing >Thread-53162::INFO::2014-05-16 17:05:45,435::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53162::DEBUG::2014-05-16 17:05:45,435::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b987e6f2-ab28-4b6a-b409-67ec1fefe213`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53162::DEBUG::2014-05-16 17:05:45,435::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53162::DEBUG::2014-05-16 17:05:45,435::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53162::DEBUG::2014-05-16 17:05:45,435::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b987e6f2-ab28-4b6a-b409-67ec1fefe213`::Granted request >Thread-53162::DEBUG::2014-05-16 17:05:45,436::task::811::TaskManager.Task::(resourceAcquired) Task=`5d01183a-29c7-4297-a0be-c41638eae991`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53162::DEBUG::2014-05-16 17:05:45,436::task::974::TaskManager.Task::(_decref) Task=`5d01183a-29c7-4297-a0be-c41638eae991`::ref 1 aborting False >Thread-53162::INFO::2014-05-16 17:05:45,436::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53162::DEBUG::2014-05-16 17:05:45,437::task::1168::TaskManager.Task::(prepare) Task=`5d01183a-29c7-4297-a0be-c41638eae991`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53162::DEBUG::2014-05-16 17:05:45,437::task::579::TaskManager.Task::(_updateState) Task=`5d01183a-29c7-4297-a0be-c41638eae991`::moving from state preparing -> state finished >Thread-53162::DEBUG::2014-05-16 17:05:45,437::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53162::DEBUG::2014-05-16 17:05:45,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53162::DEBUG::2014-05-16 17:05:45,437::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53162::DEBUG::2014-05-16 17:05:45,437::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53162::DEBUG::2014-05-16 17:05:45,437::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53162::DEBUG::2014-05-16 17:05:45,438::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53162::DEBUG::2014-05-16 17:05:45,438::task::974::TaskManager.Task::(_decref) Task=`5d01183a-29c7-4297-a0be-c41638eae991`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:05:45,530::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:45,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310699 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:47,608::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:47,681::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367178 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:49,693::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:49,760::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302229 s, 33.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:05:51,685::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:05:51,695::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000566148 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:51,771::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:51,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351972 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:53,855::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:53,927::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360909 s, 28.4 MB/s\n'; <rc> = 0 >Thread-53166::DEBUG::2014-05-16 17:05:55,463::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53166::DEBUG::2014-05-16 17:05:55,463::task::579::TaskManager.Task::(_updateState) Task=`2f7a606c-8099-4813-8331-b7097ded5fe7`::moving from state init -> state preparing >Thread-53166::INFO::2014-05-16 17:05:55,464::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53166::INFO::2014-05-16 17:05:55,464::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53166::DEBUG::2014-05-16 17:05:55,464::task::1168::TaskManager.Task::(prepare) Task=`2f7a606c-8099-4813-8331-b7097ded5fe7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53166::DEBUG::2014-05-16 17:05:55,464::task::579::TaskManager.Task::(_updateState) Task=`2f7a606c-8099-4813-8331-b7097ded5fe7`::moving from state preparing -> state finished >Thread-53166::DEBUG::2014-05-16 17:05:55,464::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53166::DEBUG::2014-05-16 17:05:55,464::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53166::DEBUG::2014-05-16 17:05:55,465::task::974::TaskManager.Task::(_decref) Task=`2f7a606c-8099-4813-8331-b7097ded5fe7`::ref 0 aborting False >Thread-53167::DEBUG::2014-05-16 17:05:55,473::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53167::DEBUG::2014-05-16 17:05:55,473::task::579::TaskManager.Task::(_updateState) Task=`86ce26af-f504-4f71-8757-f4fe0791ce7d`::moving from state init -> state preparing >Thread-53167::INFO::2014-05-16 17:05:55,473::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53167::DEBUG::2014-05-16 17:05:55,474::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`34a80ebf-8ba0-4abb-896f-71aca9ae1b71`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53167::DEBUG::2014-05-16 17:05:55,474::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53167::DEBUG::2014-05-16 17:05:55,474::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53167::DEBUG::2014-05-16 17:05:55,474::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`34a80ebf-8ba0-4abb-896f-71aca9ae1b71`::Granted request >Thread-53167::DEBUG::2014-05-16 17:05:55,475::task::811::TaskManager.Task::(resourceAcquired) Task=`86ce26af-f504-4f71-8757-f4fe0791ce7d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53167::DEBUG::2014-05-16 17:05:55,475::task::974::TaskManager.Task::(_decref) Task=`86ce26af-f504-4f71-8757-f4fe0791ce7d`::ref 1 aborting False >Thread-53167::INFO::2014-05-16 17:05:55,475::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53167::DEBUG::2014-05-16 17:05:55,475::task::1168::TaskManager.Task::(prepare) Task=`86ce26af-f504-4f71-8757-f4fe0791ce7d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53167::DEBUG::2014-05-16 17:05:55,476::task::579::TaskManager.Task::(_updateState) Task=`86ce26af-f504-4f71-8757-f4fe0791ce7d`::moving from state preparing -> state finished >Thread-53167::DEBUG::2014-05-16 17:05:55,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53167::DEBUG::2014-05-16 17:05:55,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53167::DEBUG::2014-05-16 17:05:55,476::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53167::DEBUG::2014-05-16 17:05:55,476::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53167::DEBUG::2014-05-16 17:05:55,476::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53167::DEBUG::2014-05-16 17:05:55,476::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53167::DEBUG::2014-05-16 17:05:55,477::task::974::TaskManager.Task::(_decref) Task=`86ce26af-f504-4f71-8757-f4fe0791ce7d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:05:55,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:56,005::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308571 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:05:58,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:05:58,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361969 s, 28.3 MB/s\n'; <rc> = 0 >Thread-53169::DEBUG::2014-05-16 17:05:59,440::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315689.000000 / 8.008092 / 262500000.000000 = 0.205301 >Thread-53169::DEBUG::2014-05-16 17:05:59,440::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052819906482715704, 'statsAge': 0.11080098152160645, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20530133957930441, 'rxDropped': 0} >Thread-53169::DEBUG::2014-05-16 17:05:59,441::task::579::TaskManager.Task::(_updateState) Task=`c38cfe4a-84d0-4fbc-a82d-bd02846a859d`::moving from state init -> state preparing >Thread-53169::INFO::2014-05-16 17:05:59,441::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53169::INFO::2014-05-16 17:05:59,441::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566148', 'lastCheck': '7.7', 'valid': True}} >Thread-53169::DEBUG::2014-05-16 17:05:59,442::task::1168::TaskManager.Task::(prepare) Task=`c38cfe4a-84d0-4fbc-a82d-bd02846a859d`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566148', 'lastCheck': '7.7', 'valid': True}} >Thread-53169::DEBUG::2014-05-16 17:05:59,442::task::579::TaskManager.Task::(_updateState) Task=`c38cfe4a-84d0-4fbc-a82d-bd02846a859d`::moving from state preparing -> state finished >Thread-53169::DEBUG::2014-05-16 17:05:59,442::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53169::DEBUG::2014-05-16 17:05:59,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53169::DEBUG::2014-05-16 17:05:59,442::task::974::TaskManager.Task::(_decref) Task=`c38cfe4a-84d0-4fbc-a82d-bd02846a859d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:06:00,099::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:00,166::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302647 s, 33.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:06:01,733::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:06:01,743::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698328 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:02,177::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:02,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354805 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:04,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:04,327::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314634 s, 32.5 MB/s\n'; <rc> = 0 >Thread-53173::DEBUG::2014-05-16 17:06:05,542::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53173::DEBUG::2014-05-16 17:06:05,543::task::579::TaskManager.Task::(_updateState) Task=`9121fc46-4b69-40ca-bd0f-32800c23d8b9`::moving from state init -> state preparing >Thread-53173::INFO::2014-05-16 17:06:05,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53173::INFO::2014-05-16 17:06:05,543::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53173::DEBUG::2014-05-16 17:06:05,544::task::1168::TaskManager.Task::(prepare) Task=`9121fc46-4b69-40ca-bd0f-32800c23d8b9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53173::DEBUG::2014-05-16 17:06:05,544::task::579::TaskManager.Task::(_updateState) Task=`9121fc46-4b69-40ca-bd0f-32800c23d8b9`::moving from state preparing -> state finished >Thread-53173::DEBUG::2014-05-16 17:06:05,544::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53173::DEBUG::2014-05-16 17:06:05,544::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53173::DEBUG::2014-05-16 17:06:05,544::task::974::TaskManager.Task::(_decref) Task=`9121fc46-4b69-40ca-bd0f-32800c23d8b9`::ref 0 aborting False >Thread-53174::DEBUG::2014-05-16 17:06:05,553::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53174::DEBUG::2014-05-16 17:06:05,553::task::579::TaskManager.Task::(_updateState) Task=`6e000e31-d450-4b95-9ea4-f69dcee5b4c1`::moving from state init -> state preparing >Thread-53174::INFO::2014-05-16 17:06:05,553::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53174::DEBUG::2014-05-16 17:06:05,554::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`16562925-792f-41c7-ad53-8a5d3f0a2444`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53174::DEBUG::2014-05-16 17:06:05,554::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53174::DEBUG::2014-05-16 17:06:05,554::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53174::DEBUG::2014-05-16 17:06:05,554::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`16562925-792f-41c7-ad53-8a5d3f0a2444`::Granted request >Thread-53174::DEBUG::2014-05-16 17:06:05,555::task::811::TaskManager.Task::(resourceAcquired) Task=`6e000e31-d450-4b95-9ea4-f69dcee5b4c1`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53174::DEBUG::2014-05-16 17:06:05,555::task::974::TaskManager.Task::(_decref) Task=`6e000e31-d450-4b95-9ea4-f69dcee5b4c1`::ref 1 aborting False >Thread-53174::INFO::2014-05-16 17:06:05,556::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53174::DEBUG::2014-05-16 17:06:05,556::task::1168::TaskManager.Task::(prepare) Task=`6e000e31-d450-4b95-9ea4-f69dcee5b4c1`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53174::DEBUG::2014-05-16 17:06:05,556::task::579::TaskManager.Task::(_updateState) Task=`6e000e31-d450-4b95-9ea4-f69dcee5b4c1`::moving from state preparing -> state finished >Thread-53174::DEBUG::2014-05-16 17:06:05,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53174::DEBUG::2014-05-16 17:06:05,557::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53174::DEBUG::2014-05-16 17:06:05,557::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53174::DEBUG::2014-05-16 17:06:05,557::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53174::DEBUG::2014-05-16 17:06:05,557::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53174::DEBUG::2014-05-16 17:06:05,557::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53174::DEBUG::2014-05-16 17:06:05,558::task::974::TaskManager.Task::(_decref) Task=`6e000e31-d450-4b95-9ea4-f69dcee5b4c1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:06:06,339::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:06,469::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0820835 s, 12.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:08,485::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:08,558::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371731 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:10,573::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:10,641::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030532 s, 33.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:06:11,764::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 17:06:11,764::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:06:11,782::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:06:11,791::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000731482 s, 2.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:06:11,791::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000731482 s, 2.8 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 17:06:11,791::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 17:06:11,791::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 17:06:11,792::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:06:11,792::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:06:11,792::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:06:11,792::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:06:11,793::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:06:11,793::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:06:11,794::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:06:11,946::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:06:11,947::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:06:11,948::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 17:06:11,949::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 17:06:11,949::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 17:06:11,949::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 17:06:11,949::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:06:12,094::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:06:12,115::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:06:12,124::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000540608 s, 7.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:12,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:12,724::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350634 s, 29.2 MB/s\n'; <rc> = 0 >Thread-53177::DEBUG::2014-05-16 17:06:14,605::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5543727.000000 / 8.008404 / 262500000.000000 = 0.263710 >Thread-53177::DEBUG::2014-05-16 17:06:14,606::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0071549598903589582, 'statsAge': 1.2614591121673584, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.26370997213054803, 'rxDropped': 0} >Thread-53177::DEBUG::2014-05-16 17:06:14,606::task::579::TaskManager.Task::(_updateState) Task=`d54b78c0-67a0-4370-847e-411b420ddd01`::moving from state init -> state preparing >Thread-53177::INFO::2014-05-16 17:06:14,606::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53177::INFO::2014-05-16 17:06:14,607::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540608', 'lastCheck': '2.5', 'valid': True}} >Thread-53177::DEBUG::2014-05-16 17:06:14,607::task::1168::TaskManager.Task::(prepare) Task=`d54b78c0-67a0-4370-847e-411b420ddd01`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540608', 'lastCheck': '2.5', 'valid': True}} >Thread-53177::DEBUG::2014-05-16 17:06:14,607::task::579::TaskManager.Task::(_updateState) Task=`d54b78c0-67a0-4370-847e-411b420ddd01`::moving from state preparing -> state finished >Thread-53177::DEBUG::2014-05-16 17:06:14,607::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53177::DEBUG::2014-05-16 17:06:14,607::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53177::DEBUG::2014-05-16 17:06:14,608::task::974::TaskManager.Task::(_decref) Task=`d54b78c0-67a0-4370-847e-411b420ddd01`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:06:14,735::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:14,912::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350385 s, 29.2 MB/s\n'; <rc> = 0 >Thread-53179::DEBUG::2014-05-16 17:06:15,646::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53179::DEBUG::2014-05-16 17:06:15,646::task::579::TaskManager.Task::(_updateState) Task=`7ffcdf08-b924-4462-8347-1c5d901442c8`::moving from state init -> state preparing >Thread-53179::INFO::2014-05-16 17:06:15,646::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53179::INFO::2014-05-16 17:06:15,646::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53179::DEBUG::2014-05-16 17:06:15,647::task::1168::TaskManager.Task::(prepare) Task=`7ffcdf08-b924-4462-8347-1c5d901442c8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53179::DEBUG::2014-05-16 17:06:15,647::task::579::TaskManager.Task::(_updateState) Task=`7ffcdf08-b924-4462-8347-1c5d901442c8`::moving from state preparing -> state finished >Thread-53179::DEBUG::2014-05-16 17:06:15,647::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53179::DEBUG::2014-05-16 17:06:15,647::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53179::DEBUG::2014-05-16 17:06:15,647::task::974::TaskManager.Task::(_decref) Task=`7ffcdf08-b924-4462-8347-1c5d901442c8`::ref 0 aborting False >Thread-53180::DEBUG::2014-05-16 17:06:15,675::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53180::DEBUG::2014-05-16 17:06:15,675::task::579::TaskManager.Task::(_updateState) Task=`521ed53f-ae06-466f-ba39-1069672451fd`::moving from state init -> state preparing >Thread-53180::INFO::2014-05-16 17:06:15,675::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53180::DEBUG::2014-05-16 17:06:15,675::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f1354055-b4c3-435b-84a1-6698130ab570`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53180::DEBUG::2014-05-16 17:06:15,676::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53180::DEBUG::2014-05-16 17:06:15,676::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53180::DEBUG::2014-05-16 17:06:15,676::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f1354055-b4c3-435b-84a1-6698130ab570`::Granted request >Thread-53180::DEBUG::2014-05-16 17:06:15,676::task::811::TaskManager.Task::(resourceAcquired) Task=`521ed53f-ae06-466f-ba39-1069672451fd`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53180::DEBUG::2014-05-16 17:06:15,676::task::974::TaskManager.Task::(_decref) Task=`521ed53f-ae06-466f-ba39-1069672451fd`::ref 1 aborting False >Thread-53180::INFO::2014-05-16 17:06:15,677::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53180::DEBUG::2014-05-16 17:06:15,677::task::1168::TaskManager.Task::(prepare) Task=`521ed53f-ae06-466f-ba39-1069672451fd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53180::DEBUG::2014-05-16 17:06:15,677::task::579::TaskManager.Task::(_updateState) Task=`521ed53f-ae06-466f-ba39-1069672451fd`::moving from state preparing -> state finished >Thread-53180::DEBUG::2014-05-16 17:06:15,677::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53180::DEBUG::2014-05-16 17:06:15,677::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53180::DEBUG::2014-05-16 17:06:15,678::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53180::DEBUG::2014-05-16 17:06:15,678::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53180::DEBUG::2014-05-16 17:06:15,678::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53180::DEBUG::2014-05-16 17:06:15,678::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53180::DEBUG::2014-05-16 17:06:15,678::task::974::TaskManager.Task::(_decref) Task=`521ed53f-ae06-466f-ba39-1069672451fd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:06:16,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:17,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309174 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:19,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:19,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306171 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:21,106::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:21,173::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307434 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:06:22,162::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:06:22,173::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000757048 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:23,185::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:23,256::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352322 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:25,267::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:25,334::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310056 s, 33.0 MB/s\n'; <rc> = 0 >Thread-53184::DEBUG::2014-05-16 17:06:25,707::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53184::DEBUG::2014-05-16 17:06:25,707::task::579::TaskManager.Task::(_updateState) Task=`8d3fb392-1eab-44c9-8505-5faa7c564642`::moving from state init -> state preparing >Thread-53184::INFO::2014-05-16 17:06:25,708::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53184::INFO::2014-05-16 17:06:25,708::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53184::DEBUG::2014-05-16 17:06:25,708::task::1168::TaskManager.Task::(prepare) Task=`8d3fb392-1eab-44c9-8505-5faa7c564642`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53184::DEBUG::2014-05-16 17:06:25,708::task::579::TaskManager.Task::(_updateState) Task=`8d3fb392-1eab-44c9-8505-5faa7c564642`::moving from state preparing -> state finished >Thread-53184::DEBUG::2014-05-16 17:06:25,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53184::DEBUG::2014-05-16 17:06:25,709::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53184::DEBUG::2014-05-16 17:06:25,709::task::974::TaskManager.Task::(_decref) Task=`8d3fb392-1eab-44c9-8505-5faa7c564642`::ref 0 aborting False >Thread-53185::DEBUG::2014-05-16 17:06:25,718::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53185::DEBUG::2014-05-16 17:06:25,718::task::579::TaskManager.Task::(_updateState) Task=`47775010-7647-4636-8508-c6b20e05dd6d`::moving from state init -> state preparing >Thread-53185::INFO::2014-05-16 17:06:25,718::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53185::DEBUG::2014-05-16 17:06:25,719::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c4309f59-2249-447a-a91b-494c95307ede`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53185::DEBUG::2014-05-16 17:06:25,719::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53185::DEBUG::2014-05-16 17:06:25,719::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53185::DEBUG::2014-05-16 17:06:25,719::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c4309f59-2249-447a-a91b-494c95307ede`::Granted request >Thread-53185::DEBUG::2014-05-16 17:06:25,720::task::811::TaskManager.Task::(resourceAcquired) Task=`47775010-7647-4636-8508-c6b20e05dd6d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53185::DEBUG::2014-05-16 17:06:25,720::task::974::TaskManager.Task::(_decref) Task=`47775010-7647-4636-8508-c6b20e05dd6d`::ref 1 aborting False >Thread-53185::INFO::2014-05-16 17:06:25,721::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53185::DEBUG::2014-05-16 17:06:25,721::task::1168::TaskManager.Task::(prepare) Task=`47775010-7647-4636-8508-c6b20e05dd6d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53185::DEBUG::2014-05-16 17:06:25,721::task::579::TaskManager.Task::(_updateState) Task=`47775010-7647-4636-8508-c6b20e05dd6d`::moving from state preparing -> state finished >Thread-53185::DEBUG::2014-05-16 17:06:25,721::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53185::DEBUG::2014-05-16 17:06:25,721::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53185::DEBUG::2014-05-16 17:06:25,722::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53185::DEBUG::2014-05-16 17:06:25,722::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53185::DEBUG::2014-05-16 17:06:25,722::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53185::DEBUG::2014-05-16 17:06:25,722::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53185::DEBUG::2014-05-16 17:06:25,722::task::974::TaskManager.Task::(_decref) Task=`47775010-7647-4636-8508-c6b20e05dd6d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:06:27,346::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:27,413::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314991 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:29,425::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:29,496::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350647 s, 29.2 MB/s\n'; <rc> = 0 >Thread-53187::DEBUG::2014-05-16 17:06:29,811::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314606.000000 / 8.008558 / 262500000.000000 = 0.205238 >Thread-53187::DEBUG::2014-05-16 17:06:29,811::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052840616377276871, 'statsAge': 0.4500429630279541, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20523787445995562, 'rxDropped': 0} >Thread-53187::DEBUG::2014-05-16 17:06:29,812::task::579::TaskManager.Task::(_updateState) Task=`4504a749-9352-44a3-aac8-d02be8ab36df`::moving from state init -> state preparing >Thread-53187::INFO::2014-05-16 17:06:29,812::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53187::INFO::2014-05-16 17:06:29,812::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757048', 'lastCheck': '7.6', 'valid': True}} >Thread-53187::DEBUG::2014-05-16 17:06:29,812::task::1168::TaskManager.Task::(prepare) Task=`4504a749-9352-44a3-aac8-d02be8ab36df`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757048', 'lastCheck': '7.6', 'valid': True}} >Thread-53187::DEBUG::2014-05-16 17:06:29,812::task::579::TaskManager.Task::(_updateState) Task=`4504a749-9352-44a3-aac8-d02be8ab36df`::moving from state preparing -> state finished >Thread-53187::DEBUG::2014-05-16 17:06:29,813::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53187::DEBUG::2014-05-16 17:06:29,813::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53187::DEBUG::2014-05-16 17:06:29,813::task::974::TaskManager.Task::(_decref) Task=`4504a749-9352-44a3-aac8-d02be8ab36df`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:06:31,507::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:31,574::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031374 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:06:32,209::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:06:32,219::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734263 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:33,586::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:33,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311004 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:35,665::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:35,736::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357084 s, 28.7 MB/s\n'; <rc> = 0 >Thread-53190::DEBUG::2014-05-16 17:06:35,751::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53190::DEBUG::2014-05-16 17:06:35,752::task::579::TaskManager.Task::(_updateState) Task=`b944c77b-05c1-4446-b2ce-c2d54520c837`::moving from state init -> state preparing >Thread-53190::INFO::2014-05-16 17:06:35,752::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53190::INFO::2014-05-16 17:06:35,752::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53190::DEBUG::2014-05-16 17:06:35,752::task::1168::TaskManager.Task::(prepare) Task=`b944c77b-05c1-4446-b2ce-c2d54520c837`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53190::DEBUG::2014-05-16 17:06:35,753::task::579::TaskManager.Task::(_updateState) Task=`b944c77b-05c1-4446-b2ce-c2d54520c837`::moving from state preparing -> state finished >Thread-53190::DEBUG::2014-05-16 17:06:35,753::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53190::DEBUG::2014-05-16 17:06:35,753::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53190::DEBUG::2014-05-16 17:06:35,753::task::974::TaskManager.Task::(_decref) Task=`b944c77b-05c1-4446-b2ce-c2d54520c837`::ref 0 aborting False >Thread-53191::DEBUG::2014-05-16 17:06:35,768::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53191::DEBUG::2014-05-16 17:06:35,768::task::579::TaskManager.Task::(_updateState) Task=`97357178-bdcd-4200-ac22-b53cc09de3f8`::moving from state init -> state preparing >Thread-53191::INFO::2014-05-16 17:06:35,768::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53191::DEBUG::2014-05-16 17:06:35,768::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`da31a5a9-a0b4-4e28-966f-ede12eb49e1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53191::DEBUG::2014-05-16 17:06:35,769::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53191::DEBUG::2014-05-16 17:06:35,769::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53191::DEBUG::2014-05-16 17:06:35,769::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`da31a5a9-a0b4-4e28-966f-ede12eb49e1b`::Granted request >Thread-53191::DEBUG::2014-05-16 17:06:35,769::task::811::TaskManager.Task::(resourceAcquired) Task=`97357178-bdcd-4200-ac22-b53cc09de3f8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53191::DEBUG::2014-05-16 17:06:35,769::task::974::TaskManager.Task::(_decref) Task=`97357178-bdcd-4200-ac22-b53cc09de3f8`::ref 1 aborting False >Thread-53191::INFO::2014-05-16 17:06:35,770::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53191::DEBUG::2014-05-16 17:06:35,770::task::1168::TaskManager.Task::(prepare) Task=`97357178-bdcd-4200-ac22-b53cc09de3f8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53191::DEBUG::2014-05-16 17:06:35,770::task::579::TaskManager.Task::(_updateState) Task=`97357178-bdcd-4200-ac22-b53cc09de3f8`::moving from state preparing -> state finished >Thread-53191::DEBUG::2014-05-16 17:06:35,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53191::DEBUG::2014-05-16 17:06:35,771::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53191::DEBUG::2014-05-16 17:06:35,771::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53191::DEBUG::2014-05-16 17:06:35,771::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53191::DEBUG::2014-05-16 17:06:35,771::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53191::DEBUG::2014-05-16 17:06:35,771::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53191::DEBUG::2014-05-16 17:06:35,772::task::974::TaskManager.Task::(_decref) Task=`97357178-bdcd-4200-ac22-b53cc09de3f8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:06:37,748::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:37,821::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036148 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:39,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:39,900::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307955 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:41,912::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:41,980::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351825 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:06:42,254::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:06:42,264::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000797185 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:43,988::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:44,061::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350263 s, 29.2 MB/s\n'; <rc> = 0 >Thread-53195::DEBUG::2014-05-16 17:06:44,998::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315405.000000 / 8.008180 / 262500000.000000 = 0.205286 >Thread-53195::DEBUG::2014-05-16 17:06:44,999::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053601382115245066, 'statsAge': 1.6233499050140381, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20528556806744808, 'rxDropped': 0} >Thread-53195::DEBUG::2014-05-16 17:06:45,000::task::579::TaskManager.Task::(_updateState) Task=`bf7f8d88-4ea6-4a2d-8b4a-00267d2f2df1`::moving from state init -> state preparing >Thread-53195::INFO::2014-05-16 17:06:45,011::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53195::INFO::2014-05-16 17:06:45,015::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797185', 'lastCheck': '2.7', 'valid': True}} >Thread-53195::DEBUG::2014-05-16 17:06:45,015::task::1168::TaskManager.Task::(prepare) Task=`bf7f8d88-4ea6-4a2d-8b4a-00267d2f2df1`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797185', 'lastCheck': '2.7', 'valid': True}} >Thread-53195::DEBUG::2014-05-16 17:06:45,015::task::579::TaskManager.Task::(_updateState) Task=`bf7f8d88-4ea6-4a2d-8b4a-00267d2f2df1`::moving from state preparing -> state finished >Thread-53195::DEBUG::2014-05-16 17:06:45,015::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53195::DEBUG::2014-05-16 17:06:45,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53195::DEBUG::2014-05-16 17:06:45,015::task::974::TaskManager.Task::(_decref) Task=`bf7f8d88-4ea6-4a2d-8b4a-00267d2f2df1`::ref 0 aborting False >Thread-53197::DEBUG::2014-05-16 17:06:45,813::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53197::DEBUG::2014-05-16 17:06:45,813::task::579::TaskManager.Task::(_updateState) Task=`ed6691ec-fd19-4836-8942-6f0c51b1dc6c`::moving from state init -> state preparing >Thread-53197::INFO::2014-05-16 17:06:45,813::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53197::INFO::2014-05-16 17:06:45,814::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53197::DEBUG::2014-05-16 17:06:45,814::task::1168::TaskManager.Task::(prepare) Task=`ed6691ec-fd19-4836-8942-6f0c51b1dc6c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53197::DEBUG::2014-05-16 17:06:45,814::task::579::TaskManager.Task::(_updateState) Task=`ed6691ec-fd19-4836-8942-6f0c51b1dc6c`::moving from state preparing -> state finished >Thread-53197::DEBUG::2014-05-16 17:06:45,814::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53197::DEBUG::2014-05-16 17:06:45,814::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53197::DEBUG::2014-05-16 17:06:45,814::task::974::TaskManager.Task::(_decref) Task=`ed6691ec-fd19-4836-8942-6f0c51b1dc6c`::ref 0 aborting False >Thread-53198::DEBUG::2014-05-16 17:06:45,832::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53198::DEBUG::2014-05-16 17:06:45,833::task::579::TaskManager.Task::(_updateState) Task=`164ccef4-02c1-438c-985b-17b4827a5dd3`::moving from state init -> state preparing >Thread-53198::INFO::2014-05-16 17:06:45,833::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53198::DEBUG::2014-05-16 17:06:45,833::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`22fb730f-3eeb-4060-a981-711e6398b05f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53198::DEBUG::2014-05-16 17:06:45,833::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53198::DEBUG::2014-05-16 17:06:45,833::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53198::DEBUG::2014-05-16 17:06:45,834::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`22fb730f-3eeb-4060-a981-711e6398b05f`::Granted request >Thread-53198::DEBUG::2014-05-16 17:06:45,834::task::811::TaskManager.Task::(resourceAcquired) Task=`164ccef4-02c1-438c-985b-17b4827a5dd3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53198::DEBUG::2014-05-16 17:06:45,834::task::974::TaskManager.Task::(_decref) Task=`164ccef4-02c1-438c-985b-17b4827a5dd3`::ref 1 aborting False >Thread-53198::INFO::2014-05-16 17:06:45,834::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53198::DEBUG::2014-05-16 17:06:45,835::task::1168::TaskManager.Task::(prepare) Task=`164ccef4-02c1-438c-985b-17b4827a5dd3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53198::DEBUG::2014-05-16 17:06:45,835::task::579::TaskManager.Task::(_updateState) Task=`164ccef4-02c1-438c-985b-17b4827a5dd3`::moving from state preparing -> state finished >Thread-53198::DEBUG::2014-05-16 17:06:45,835::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53198::DEBUG::2014-05-16 17:06:45,835::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53198::DEBUG::2014-05-16 17:06:45,835::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53198::DEBUG::2014-05-16 17:06:45,835::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53198::DEBUG::2014-05-16 17:06:45,835::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53198::DEBUG::2014-05-16 17:06:45,836::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53198::DEBUG::2014-05-16 17:06:45,836::task::974::TaskManager.Task::(_decref) Task=`164ccef4-02c1-438c-985b-17b4827a5dd3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:06:46,073::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:46,140::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310529 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:48,152::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:48,220::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312864 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:50,231::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:50,302::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347155 s, 29.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:06:52,298::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:06:52,308::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000902597 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:52,316::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:52,443::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0906778 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:54,455::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:54,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311048 s, 32.9 MB/s\n'; <rc> = 0 >Thread-53202::DEBUG::2014-05-16 17:06:55,875::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53202::DEBUG::2014-05-16 17:06:55,875::task::579::TaskManager.Task::(_updateState) Task=`fc24358a-dd50-4347-bb35-725754aac674`::moving from state init -> state preparing >Thread-53202::INFO::2014-05-16 17:06:55,876::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53202::INFO::2014-05-16 17:06:55,876::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53202::DEBUG::2014-05-16 17:06:55,876::task::1168::TaskManager.Task::(prepare) Task=`fc24358a-dd50-4347-bb35-725754aac674`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53202::DEBUG::2014-05-16 17:06:55,876::task::579::TaskManager.Task::(_updateState) Task=`fc24358a-dd50-4347-bb35-725754aac674`::moving from state preparing -> state finished >Thread-53202::DEBUG::2014-05-16 17:06:55,876::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53202::DEBUG::2014-05-16 17:06:55,877::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53202::DEBUG::2014-05-16 17:06:55,877::task::974::TaskManager.Task::(_decref) Task=`fc24358a-dd50-4347-bb35-725754aac674`::ref 0 aborting False >Thread-53203::DEBUG::2014-05-16 17:06:55,885::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53203::DEBUG::2014-05-16 17:06:55,886::task::579::TaskManager.Task::(_updateState) Task=`7613e773-fa2c-453b-bd5c-d1aee6901921`::moving from state init -> state preparing >Thread-53203::INFO::2014-05-16 17:06:55,886::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53203::DEBUG::2014-05-16 17:06:55,886::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`54aa01c2-6f1e-4cc7-9390-505bd6d1050b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53203::DEBUG::2014-05-16 17:06:55,886::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53203::DEBUG::2014-05-16 17:06:55,887::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53203::DEBUG::2014-05-16 17:06:55,887::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`54aa01c2-6f1e-4cc7-9390-505bd6d1050b`::Granted request >Thread-53203::DEBUG::2014-05-16 17:06:55,887::task::811::TaskManager.Task::(resourceAcquired) Task=`7613e773-fa2c-453b-bd5c-d1aee6901921`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53203::DEBUG::2014-05-16 17:06:55,887::task::974::TaskManager.Task::(_decref) Task=`7613e773-fa2c-453b-bd5c-d1aee6901921`::ref 1 aborting False >Thread-53203::INFO::2014-05-16 17:06:55,888::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53203::DEBUG::2014-05-16 17:06:55,888::task::1168::TaskManager.Task::(prepare) Task=`7613e773-fa2c-453b-bd5c-d1aee6901921`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53203::DEBUG::2014-05-16 17:06:55,888::task::579::TaskManager.Task::(_updateState) Task=`7613e773-fa2c-453b-bd5c-d1aee6901921`::moving from state preparing -> state finished >Thread-53203::DEBUG::2014-05-16 17:06:55,889::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53203::DEBUG::2014-05-16 17:06:55,889::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53203::DEBUG::2014-05-16 17:06:55,889::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53203::DEBUG::2014-05-16 17:06:55,889::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53203::DEBUG::2014-05-16 17:06:55,889::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53203::DEBUG::2014-05-16 17:06:55,889::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53203::DEBUG::2014-05-16 17:06:55,890::task::974::TaskManager.Task::(_decref) Task=`7613e773-fa2c-453b-bd5c-d1aee6901921`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:06:56,534::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:56,605::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351693 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:06:58,617::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:06:58,692::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375608 s, 27.3 MB/s\n'; <rc> = 0 >Thread-53205::DEBUG::2014-05-16 17:07:00,193::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317958.000000 / 8.008232 / 262500000.000000 = 0.205406 >Thread-53205::DEBUG::2014-05-16 17:07:00,194::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053710447052897018, 'statsAge': 0.80172610282897949, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20540568829102726, 'rxDropped': 0} >Thread-53205::DEBUG::2014-05-16 17:07:00,194::task::579::TaskManager.Task::(_updateState) Task=`29e01940-aa34-4760-981f-124d909a6167`::moving from state init -> state preparing >Thread-53205::INFO::2014-05-16 17:07:00,194::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53205::INFO::2014-05-16 17:07:00,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000902597', 'lastCheck': '7.8', 'valid': True}} >Thread-53205::DEBUG::2014-05-16 17:07:00,195::task::1168::TaskManager.Task::(prepare) Task=`29e01940-aa34-4760-981f-124d909a6167`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000902597', 'lastCheck': '7.8', 'valid': True}} >Thread-53205::DEBUG::2014-05-16 17:07:00,195::task::579::TaskManager.Task::(_updateState) Task=`29e01940-aa34-4760-981f-124d909a6167`::moving from state preparing -> state finished >Thread-53205::DEBUG::2014-05-16 17:07:00,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53205::DEBUG::2014-05-16 17:07:00,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53205::DEBUG::2014-05-16 17:07:00,195::task::974::TaskManager.Task::(_decref) Task=`29e01940-aa34-4760-981f-124d909a6167`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:07:00,704::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:00,771::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030307 s, 33.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:07:02,413::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:07:02,424::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000981503 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:02,783::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:02,865::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0424629 s, 24.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:04,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:04,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310504 s, 33.0 MB/s\n'; <rc> = 0 >Thread-53208::DEBUG::2014-05-16 17:07:05,929::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53208::DEBUG::2014-05-16 17:07:05,929::task::579::TaskManager.Task::(_updateState) Task=`92579442-98c1-49c0-89e4-523996614e41`::moving from state init -> state preparing >Thread-53208::INFO::2014-05-16 17:07:05,929::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53208::INFO::2014-05-16 17:07:05,930::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53208::DEBUG::2014-05-16 17:07:05,930::task::1168::TaskManager.Task::(prepare) Task=`92579442-98c1-49c0-89e4-523996614e41`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53208::DEBUG::2014-05-16 17:07:05,930::task::579::TaskManager.Task::(_updateState) Task=`92579442-98c1-49c0-89e4-523996614e41`::moving from state preparing -> state finished >Thread-53208::DEBUG::2014-05-16 17:07:05,930::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53208::DEBUG::2014-05-16 17:07:05,930::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53208::DEBUG::2014-05-16 17:07:05,931::task::974::TaskManager.Task::(_decref) Task=`92579442-98c1-49c0-89e4-523996614e41`::ref 0 aborting False >Thread-53209::DEBUG::2014-05-16 17:07:05,939::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53209::DEBUG::2014-05-16 17:07:05,940::task::579::TaskManager.Task::(_updateState) Task=`29d6de96-a44c-4cc8-8fcb-53b7add2d425`::moving from state init -> state preparing >Thread-53209::INFO::2014-05-16 17:07:05,940::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53209::DEBUG::2014-05-16 17:07:05,940::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f1634967-9ca3-4e57-9ee9-86a082f57cd4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53209::DEBUG::2014-05-16 17:07:05,940::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53209::DEBUG::2014-05-16 17:07:05,941::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53209::DEBUG::2014-05-16 17:07:05,941::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f1634967-9ca3-4e57-9ee9-86a082f57cd4`::Granted request >Thread-53209::DEBUG::2014-05-16 17:07:05,941::task::811::TaskManager.Task::(resourceAcquired) Task=`29d6de96-a44c-4cc8-8fcb-53b7add2d425`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53209::DEBUG::2014-05-16 17:07:05,941::task::974::TaskManager.Task::(_decref) Task=`29d6de96-a44c-4cc8-8fcb-53b7add2d425`::ref 1 aborting False >Thread-53209::INFO::2014-05-16 17:07:05,942::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53209::DEBUG::2014-05-16 17:07:05,942::task::1168::TaskManager.Task::(prepare) Task=`29d6de96-a44c-4cc8-8fcb-53b7add2d425`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53209::DEBUG::2014-05-16 17:07:05,942::task::579::TaskManager.Task::(_updateState) Task=`29d6de96-a44c-4cc8-8fcb-53b7add2d425`::moving from state preparing -> state finished >Thread-53209::DEBUG::2014-05-16 17:07:05,942::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53209::DEBUG::2014-05-16 17:07:05,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53209::DEBUG::2014-05-16 17:07:05,943::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53209::DEBUG::2014-05-16 17:07:05,943::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53209::DEBUG::2014-05-16 17:07:05,943::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53209::DEBUG::2014-05-16 17:07:05,943::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53209::DEBUG::2014-05-16 17:07:05,943::task::974::TaskManager.Task::(_decref) Task=`29d6de96-a44c-4cc8-8fcb-53b7add2d425`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:07:06,955::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:07,022::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310068 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:09,034::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:09,101::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307153 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:11,112::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:11,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344357 s, 29.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:07:12,456::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:07:12,467::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104549 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:13,194::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:13,266::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357639 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:15,277::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:15,344::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305201 s, 33.6 MB/s\n'; <rc> = 0 >Thread-53213::DEBUG::2014-05-16 17:07:15,400::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5417113.000000 / 8.008539 / 262500000.000000 = 0.257683 >Thread-53213::DEBUG::2014-05-16 17:07:15,401::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0067976015856541418, 'statsAge': 1.9933781623840332, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25768271905549023, 'rxDropped': 0} >Thread-53213::DEBUG::2014-05-16 17:07:15,401::task::579::TaskManager.Task::(_updateState) Task=`556c3bf1-e8cb-411d-bb5a-c5bf7d2ed328`::moving from state init -> state preparing >Thread-53213::INFO::2014-05-16 17:07:15,401::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53213::INFO::2014-05-16 17:07:15,402::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104549', 'lastCheck': '2.9', 'valid': True}} >Thread-53213::DEBUG::2014-05-16 17:07:15,402::task::1168::TaskManager.Task::(prepare) Task=`556c3bf1-e8cb-411d-bb5a-c5bf7d2ed328`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104549', 'lastCheck': '2.9', 'valid': True}} >Thread-53213::DEBUG::2014-05-16 17:07:15,402::task::579::TaskManager.Task::(_updateState) Task=`556c3bf1-e8cb-411d-bb5a-c5bf7d2ed328`::moving from state preparing -> state finished >Thread-53213::DEBUG::2014-05-16 17:07:15,402::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53213::DEBUG::2014-05-16 17:07:15,402::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53213::DEBUG::2014-05-16 17:07:15,403::task::974::TaskManager.Task::(_decref) Task=`556c3bf1-e8cb-411d-bb5a-c5bf7d2ed328`::ref 0 aborting False >Thread-53215::DEBUG::2014-05-16 17:07:15,987::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53215::DEBUG::2014-05-16 17:07:15,988::task::579::TaskManager.Task::(_updateState) Task=`618a3491-5b6e-4f30-aaf8-16c6c59b0d10`::moving from state init -> state preparing >Thread-53215::INFO::2014-05-16 17:07:15,988::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53215::INFO::2014-05-16 17:07:15,988::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53215::DEBUG::2014-05-16 17:07:15,988::task::1168::TaskManager.Task::(prepare) Task=`618a3491-5b6e-4f30-aaf8-16c6c59b0d10`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53215::DEBUG::2014-05-16 17:07:15,988::task::579::TaskManager.Task::(_updateState) Task=`618a3491-5b6e-4f30-aaf8-16c6c59b0d10`::moving from state preparing -> state finished >Thread-53215::DEBUG::2014-05-16 17:07:15,988::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53215::DEBUG::2014-05-16 17:07:15,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53215::DEBUG::2014-05-16 17:07:15,989::task::974::TaskManager.Task::(_decref) Task=`618a3491-5b6e-4f30-aaf8-16c6c59b0d10`::ref 0 aborting False >Thread-53216::DEBUG::2014-05-16 17:07:15,998::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53216::DEBUG::2014-05-16 17:07:15,998::task::579::TaskManager.Task::(_updateState) Task=`9dd0228f-9ea7-426c-8d5b-db0a83431c27`::moving from state init -> state preparing >Thread-53216::INFO::2014-05-16 17:07:15,998::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53216::DEBUG::2014-05-16 17:07:15,999::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9d336b35-2f2e-402e-8851-2c04205705d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53216::DEBUG::2014-05-16 17:07:15,999::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53216::DEBUG::2014-05-16 17:07:15,999::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53216::DEBUG::2014-05-16 17:07:15,999::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9d336b35-2f2e-402e-8851-2c04205705d1`::Granted request >Thread-53216::DEBUG::2014-05-16 17:07:15,999::task::811::TaskManager.Task::(resourceAcquired) Task=`9dd0228f-9ea7-426c-8d5b-db0a83431c27`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53216::DEBUG::2014-05-16 17:07:16,000::task::974::TaskManager.Task::(_decref) Task=`9dd0228f-9ea7-426c-8d5b-db0a83431c27`::ref 1 aborting False >Thread-53216::INFO::2014-05-16 17:07:16,000::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53216::DEBUG::2014-05-16 17:07:16,000::task::1168::TaskManager.Task::(prepare) Task=`9dd0228f-9ea7-426c-8d5b-db0a83431c27`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53216::DEBUG::2014-05-16 17:07:16,001::task::579::TaskManager.Task::(_updateState) Task=`9dd0228f-9ea7-426c-8d5b-db0a83431c27`::moving from state preparing -> state finished >Thread-53216::DEBUG::2014-05-16 17:07:16,001::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53216::DEBUG::2014-05-16 17:07:16,001::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53216::DEBUG::2014-05-16 17:07:16,001::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53216::DEBUG::2014-05-16 17:07:16,001::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53216::DEBUG::2014-05-16 17:07:16,001::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53216::DEBUG::2014-05-16 17:07:16,002::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53216::DEBUG::2014-05-16 17:07:16,002::task::974::TaskManager.Task::(_decref) Task=`9dd0228f-9ea7-426c-8d5b-db0a83431c27`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:07:17,356::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:17,434::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362414 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:19,445::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:19,511::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030712 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:21,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:21,590::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312405 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:07:22,504::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:07:22,514::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623807 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:23,601::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:23,673::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354005 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:25,685::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:25,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310356 s, 33.0 MB/s\n'; <rc> = 0 >Thread-53220::DEBUG::2014-05-16 17:07:26,037::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53220::DEBUG::2014-05-16 17:07:26,038::task::579::TaskManager.Task::(_updateState) Task=`4db45ee5-06be-4c6c-bcce-af81f457c66a`::moving from state init -> state preparing >Thread-53220::INFO::2014-05-16 17:07:26,038::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53220::INFO::2014-05-16 17:07:26,038::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53220::DEBUG::2014-05-16 17:07:26,038::task::1168::TaskManager.Task::(prepare) Task=`4db45ee5-06be-4c6c-bcce-af81f457c66a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53220::DEBUG::2014-05-16 17:07:26,039::task::579::TaskManager.Task::(_updateState) Task=`4db45ee5-06be-4c6c-bcce-af81f457c66a`::moving from state preparing -> state finished >Thread-53220::DEBUG::2014-05-16 17:07:26,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53220::DEBUG::2014-05-16 17:07:26,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53220::DEBUG::2014-05-16 17:07:26,039::task::974::TaskManager.Task::(_decref) Task=`4db45ee5-06be-4c6c-bcce-af81f457c66a`::ref 0 aborting False >Thread-53221::DEBUG::2014-05-16 17:07:26,061::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53221::DEBUG::2014-05-16 17:07:26,061::task::579::TaskManager.Task::(_updateState) Task=`b49e86df-a3f6-4eab-91a8-0dde677bf8f7`::moving from state init -> state preparing >Thread-53221::INFO::2014-05-16 17:07:26,062::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53221::DEBUG::2014-05-16 17:07:26,062::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6b97adef-0566-46e4-88cd-2e5db723c7a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53221::DEBUG::2014-05-16 17:07:26,062::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53221::DEBUG::2014-05-16 17:07:26,062::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53221::DEBUG::2014-05-16 17:07:26,063::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6b97adef-0566-46e4-88cd-2e5db723c7a2`::Granted request >Thread-53221::DEBUG::2014-05-16 17:07:26,063::task::811::TaskManager.Task::(resourceAcquired) Task=`b49e86df-a3f6-4eab-91a8-0dde677bf8f7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53221::DEBUG::2014-05-16 17:07:26,063::task::974::TaskManager.Task::(_decref) Task=`b49e86df-a3f6-4eab-91a8-0dde677bf8f7`::ref 1 aborting False >Thread-53221::INFO::2014-05-16 17:07:26,064::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53221::DEBUG::2014-05-16 17:07:26,064::task::1168::TaskManager.Task::(prepare) Task=`b49e86df-a3f6-4eab-91a8-0dde677bf8f7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53221::DEBUG::2014-05-16 17:07:26,064::task::579::TaskManager.Task::(_updateState) Task=`b49e86df-a3f6-4eab-91a8-0dde677bf8f7`::moving from state preparing -> state finished >Thread-53221::DEBUG::2014-05-16 17:07:26,064::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53221::DEBUG::2014-05-16 17:07:26,064::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53221::DEBUG::2014-05-16 17:07:26,065::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53221::DEBUG::2014-05-16 17:07:26,065::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53221::DEBUG::2014-05-16 17:07:26,065::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53221::DEBUG::2014-05-16 17:07:26,065::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53221::DEBUG::2014-05-16 17:07:26,065::task::974::TaskManager.Task::(_decref) Task=`b49e86df-a3f6-4eab-91a8-0dde677bf8f7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:07:27,764::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:27,831::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316601 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:29,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:29,915::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365879 s, 28.0 MB/s\n'; <rc> = 0 >Thread-53223::DEBUG::2014-05-16 17:07:30,619::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319470.000000 / 8.008093 / 262500000.000000 = 0.205481 >Thread-53223::DEBUG::2014-05-16 17:07:30,619::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005374182470722552, 'statsAge': 1.1923110485076904, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20548118079534705, 'rxDropped': 0} >Thread-53223::DEBUG::2014-05-16 17:07:30,619::task::579::TaskManager.Task::(_updateState) Task=`2d154c23-7ba0-4759-8315-eb67894fa8c9`::moving from state init -> state preparing >Thread-53223::INFO::2014-05-16 17:07:30,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53223::INFO::2014-05-16 17:07:30,620::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623807', 'lastCheck': '8.1', 'valid': True}} >Thread-53223::DEBUG::2014-05-16 17:07:30,620::task::1168::TaskManager.Task::(prepare) Task=`2d154c23-7ba0-4759-8315-eb67894fa8c9`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623807', 'lastCheck': '8.1', 'valid': True}} >Thread-53223::DEBUG::2014-05-16 17:07:30,620::task::579::TaskManager.Task::(_updateState) Task=`2d154c23-7ba0-4759-8315-eb67894fa8c9`::moving from state preparing -> state finished >Thread-53223::DEBUG::2014-05-16 17:07:30,620::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53223::DEBUG::2014-05-16 17:07:30,620::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53223::DEBUG::2014-05-16 17:07:30,621::task::974::TaskManager.Task::(_decref) Task=`2d154c23-7ba0-4759-8315-eb67894fa8c9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:07:31,927::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:31,993::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297206 s, 34.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:07:32,551::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:07:32,561::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000762894 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:34,005::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:34,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308666 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:36,090::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-53226::DEBUG::2014-05-16 17:07:36,099::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53226::DEBUG::2014-05-16 17:07:36,099::task::579::TaskManager.Task::(_updateState) Task=`7a8b954a-6399-4a01-b50b-3664ae24fcfd`::moving from state init -> state preparing >Thread-53226::INFO::2014-05-16 17:07:36,100::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53226::INFO::2014-05-16 17:07:36,100::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53226::DEBUG::2014-05-16 17:07:36,100::task::1168::TaskManager.Task::(prepare) Task=`7a8b954a-6399-4a01-b50b-3664ae24fcfd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53226::DEBUG::2014-05-16 17:07:36,100::task::579::TaskManager.Task::(_updateState) Task=`7a8b954a-6399-4a01-b50b-3664ae24fcfd`::moving from state preparing -> state finished >Thread-53226::DEBUG::2014-05-16 17:07:36,100::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53226::DEBUG::2014-05-16 17:07:36,101::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53226::DEBUG::2014-05-16 17:07:36,101::task::974::TaskManager.Task::(_decref) Task=`7a8b954a-6399-4a01-b50b-3664ae24fcfd`::ref 0 aborting False >Thread-53227::DEBUG::2014-05-16 17:07:36,120::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53227::DEBUG::2014-05-16 17:07:36,120::task::579::TaskManager.Task::(_updateState) Task=`57bbd574-74f7-4796-bc96-1f339778db4d`::moving from state init -> state preparing >Thread-53227::INFO::2014-05-16 17:07:36,120::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53227::DEBUG::2014-05-16 17:07:36,121::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c3649a23-f757-45e8-8dbc-b17b0bf69ccc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53227::DEBUG::2014-05-16 17:07:36,121::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53227::DEBUG::2014-05-16 17:07:36,121::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53227::DEBUG::2014-05-16 17:07:36,122::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c3649a23-f757-45e8-8dbc-b17b0bf69ccc`::Granted request >Thread-53227::DEBUG::2014-05-16 17:07:36,122::task::811::TaskManager.Task::(resourceAcquired) Task=`57bbd574-74f7-4796-bc96-1f339778db4d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53227::DEBUG::2014-05-16 17:07:36,122::task::974::TaskManager.Task::(_decref) Task=`57bbd574-74f7-4796-bc96-1f339778db4d`::ref 1 aborting False >Thread-53227::INFO::2014-05-16 17:07:36,123::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53227::DEBUG::2014-05-16 17:07:36,123::task::1168::TaskManager.Task::(prepare) Task=`57bbd574-74f7-4796-bc96-1f339778db4d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53227::DEBUG::2014-05-16 17:07:36,124::task::579::TaskManager.Task::(_updateState) Task=`57bbd574-74f7-4796-bc96-1f339778db4d`::moving from state preparing -> state finished >Thread-53227::DEBUG::2014-05-16 17:07:36,124::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53227::DEBUG::2014-05-16 17:07:36,124::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53227::DEBUG::2014-05-16 17:07:36,124::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53227::DEBUG::2014-05-16 17:07:36,125::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53227::DEBUG::2014-05-16 17:07:36,125::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53227::DEBUG::2014-05-16 17:07:36,125::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53227::DEBUG::2014-05-16 17:07:36,125::task::974::TaskManager.Task::(_decref) Task=`57bbd574-74f7-4796-bc96-1f339778db4d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:07:36,165::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037538 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:38,177::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:38,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353153 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:40,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:40,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030447 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:42,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:42,405::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312023 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:07:42,599::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:07:42,609::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000790841 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:44,417::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:44,488::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035083 s, 29.2 MB/s\n'; <rc> = 0 >Thread-53231::DEBUG::2014-05-16 17:07:46,144::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314964.000000 / 8.008316 / 262500000.000000 = 0.205261 >Thread-53231::DEBUG::2014-05-16 17:07:46,145::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051271464960327964, 'statsAge': 0.7013700008392334, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20526110624322857, 'rxDropped': 0} >Thread-53231::DEBUG::2014-05-16 17:07:46,146::task::579::TaskManager.Task::(_updateState) Task=`e0ce3561-3ded-4802-a3ae-2ad42161e353`::moving from state init -> state preparing >Thread-53231::INFO::2014-05-16 17:07:46,146::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53231::INFO::2014-05-16 17:07:46,146::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790841', 'lastCheck': '3.5', 'valid': True}} >Thread-53231::DEBUG::2014-05-16 17:07:46,146::task::1168::TaskManager.Task::(prepare) Task=`e0ce3561-3ded-4802-a3ae-2ad42161e353`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790841', 'lastCheck': '3.5', 'valid': True}} >Thread-53231::DEBUG::2014-05-16 17:07:46,146::task::579::TaskManager.Task::(_updateState) Task=`e0ce3561-3ded-4802-a3ae-2ad42161e353`::moving from state preparing -> state finished >Thread-53231::DEBUG::2014-05-16 17:07:46,146::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53231::DEBUG::2014-05-16 17:07:46,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53231::DEBUG::2014-05-16 17:07:46,147::task::974::TaskManager.Task::(_decref) Task=`e0ce3561-3ded-4802-a3ae-2ad42161e353`::ref 0 aborting False >Thread-53232::DEBUG::2014-05-16 17:07:46,170::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53232::DEBUG::2014-05-16 17:07:46,170::task::579::TaskManager.Task::(_updateState) Task=`741ca2ab-526f-4df6-ae2a-9277a8115767`::moving from state init -> state preparing >Thread-53232::INFO::2014-05-16 17:07:46,170::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53232::INFO::2014-05-16 17:07:46,171::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53232::DEBUG::2014-05-16 17:07:46,171::task::1168::TaskManager.Task::(prepare) Task=`741ca2ab-526f-4df6-ae2a-9277a8115767`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53232::DEBUG::2014-05-16 17:07:46,171::task::579::TaskManager.Task::(_updateState) Task=`741ca2ab-526f-4df6-ae2a-9277a8115767`::moving from state preparing -> state finished >Thread-53232::DEBUG::2014-05-16 17:07:46,171::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53232::DEBUG::2014-05-16 17:07:46,171::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53232::DEBUG::2014-05-16 17:07:46,171::task::974::TaskManager.Task::(_decref) Task=`741ca2ab-526f-4df6-ae2a-9277a8115767`::ref 0 aborting False >Thread-53233::DEBUG::2014-05-16 17:07:46,180::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53233::DEBUG::2014-05-16 17:07:46,180::task::579::TaskManager.Task::(_updateState) Task=`4cbd6f75-fd18-4a40-a946-28c1eebcc46d`::moving from state init -> state preparing >Thread-53233::INFO::2014-05-16 17:07:46,180::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53233::DEBUG::2014-05-16 17:07:46,181::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`61f0d595-8d30-4ed3-9115-899bf457ab2e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53233::DEBUG::2014-05-16 17:07:46,181::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53233::DEBUG::2014-05-16 17:07:46,181::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53233::DEBUG::2014-05-16 17:07:46,181::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`61f0d595-8d30-4ed3-9115-899bf457ab2e`::Granted request >Thread-53233::DEBUG::2014-05-16 17:07:46,181::task::811::TaskManager.Task::(resourceAcquired) Task=`4cbd6f75-fd18-4a40-a946-28c1eebcc46d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53233::DEBUG::2014-05-16 17:07:46,182::task::974::TaskManager.Task::(_decref) Task=`4cbd6f75-fd18-4a40-a946-28c1eebcc46d`::ref 1 aborting False >Thread-53233::INFO::2014-05-16 17:07:46,182::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53233::DEBUG::2014-05-16 17:07:46,182::task::1168::TaskManager.Task::(prepare) Task=`4cbd6f75-fd18-4a40-a946-28c1eebcc46d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53233::DEBUG::2014-05-16 17:07:46,182::task::579::TaskManager.Task::(_updateState) Task=`4cbd6f75-fd18-4a40-a946-28c1eebcc46d`::moving from state preparing -> state finished >Thread-53233::DEBUG::2014-05-16 17:07:46,183::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53233::DEBUG::2014-05-16 17:07:46,183::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53233::DEBUG::2014-05-16 17:07:46,183::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53233::DEBUG::2014-05-16 17:07:46,183::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53233::DEBUG::2014-05-16 17:07:46,183::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53233::DEBUG::2014-05-16 17:07:46,183::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53233::DEBUG::2014-05-16 17:07:46,183::task::974::TaskManager.Task::(_decref) Task=`4cbd6f75-fd18-4a40-a946-28c1eebcc46d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:07:46,500::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:46,567::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312501 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:48,578::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:48,650::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359536 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:50,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:50,734::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355628 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:07:52,644::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:07:52,654::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607355 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:52,745::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:52,815::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339072 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:54,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:54,893::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307598 s, 33.3 MB/s\n'; <rc> = 0 >Thread-53238::DEBUG::2014-05-16 17:07:56,222::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53238::DEBUG::2014-05-16 17:07:56,222::task::579::TaskManager.Task::(_updateState) Task=`3ec3b5ae-88e8-48df-917e-077a83bd3da8`::moving from state init -> state preparing >Thread-53238::INFO::2014-05-16 17:07:56,222::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53238::INFO::2014-05-16 17:07:56,223::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53238::DEBUG::2014-05-16 17:07:56,223::task::1168::TaskManager.Task::(prepare) Task=`3ec3b5ae-88e8-48df-917e-077a83bd3da8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53238::DEBUG::2014-05-16 17:07:56,223::task::579::TaskManager.Task::(_updateState) Task=`3ec3b5ae-88e8-48df-917e-077a83bd3da8`::moving from state preparing -> state finished >Thread-53238::DEBUG::2014-05-16 17:07:56,223::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53238::DEBUG::2014-05-16 17:07:56,223::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53238::DEBUG::2014-05-16 17:07:56,224::task::974::TaskManager.Task::(_decref) Task=`3ec3b5ae-88e8-48df-917e-077a83bd3da8`::ref 0 aborting False >Thread-53239::DEBUG::2014-05-16 17:07:56,232::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53239::DEBUG::2014-05-16 17:07:56,232::task::579::TaskManager.Task::(_updateState) Task=`459d2a64-acde-4b57-b98e-0bdc11149e32`::moving from state init -> state preparing >Thread-53239::INFO::2014-05-16 17:07:56,233::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53239::DEBUG::2014-05-16 17:07:56,233::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0db50b20-73c5-4ded-8b76-482544c0660c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53239::DEBUG::2014-05-16 17:07:56,233::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53239::DEBUG::2014-05-16 17:07:56,233::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53239::DEBUG::2014-05-16 17:07:56,234::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0db50b20-73c5-4ded-8b76-482544c0660c`::Granted request >Thread-53239::DEBUG::2014-05-16 17:07:56,234::task::811::TaskManager.Task::(resourceAcquired) Task=`459d2a64-acde-4b57-b98e-0bdc11149e32`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53239::DEBUG::2014-05-16 17:07:56,234::task::974::TaskManager.Task::(_decref) Task=`459d2a64-acde-4b57-b98e-0bdc11149e32`::ref 1 aborting False >Thread-53239::INFO::2014-05-16 17:07:56,235::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53239::DEBUG::2014-05-16 17:07:56,235::task::1168::TaskManager.Task::(prepare) Task=`459d2a64-acde-4b57-b98e-0bdc11149e32`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53239::DEBUG::2014-05-16 17:07:56,235::task::579::TaskManager.Task::(_updateState) Task=`459d2a64-acde-4b57-b98e-0bdc11149e32`::moving from state preparing -> state finished >Thread-53239::DEBUG::2014-05-16 17:07:56,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53239::DEBUG::2014-05-16 17:07:56,235::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53239::DEBUG::2014-05-16 17:07:56,235::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53239::DEBUG::2014-05-16 17:07:56,236::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53239::DEBUG::2014-05-16 17:07:56,236::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53239::DEBUG::2014-05-16 17:07:56,236::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53239::DEBUG::2014-05-16 17:07:56,236::task::974::TaskManager.Task::(_decref) Task=`459d2a64-acde-4b57-b98e-0bdc11149e32`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:07:56,905::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:56,978::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035524 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:07:58,987::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:07:59,061::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035525 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:01,073::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:01,140::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308296 s, 33.2 MB/s\n'; <rc> = 0 >Thread-53241::DEBUG::2014-05-16 17:08:01,345::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4338765.000000 / 8.008233 / 262500000.000000 = 0.206395 >Thread-53241::DEBUG::2014-05-16 17:08:01,346::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054343122894210671, 'statsAge': 1.8877661228179932, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20639545475594806, 'rxDropped': 0} >Thread-53241::DEBUG::2014-05-16 17:08:01,346::task::579::TaskManager.Task::(_updateState) Task=`895c1619-30aa-41a8-acd3-2fa605053f38`::moving from state init -> state preparing >Thread-53241::INFO::2014-05-16 17:08:01,346::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53241::INFO::2014-05-16 17:08:01,347::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607355', 'lastCheck': '8.7', 'valid': True}} >Thread-53241::DEBUG::2014-05-16 17:08:01,347::task::1168::TaskManager.Task::(prepare) Task=`895c1619-30aa-41a8-acd3-2fa605053f38`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607355', 'lastCheck': '8.7', 'valid': True}} >Thread-53241::DEBUG::2014-05-16 17:08:01,347::task::579::TaskManager.Task::(_updateState) Task=`895c1619-30aa-41a8-acd3-2fa605053f38`::moving from state preparing -> state finished >Thread-53241::DEBUG::2014-05-16 17:08:01,347::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53241::DEBUG::2014-05-16 17:08:01,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53241::DEBUG::2014-05-16 17:08:01,347::task::974::TaskManager.Task::(_decref) Task=`895c1619-30aa-41a8-acd3-2fa605053f38`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:08:02,692::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:08:02,702::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568454 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:03,151::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:03,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354077 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:05,234::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:05,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350115 s, 29.2 MB/s\n'; <rc> = 0 >Thread-53244::DEBUG::2014-05-16 17:08:06,277::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [db6c4f8] >Thread-53244::DEBUG::2014-05-16 17:08:06,277::task::579::TaskManager.Task::(_updateState) Task=`89826cbf-5674-4d6f-bf25-49e2abffaed6`::moving from state init -> state preparing >Thread-53244::INFO::2014-05-16 17:08:06,278::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53244::INFO::2014-05-16 17:08:06,278::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53244::DEBUG::2014-05-16 17:08:06,278::task::1168::TaskManager.Task::(prepare) Task=`89826cbf-5674-4d6f-bf25-49e2abffaed6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53244::DEBUG::2014-05-16 17:08:06,278::task::579::TaskManager.Task::(_updateState) Task=`89826cbf-5674-4d6f-bf25-49e2abffaed6`::moving from state preparing -> state finished >Thread-53244::DEBUG::2014-05-16 17:08:06,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53244::DEBUG::2014-05-16 17:08:06,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53244::DEBUG::2014-05-16 17:08:06,279::task::974::TaskManager.Task::(_decref) Task=`89826cbf-5674-4d6f-bf25-49e2abffaed6`::ref 0 aborting False >Thread-53245::DEBUG::2014-05-16 17:08:06,288::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [db6c4f8] >Thread-53245::DEBUG::2014-05-16 17:08:06,288::task::579::TaskManager.Task::(_updateState) Task=`1ad6b9d3-4b76-4593-9d95-208c89b9ac93`::moving from state init -> state preparing >Thread-53245::INFO::2014-05-16 17:08:06,288::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53245::DEBUG::2014-05-16 17:08:06,289::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7ba0af06-1a81-440c-b868-dd0d14a1db04`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53245::DEBUG::2014-05-16 17:08:06,289::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53245::DEBUG::2014-05-16 17:08:06,289::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53245::DEBUG::2014-05-16 17:08:06,289::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7ba0af06-1a81-440c-b868-dd0d14a1db04`::Granted request >Thread-53245::DEBUG::2014-05-16 17:08:06,289::task::811::TaskManager.Task::(resourceAcquired) Task=`1ad6b9d3-4b76-4593-9d95-208c89b9ac93`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53245::DEBUG::2014-05-16 17:08:06,290::task::974::TaskManager.Task::(_decref) Task=`1ad6b9d3-4b76-4593-9d95-208c89b9ac93`::ref 1 aborting False >Thread-53245::INFO::2014-05-16 17:08:06,290::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53245::DEBUG::2014-05-16 17:08:06,290::task::1168::TaskManager.Task::(prepare) Task=`1ad6b9d3-4b76-4593-9d95-208c89b9ac93`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53245::DEBUG::2014-05-16 17:08:06,290::task::579::TaskManager.Task::(_updateState) Task=`1ad6b9d3-4b76-4593-9d95-208c89b9ac93`::moving from state preparing -> state finished >Thread-53245::DEBUG::2014-05-16 17:08:06,291::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53245::DEBUG::2014-05-16 17:08:06,291::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53245::DEBUG::2014-05-16 17:08:06,291::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53245::DEBUG::2014-05-16 17:08:06,291::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53245::DEBUG::2014-05-16 17:08:06,291::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53245::DEBUG::2014-05-16 17:08:06,291::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53245::DEBUG::2014-05-16 17:08:06,291::task::974::TaskManager.Task::(_decref) Task=`1ad6b9d3-4b76-4593-9d95-208c89b9ac93`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:08:07,317::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:07,383::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310923 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:09,395::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:09,463::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309825 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:11,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:11,550::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354128 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:08:12,736::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:08:12,746::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000587776 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:13,562::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:13,634::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347276 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:15,646::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:15,713::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310451 s, 33.0 MB/s\n'; <rc> = 0 >Thread-53249::DEBUG::2014-05-16 17:08:16,355::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53249::DEBUG::2014-05-16 17:08:16,355::task::579::TaskManager.Task::(_updateState) Task=`ca07af14-94e7-4711-8fbf-6f63f0905224`::moving from state init -> state preparing >Thread-53249::INFO::2014-05-16 17:08:16,356::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53249::INFO::2014-05-16 17:08:16,356::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53249::DEBUG::2014-05-16 17:08:16,356::task::1168::TaskManager.Task::(prepare) Task=`ca07af14-94e7-4711-8fbf-6f63f0905224`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53249::DEBUG::2014-05-16 17:08:16,356::task::579::TaskManager.Task::(_updateState) Task=`ca07af14-94e7-4711-8fbf-6f63f0905224`::moving from state preparing -> state finished >Thread-53249::DEBUG::2014-05-16 17:08:16,356::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53249::DEBUG::2014-05-16 17:08:16,357::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53249::DEBUG::2014-05-16 17:08:16,357::task::974::TaskManager.Task::(_decref) Task=`ca07af14-94e7-4711-8fbf-6f63f0905224`::ref 0 aborting False >Thread-53250::DEBUG::2014-05-16 17:08:16,386::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53250::DEBUG::2014-05-16 17:08:16,386::task::579::TaskManager.Task::(_updateState) Task=`d9c6361d-3d0b-4b7e-b71f-4fa938821054`::moving from state init -> state preparing >Thread-53250::INFO::2014-05-16 17:08:16,387::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53250::DEBUG::2014-05-16 17:08:16,387::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`97c93246-9b6a-4eed-ba06-8b5654ae9672`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53250::DEBUG::2014-05-16 17:08:16,387::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53250::DEBUG::2014-05-16 17:08:16,387::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53250::DEBUG::2014-05-16 17:08:16,388::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`97c93246-9b6a-4eed-ba06-8b5654ae9672`::Granted request >Thread-53250::DEBUG::2014-05-16 17:08:16,388::task::811::TaskManager.Task::(resourceAcquired) Task=`d9c6361d-3d0b-4b7e-b71f-4fa938821054`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53250::DEBUG::2014-05-16 17:08:16,388::task::974::TaskManager.Task::(_decref) Task=`d9c6361d-3d0b-4b7e-b71f-4fa938821054`::ref 1 aborting False >Thread-53250::INFO::2014-05-16 17:08:16,389::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53250::DEBUG::2014-05-16 17:08:16,389::task::1168::TaskManager.Task::(prepare) Task=`d9c6361d-3d0b-4b7e-b71f-4fa938821054`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53250::DEBUG::2014-05-16 17:08:16,389::task::579::TaskManager.Task::(_updateState) Task=`d9c6361d-3d0b-4b7e-b71f-4fa938821054`::moving from state preparing -> state finished >Thread-53250::DEBUG::2014-05-16 17:08:16,389::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53250::DEBUG::2014-05-16 17:08:16,389::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53250::DEBUG::2014-05-16 17:08:16,390::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53250::DEBUG::2014-05-16 17:08:16,390::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53250::DEBUG::2014-05-16 17:08:16,390::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53250::DEBUG::2014-05-16 17:08:16,390::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53250::DEBUG::2014-05-16 17:08:16,390::task::974::TaskManager.Task::(_decref) Task=`d9c6361d-3d0b-4b7e-b71f-4fa938821054`::ref 0 aborting False >Thread-53251::DEBUG::2014-05-16 17:08:16,534::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5412953.000000 / 8.010717 / 262500000.000000 = 0.257415 >Thread-53251::DEBUG::2014-05-16 17:08:16,534::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0063928645980112714, 'statsAge': 1.0571660995483398, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25741483005578297, 'rxDropped': 0} >Thread-53251::DEBUG::2014-05-16 17:08:16,535::task::579::TaskManager.Task::(_updateState) Task=`d81485d7-bd30-4b49-b253-98cc4bc7ab77`::moving from state init -> state preparing >Thread-53251::INFO::2014-05-16 17:08:16,535::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53251::INFO::2014-05-16 17:08:16,535::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587776', 'lastCheck': '3.8', 'valid': True}} >Thread-53251::DEBUG::2014-05-16 17:08:16,536::task::1168::TaskManager.Task::(prepare) Task=`d81485d7-bd30-4b49-b253-98cc4bc7ab77`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587776', 'lastCheck': '3.8', 'valid': True}} >Thread-53251::DEBUG::2014-05-16 17:08:16,536::task::579::TaskManager.Task::(_updateState) Task=`d81485d7-bd30-4b49-b253-98cc4bc7ab77`::moving from state preparing -> state finished >Thread-53251::DEBUG::2014-05-16 17:08:16,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53251::DEBUG::2014-05-16 17:08:16,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53251::DEBUG::2014-05-16 17:08:16,536::task::974::TaskManager.Task::(_decref) Task=`d81485d7-bd30-4b49-b253-98cc4bc7ab77`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:08:17,725::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:17,797::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358662 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:19,809::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:19,880::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350289 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:21,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:21,960::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315206 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:08:22,784::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:08:22,794::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000853311 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:23,972::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:24,041::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313737 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:26,053::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:26,125::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356779 s, 28.7 MB/s\n'; <rc> = 0 >Thread-53256::DEBUG::2014-05-16 17:08:26,442::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53256::DEBUG::2014-05-16 17:08:26,442::task::579::TaskManager.Task::(_updateState) Task=`5dc22e00-e1c5-4af3-b858-56b2bb1ce9bf`::moving from state init -> state preparing >Thread-53256::INFO::2014-05-16 17:08:26,442::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53256::INFO::2014-05-16 17:08:26,443::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53256::DEBUG::2014-05-16 17:08:26,443::task::1168::TaskManager.Task::(prepare) Task=`5dc22e00-e1c5-4af3-b858-56b2bb1ce9bf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53256::DEBUG::2014-05-16 17:08:26,443::task::579::TaskManager.Task::(_updateState) Task=`5dc22e00-e1c5-4af3-b858-56b2bb1ce9bf`::moving from state preparing -> state finished >Thread-53256::DEBUG::2014-05-16 17:08:26,443::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53256::DEBUG::2014-05-16 17:08:26,443::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53256::DEBUG::2014-05-16 17:08:26,444::task::974::TaskManager.Task::(_decref) Task=`5dc22e00-e1c5-4af3-b858-56b2bb1ce9bf`::ref 0 aborting False >Thread-53257::DEBUG::2014-05-16 17:08:26,452::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53257::DEBUG::2014-05-16 17:08:26,453::task::579::TaskManager.Task::(_updateState) Task=`a2cf3b1e-5469-40f8-926f-1808919fdf73`::moving from state init -> state preparing >Thread-53257::INFO::2014-05-16 17:08:26,453::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53257::DEBUG::2014-05-16 17:08:26,453::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e8d6c962-c86d-48fa-a779-2b50ed5fae11`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53257::DEBUG::2014-05-16 17:08:26,453::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53257::DEBUG::2014-05-16 17:08:26,454::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53257::DEBUG::2014-05-16 17:08:26,454::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e8d6c962-c86d-48fa-a779-2b50ed5fae11`::Granted request >Thread-53257::DEBUG::2014-05-16 17:08:26,454::task::811::TaskManager.Task::(resourceAcquired) Task=`a2cf3b1e-5469-40f8-926f-1808919fdf73`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53257::DEBUG::2014-05-16 17:08:26,454::task::974::TaskManager.Task::(_decref) Task=`a2cf3b1e-5469-40f8-926f-1808919fdf73`::ref 1 aborting False >Thread-53257::INFO::2014-05-16 17:08:26,455::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53257::DEBUG::2014-05-16 17:08:26,455::task::1168::TaskManager.Task::(prepare) Task=`a2cf3b1e-5469-40f8-926f-1808919fdf73`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53257::DEBUG::2014-05-16 17:08:26,455::task::579::TaskManager.Task::(_updateState) Task=`a2cf3b1e-5469-40f8-926f-1808919fdf73`::moving from state preparing -> state finished >Thread-53257::DEBUG::2014-05-16 17:08:26,455::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53257::DEBUG::2014-05-16 17:08:26,456::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53257::DEBUG::2014-05-16 17:08:26,456::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53257::DEBUG::2014-05-16 17:08:26,456::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53257::DEBUG::2014-05-16 17:08:26,456::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53257::DEBUG::2014-05-16 17:08:26,456::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53257::DEBUG::2014-05-16 17:08:26,457::task::974::TaskManager.Task::(_decref) Task=`a2cf3b1e-5469-40f8-926f-1808919fdf73`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:08:28,136::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:28,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361117 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:30,225::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:30,292::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308711 s, 33.2 MB/s\n'; <rc> = 0 >Thread-53259::DEBUG::2014-05-16 17:08:31,708::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317240.000000 / 8.008383 / 262500000.000000 = 0.205368 >Thread-53259::DEBUG::2014-05-16 17:08:31,708::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053152873624194939, 'statsAge': 0.21428108215332031, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20536765659428247, 'rxDropped': 0} >Thread-53259::DEBUG::2014-05-16 17:08:31,708::task::579::TaskManager.Task::(_updateState) Task=`ff987007-3b18-4818-97b2-99ab63c6edb8`::moving from state init -> state preparing >Thread-53259::INFO::2014-05-16 17:08:31,709::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53259::INFO::2014-05-16 17:08:31,709::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000853311', 'lastCheck': '8.9', 'valid': True}} >Thread-53259::DEBUG::2014-05-16 17:08:31,709::task::1168::TaskManager.Task::(prepare) Task=`ff987007-3b18-4818-97b2-99ab63c6edb8`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000853311', 'lastCheck': '8.9', 'valid': True}} >Thread-53259::DEBUG::2014-05-16 17:08:31,709::task::579::TaskManager.Task::(_updateState) Task=`ff987007-3b18-4818-97b2-99ab63c6edb8`::moving from state preparing -> state finished >Thread-53259::DEBUG::2014-05-16 17:08:31,709::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53259::DEBUG::2014-05-16 17:08:31,710::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53259::DEBUG::2014-05-16 17:08:31,710::task::974::TaskManager.Task::(_decref) Task=`ff987007-3b18-4818-97b2-99ab63c6edb8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:08:32,304::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:32,375::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358956 s, 28.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:08:32,832::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:08:32,842::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000854665 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:34,387::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:34,458::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351576 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:36,470::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-53262::DEBUG::2014-05-16 17:08:36,496::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53262::DEBUG::2014-05-16 17:08:36,497::task::579::TaskManager.Task::(_updateState) Task=`5e91e9cd-a538-4576-b585-47a6e4b3f12a`::moving from state init -> state preparing >Thread-53262::INFO::2014-05-16 17:08:36,497::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53262::INFO::2014-05-16 17:08:36,497::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53262::DEBUG::2014-05-16 17:08:36,497::task::1168::TaskManager.Task::(prepare) Task=`5e91e9cd-a538-4576-b585-47a6e4b3f12a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53262::DEBUG::2014-05-16 17:08:36,498::task::579::TaskManager.Task::(_updateState) Task=`5e91e9cd-a538-4576-b585-47a6e4b3f12a`::moving from state preparing -> state finished >Thread-53262::DEBUG::2014-05-16 17:08:36,498::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53262::DEBUG::2014-05-16 17:08:36,498::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53262::DEBUG::2014-05-16 17:08:36,498::task::974::TaskManager.Task::(_decref) Task=`5e91e9cd-a538-4576-b585-47a6e4b3f12a`::ref 0 aborting False >Thread-53263::DEBUG::2014-05-16 17:08:36,509::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53263::DEBUG::2014-05-16 17:08:36,509::task::579::TaskManager.Task::(_updateState) Task=`c4bc5595-5788-4cb0-92ac-9d57bad2a48b`::moving from state init -> state preparing >Thread-53263::INFO::2014-05-16 17:08:36,509::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53263::DEBUG::2014-05-16 17:08:36,510::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`94b95caf-498d-45b7-bf4d-a4084442db13`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53263::DEBUG::2014-05-16 17:08:36,510::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53263::DEBUG::2014-05-16 17:08:36,510::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53263::DEBUG::2014-05-16 17:08:36,511::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`94b95caf-498d-45b7-bf4d-a4084442db13`::Granted request >Thread-53263::DEBUG::2014-05-16 17:08:36,511::task::811::TaskManager.Task::(resourceAcquired) Task=`c4bc5595-5788-4cb0-92ac-9d57bad2a48b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53263::DEBUG::2014-05-16 17:08:36,511::task::974::TaskManager.Task::(_decref) Task=`c4bc5595-5788-4cb0-92ac-9d57bad2a48b`::ref 1 aborting False >Thread-53263::INFO::2014-05-16 17:08:36,512::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53263::DEBUG::2014-05-16 17:08:36,512::task::1168::TaskManager.Task::(prepare) Task=`c4bc5595-5788-4cb0-92ac-9d57bad2a48b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53263::DEBUG::2014-05-16 17:08:36,512::task::579::TaskManager.Task::(_updateState) Task=`c4bc5595-5788-4cb0-92ac-9d57bad2a48b`::moving from state preparing -> state finished >Thread-53263::DEBUG::2014-05-16 17:08:36,513::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53263::DEBUG::2014-05-16 17:08:36,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53263::DEBUG::2014-05-16 17:08:36,513::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53263::DEBUG::2014-05-16 17:08:36,513::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53263::DEBUG::2014-05-16 17:08:36,514::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53263::DEBUG::2014-05-16 17:08:36,514::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53263::DEBUG::2014-05-16 17:08:36,514::task::974::TaskManager.Task::(_decref) Task=`c4bc5595-5788-4cb0-92ac-9d57bad2a48b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:08:36,563::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436166 s, 23.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:38,579::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:38,651::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03544 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:40,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:40,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031542 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:42,741::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:42,809::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312916 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:08:42,880::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:08:42,890::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000825893 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:44,821::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:44,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345421 s, 29.6 MB/s\n'; <rc> = 0 >Thread-53267::DEBUG::2014-05-16 17:08:46,566::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53267::DEBUG::2014-05-16 17:08:46,567::task::579::TaskManager.Task::(_updateState) Task=`b5d6b287-6325-40a3-a251-73854d68131e`::moving from state init -> state preparing >Thread-53267::INFO::2014-05-16 17:08:46,567::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53267::INFO::2014-05-16 17:08:46,567::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53267::DEBUG::2014-05-16 17:08:46,567::task::1168::TaskManager.Task::(prepare) Task=`b5d6b287-6325-40a3-a251-73854d68131e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53267::DEBUG::2014-05-16 17:08:46,567::task::579::TaskManager.Task::(_updateState) Task=`b5d6b287-6325-40a3-a251-73854d68131e`::moving from state preparing -> state finished >Thread-53267::DEBUG::2014-05-16 17:08:46,567::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53267::DEBUG::2014-05-16 17:08:46,568::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53267::DEBUG::2014-05-16 17:08:46,568::task::974::TaskManager.Task::(_decref) Task=`b5d6b287-6325-40a3-a251-73854d68131e`::ref 0 aborting False >Thread-53268::DEBUG::2014-05-16 17:08:46,576::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53268::DEBUG::2014-05-16 17:08:46,576::task::579::TaskManager.Task::(_updateState) Task=`4a2fa25b-05cd-4279-a1b0-0a49f22774bf`::moving from state init -> state preparing >Thread-53268::INFO::2014-05-16 17:08:46,576::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53268::DEBUG::2014-05-16 17:08:46,577::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`663fb5a5-dc0d-4001-9a96-14997cfda941`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53268::DEBUG::2014-05-16 17:08:46,577::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53268::DEBUG::2014-05-16 17:08:46,577::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53268::DEBUG::2014-05-16 17:08:46,577::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`663fb5a5-dc0d-4001-9a96-14997cfda941`::Granted request >Thread-53268::DEBUG::2014-05-16 17:08:46,577::task::811::TaskManager.Task::(resourceAcquired) Task=`4a2fa25b-05cd-4279-a1b0-0a49f22774bf`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53268::DEBUG::2014-05-16 17:08:46,578::task::974::TaskManager.Task::(_decref) Task=`4a2fa25b-05cd-4279-a1b0-0a49f22774bf`::ref 1 aborting False >Thread-53268::INFO::2014-05-16 17:08:46,578::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53268::DEBUG::2014-05-16 17:08:46,578::task::1168::TaskManager.Task::(prepare) Task=`4a2fa25b-05cd-4279-a1b0-0a49f22774bf`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53268::DEBUG::2014-05-16 17:08:46,578::task::579::TaskManager.Task::(_updateState) Task=`4a2fa25b-05cd-4279-a1b0-0a49f22774bf`::moving from state preparing -> state finished >Thread-53268::DEBUG::2014-05-16 17:08:46,579::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53268::DEBUG::2014-05-16 17:08:46,579::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53268::DEBUG::2014-05-16 17:08:46,579::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53268::DEBUG::2014-05-16 17:08:46,579::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53268::DEBUG::2014-05-16 17:08:46,579::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53268::DEBUG::2014-05-16 17:08:46,579::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53268::DEBUG::2014-05-16 17:08:46,579::task::974::TaskManager.Task::(_decref) Task=`4a2fa25b-05cd-4279-a1b0-0a49f22774bf`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:08:46,902::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:46,969::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309962 s, 33.0 MB/s\n'; <rc> = 0 >Thread-53269::DEBUG::2014-05-16 17:08:47,145::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3239991.000000 / 8.008456 / 262500000.000000 = 0.154122 >Thread-53269::DEBUG::2014-05-16 17:08:47,145::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0039157658014931668, 'statsAge': 1.6364650726318359, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15412237851922603, 'rxDropped': 0} >Thread-53269::DEBUG::2014-05-16 17:08:47,145::task::579::TaskManager.Task::(_updateState) Task=`c676f17d-5fef-44fb-a78c-9cb8e03f144b`::moving from state init -> state preparing >Thread-53269::INFO::2014-05-16 17:08:47,146::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53269::INFO::2014-05-16 17:08:47,146::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000825893', 'lastCheck': '4.2', 'valid': True}} >Thread-53269::DEBUG::2014-05-16 17:08:47,146::task::1168::TaskManager.Task::(prepare) Task=`c676f17d-5fef-44fb-a78c-9cb8e03f144b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000825893', 'lastCheck': '4.2', 'valid': True}} >Thread-53269::DEBUG::2014-05-16 17:08:47,146::task::579::TaskManager.Task::(_updateState) Task=`c676f17d-5fef-44fb-a78c-9cb8e03f144b`::moving from state preparing -> state finished >Thread-53269::DEBUG::2014-05-16 17:08:47,146::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53269::DEBUG::2014-05-16 17:08:47,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53269::DEBUG::2014-05-16 17:08:47,147::task::974::TaskManager.Task::(_decref) Task=`c676f17d-5fef-44fb-a78c-9cb8e03f144b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:08:48,982::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:49,054::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349975 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:51,066::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:51,133::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031032 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:08:52,929::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:08:52,940::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107692 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:53,144::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:53,215::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357496 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:55,227::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:55,294::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301671 s, 33.9 MB/s\n'; <rc> = 0 >Thread-53274::DEBUG::2014-05-16 17:08:56,607::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53274::DEBUG::2014-05-16 17:08:56,607::task::579::TaskManager.Task::(_updateState) Task=`83f60cab-ff7c-4f6d-a6bb-73aab07dc056`::moving from state init -> state preparing >Thread-53274::INFO::2014-05-16 17:08:56,608::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53274::INFO::2014-05-16 17:08:56,608::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53274::DEBUG::2014-05-16 17:08:56,608::task::1168::TaskManager.Task::(prepare) Task=`83f60cab-ff7c-4f6d-a6bb-73aab07dc056`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53274::DEBUG::2014-05-16 17:08:56,608::task::579::TaskManager.Task::(_updateState) Task=`83f60cab-ff7c-4f6d-a6bb-73aab07dc056`::moving from state preparing -> state finished >Thread-53274::DEBUG::2014-05-16 17:08:56,608::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53274::DEBUG::2014-05-16 17:08:56,609::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53274::DEBUG::2014-05-16 17:08:56,609::task::974::TaskManager.Task::(_decref) Task=`83f60cab-ff7c-4f6d-a6bb-73aab07dc056`::ref 0 aborting False >Thread-53275::DEBUG::2014-05-16 17:08:56,634::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53275::DEBUG::2014-05-16 17:08:56,635::task::579::TaskManager.Task::(_updateState) Task=`ea8ed7a8-a989-492b-bcb0-578406da6d15`::moving from state init -> state preparing >Thread-53275::INFO::2014-05-16 17:08:56,635::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53275::DEBUG::2014-05-16 17:08:56,635::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`28efa2af-fdf6-4481-a715-abd53fa32b69`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53275::DEBUG::2014-05-16 17:08:56,635::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53275::DEBUG::2014-05-16 17:08:56,636::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53275::DEBUG::2014-05-16 17:08:56,636::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`28efa2af-fdf6-4481-a715-abd53fa32b69`::Granted request >Thread-53275::DEBUG::2014-05-16 17:08:56,636::task::811::TaskManager.Task::(resourceAcquired) Task=`ea8ed7a8-a989-492b-bcb0-578406da6d15`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53275::DEBUG::2014-05-16 17:08:56,636::task::974::TaskManager.Task::(_decref) Task=`ea8ed7a8-a989-492b-bcb0-578406da6d15`::ref 1 aborting False >Thread-53275::INFO::2014-05-16 17:08:56,637::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53275::DEBUG::2014-05-16 17:08:56,637::task::1168::TaskManager.Task::(prepare) Task=`ea8ed7a8-a989-492b-bcb0-578406da6d15`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53275::DEBUG::2014-05-16 17:08:56,637::task::579::TaskManager.Task::(_updateState) Task=`ea8ed7a8-a989-492b-bcb0-578406da6d15`::moving from state preparing -> state finished >Thread-53275::DEBUG::2014-05-16 17:08:56,637::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53275::DEBUG::2014-05-16 17:08:56,637::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53275::DEBUG::2014-05-16 17:08:56,638::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53275::DEBUG::2014-05-16 17:08:56,638::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53275::DEBUG::2014-05-16 17:08:56,638::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53275::DEBUG::2014-05-16 17:08:56,638::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53275::DEBUG::2014-05-16 17:08:56,638::task::974::TaskManager.Task::(_decref) Task=`ea8ed7a8-a989-492b-bcb0-578406da6d15`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:08:57,306::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:57,373::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314771 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:08:59,385::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:08:59,456::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345024 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:01,467::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:01,539::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309996 s, 33.0 MB/s\n'; <rc> = 0 >Thread-53277::DEBUG::2014-05-16 17:09:02,614::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5415697.000000 / 8.008588 / 262500000.000000 = 0.257614 >Thread-53277::DEBUG::2014-05-16 17:09:02,614::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.006854831749496827, 'statsAge': 1.0890669822692871, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25761378250214922, 'rxDropped': 0} >Thread-53277::DEBUG::2014-05-16 17:09:02,615::task::579::TaskManager.Task::(_updateState) Task=`8cc19a5e-2755-4c8e-bfea-c976f35c3d69`::moving from state init -> state preparing >Thread-53277::INFO::2014-05-16 17:09:02,615::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53277::INFO::2014-05-16 17:09:02,615::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107692', 'lastCheck': '9.7', 'valid': True}} >Thread-53277::DEBUG::2014-05-16 17:09:02,616::task::1168::TaskManager.Task::(prepare) Task=`8cc19a5e-2755-4c8e-bfea-c976f35c3d69`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107692', 'lastCheck': '9.7', 'valid': True}} >Thread-53277::DEBUG::2014-05-16 17:09:02,616::task::579::TaskManager.Task::(_updateState) Task=`8cc19a5e-2755-4c8e-bfea-c976f35c3d69`::moving from state preparing -> state finished >Thread-53277::DEBUG::2014-05-16 17:09:02,616::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53277::DEBUG::2014-05-16 17:09:02,616::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53277::DEBUG::2014-05-16 17:09:02,616::task::974::TaskManager.Task::(_decref) Task=`8cc19a5e-2755-4c8e-bfea-c976f35c3d69`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:09:02,977::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:09:02,988::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109408 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:03,551::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:03,622::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353697 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:05,634::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:05,706::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354644 s, 28.9 MB/s\n'; <rc> = 0 >Thread-53280::DEBUG::2014-05-16 17:09:06,707::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53280::DEBUG::2014-05-16 17:09:06,707::task::579::TaskManager.Task::(_updateState) Task=`e27a2547-12bc-417b-a789-6f9f8fa21326`::moving from state init -> state preparing >Thread-53280::INFO::2014-05-16 17:09:06,707::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53280::INFO::2014-05-16 17:09:06,707::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53280::DEBUG::2014-05-16 17:09:06,708::task::1168::TaskManager.Task::(prepare) Task=`e27a2547-12bc-417b-a789-6f9f8fa21326`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53280::DEBUG::2014-05-16 17:09:06,708::task::579::TaskManager.Task::(_updateState) Task=`e27a2547-12bc-417b-a789-6f9f8fa21326`::moving from state preparing -> state finished >Thread-53280::DEBUG::2014-05-16 17:09:06,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53280::DEBUG::2014-05-16 17:09:06,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53280::DEBUG::2014-05-16 17:09:06,708::task::974::TaskManager.Task::(_decref) Task=`e27a2547-12bc-417b-a789-6f9f8fa21326`::ref 0 aborting False >Thread-53281::DEBUG::2014-05-16 17:09:06,729::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53281::DEBUG::2014-05-16 17:09:06,729::task::579::TaskManager.Task::(_updateState) Task=`52035757-e92d-478c-951a-b67712507e9e`::moving from state init -> state preparing >Thread-53281::INFO::2014-05-16 17:09:06,729::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53281::DEBUG::2014-05-16 17:09:06,729::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6fe53747-f67c-468b-af7d-2a3db1114628`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53281::DEBUG::2014-05-16 17:09:06,729::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53281::DEBUG::2014-05-16 17:09:06,730::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53281::DEBUG::2014-05-16 17:09:06,730::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6fe53747-f67c-468b-af7d-2a3db1114628`::Granted request >Thread-53281::DEBUG::2014-05-16 17:09:06,730::task::811::TaskManager.Task::(resourceAcquired) Task=`52035757-e92d-478c-951a-b67712507e9e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53281::DEBUG::2014-05-16 17:09:06,730::task::974::TaskManager.Task::(_decref) Task=`52035757-e92d-478c-951a-b67712507e9e`::ref 1 aborting False >Thread-53281::INFO::2014-05-16 17:09:06,731::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53281::DEBUG::2014-05-16 17:09:06,731::task::1168::TaskManager.Task::(prepare) Task=`52035757-e92d-478c-951a-b67712507e9e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53281::DEBUG::2014-05-16 17:09:06,731::task::579::TaskManager.Task::(_updateState) Task=`52035757-e92d-478c-951a-b67712507e9e`::moving from state preparing -> state finished >Thread-53281::DEBUG::2014-05-16 17:09:06,731::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53281::DEBUG::2014-05-16 17:09:06,731::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53281::DEBUG::2014-05-16 17:09:06,732::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53281::DEBUG::2014-05-16 17:09:06,732::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53281::DEBUG::2014-05-16 17:09:06,732::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53281::DEBUG::2014-05-16 17:09:06,732::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53281::DEBUG::2014-05-16 17:09:06,732::task::974::TaskManager.Task::(_decref) Task=`52035757-e92d-478c-951a-b67712507e9e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:09:07,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:07,785::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308744 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:09,797::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:09,863::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308112 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:11,875::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:11,945::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346231 s, 29.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:09:13,021::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:09:13,032::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000838746 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:13,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:14,034::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0397449 s, 25.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:16,046::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:16,113::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303858 s, 33.7 MB/s\n'; <rc> = 0 >Thread-53285::DEBUG::2014-05-16 17:09:16,767::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53285::DEBUG::2014-05-16 17:09:16,767::task::579::TaskManager.Task::(_updateState) Task=`09000146-ad38-47e9-a283-609719289616`::moving from state init -> state preparing >Thread-53285::INFO::2014-05-16 17:09:16,768::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53285::INFO::2014-05-16 17:09:16,768::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53285::DEBUG::2014-05-16 17:09:16,768::task::1168::TaskManager.Task::(prepare) Task=`09000146-ad38-47e9-a283-609719289616`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53285::DEBUG::2014-05-16 17:09:16,768::task::579::TaskManager.Task::(_updateState) Task=`09000146-ad38-47e9-a283-609719289616`::moving from state preparing -> state finished >Thread-53285::DEBUG::2014-05-16 17:09:16,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53285::DEBUG::2014-05-16 17:09:16,769::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53285::DEBUG::2014-05-16 17:09:16,769::task::974::TaskManager.Task::(_decref) Task=`09000146-ad38-47e9-a283-609719289616`::ref 0 aborting False >Thread-53286::DEBUG::2014-05-16 17:09:16,799::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53286::DEBUG::2014-05-16 17:09:16,799::task::579::TaskManager.Task::(_updateState) Task=`72f73956-a4f1-4682-82f1-2e65519dfb00`::moving from state init -> state preparing >Thread-53286::INFO::2014-05-16 17:09:16,799::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53286::DEBUG::2014-05-16 17:09:16,800::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5e6b3d8d-0aa6-41ff-abb2-7c7ece9fd98e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53286::DEBUG::2014-05-16 17:09:16,800::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53286::DEBUG::2014-05-16 17:09:16,800::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53286::DEBUG::2014-05-16 17:09:16,800::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5e6b3d8d-0aa6-41ff-abb2-7c7ece9fd98e`::Granted request >Thread-53286::DEBUG::2014-05-16 17:09:16,801::task::811::TaskManager.Task::(resourceAcquired) Task=`72f73956-a4f1-4682-82f1-2e65519dfb00`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53286::DEBUG::2014-05-16 17:09:16,801::task::974::TaskManager.Task::(_decref) Task=`72f73956-a4f1-4682-82f1-2e65519dfb00`::ref 1 aborting False >Thread-53286::INFO::2014-05-16 17:09:16,802::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53286::DEBUG::2014-05-16 17:09:16,802::task::1168::TaskManager.Task::(prepare) Task=`72f73956-a4f1-4682-82f1-2e65519dfb00`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53286::DEBUG::2014-05-16 17:09:16,802::task::579::TaskManager.Task::(_updateState) Task=`72f73956-a4f1-4682-82f1-2e65519dfb00`::moving from state preparing -> state finished >Thread-53286::DEBUG::2014-05-16 17:09:16,802::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53286::DEBUG::2014-05-16 17:09:16,802::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53286::DEBUG::2014-05-16 17:09:16,802::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53286::DEBUG::2014-05-16 17:09:16,803::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53286::DEBUG::2014-05-16 17:09:16,803::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53286::DEBUG::2014-05-16 17:09:16,803::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53286::DEBUG::2014-05-16 17:09:16,803::task::974::TaskManager.Task::(_decref) Task=`72f73956-a4f1-4682-82f1-2e65519dfb00`::ref 0 aborting False >Thread-53287::DEBUG::2014-05-16 17:09:17,942::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413707.000000 / 8.008092 / 262500000.000000 = 0.257535 >Thread-53287::DEBUG::2014-05-16 17:09:17,942::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0063583303225054639, 'statsAge': 0.39759683609008789, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25753506939443427, 'rxDropped': 0} >Thread-53287::DEBUG::2014-05-16 17:09:17,942::task::579::TaskManager.Task::(_updateState) Task=`e4f204e3-58e0-4db4-9350-a4e427789c1c`::moving from state init -> state preparing >Thread-53287::INFO::2014-05-16 17:09:17,943::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53287::INFO::2014-05-16 17:09:17,943::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000838746', 'lastCheck': '4.9', 'valid': True}} >Thread-53287::DEBUG::2014-05-16 17:09:17,943::task::1168::TaskManager.Task::(prepare) Task=`e4f204e3-58e0-4db4-9350-a4e427789c1c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000838746', 'lastCheck': '4.9', 'valid': True}} >Thread-53287::DEBUG::2014-05-16 17:09:17,943::task::579::TaskManager.Task::(_updateState) Task=`e4f204e3-58e0-4db4-9350-a4e427789c1c`::moving from state preparing -> state finished >Thread-53287::DEBUG::2014-05-16 17:09:17,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53287::DEBUG::2014-05-16 17:09:17,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53287::DEBUG::2014-05-16 17:09:17,944::task::974::TaskManager.Task::(_decref) Task=`e4f204e3-58e0-4db4-9350-a4e427789c1c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:09:18,124::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:18,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314958 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:20,203::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:20,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344346 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:22,285::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:22,353::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316598 s, 32.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:09:23,070::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:09:23,080::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699112 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:24,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:24,431::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308665 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:26,442::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:26,513::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343753 s, 29.8 MB/s\n'; <rc> = 0 >Thread-53291::DEBUG::2014-05-16 17:09:26,870::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53291::DEBUG::2014-05-16 17:09:26,870::task::579::TaskManager.Task::(_updateState) Task=`b64ee1d2-1fc9-4061-9600-8a5008f2eff5`::moving from state init -> state preparing >Thread-53291::INFO::2014-05-16 17:09:26,871::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53291::INFO::2014-05-16 17:09:26,871::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53291::DEBUG::2014-05-16 17:09:26,871::task::1168::TaskManager.Task::(prepare) Task=`b64ee1d2-1fc9-4061-9600-8a5008f2eff5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53291::DEBUG::2014-05-16 17:09:26,871::task::579::TaskManager.Task::(_updateState) Task=`b64ee1d2-1fc9-4061-9600-8a5008f2eff5`::moving from state preparing -> state finished >Thread-53291::DEBUG::2014-05-16 17:09:26,871::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53291::DEBUG::2014-05-16 17:09:26,872::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53291::DEBUG::2014-05-16 17:09:26,872::task::974::TaskManager.Task::(_decref) Task=`b64ee1d2-1fc9-4061-9600-8a5008f2eff5`::ref 0 aborting False >Thread-53292::DEBUG::2014-05-16 17:09:26,881::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53292::DEBUG::2014-05-16 17:09:26,881::task::579::TaskManager.Task::(_updateState) Task=`b5a1d401-212a-4ec4-9dcd-ca892aeeb147`::moving from state init -> state preparing >Thread-53292::INFO::2014-05-16 17:09:26,881::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53292::DEBUG::2014-05-16 17:09:26,882::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9947e744-c7b1-4256-9857-e10a30754ff6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53292::DEBUG::2014-05-16 17:09:26,882::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53292::DEBUG::2014-05-16 17:09:26,882::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53292::DEBUG::2014-05-16 17:09:26,883::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9947e744-c7b1-4256-9857-e10a30754ff6`::Granted request >Thread-53292::DEBUG::2014-05-16 17:09:26,883::task::811::TaskManager.Task::(resourceAcquired) Task=`b5a1d401-212a-4ec4-9dcd-ca892aeeb147`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53292::DEBUG::2014-05-16 17:09:26,884::task::974::TaskManager.Task::(_decref) Task=`b5a1d401-212a-4ec4-9dcd-ca892aeeb147`::ref 1 aborting False >Thread-53292::INFO::2014-05-16 17:09:26,884::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53292::DEBUG::2014-05-16 17:09:26,884::task::1168::TaskManager.Task::(prepare) Task=`b5a1d401-212a-4ec4-9dcd-ca892aeeb147`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53292::DEBUG::2014-05-16 17:09:26,885::task::579::TaskManager.Task::(_updateState) Task=`b5a1d401-212a-4ec4-9dcd-ca892aeeb147`::moving from state preparing -> state finished >Thread-53292::DEBUG::2014-05-16 17:09:26,885::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53292::DEBUG::2014-05-16 17:09:26,885::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53292::DEBUG::2014-05-16 17:09:26,885::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53292::DEBUG::2014-05-16 17:09:26,885::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53292::DEBUG::2014-05-16 17:09:26,885::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53292::DEBUG::2014-05-16 17:09:26,886::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53292::DEBUG::2014-05-16 17:09:26,886::task::974::TaskManager.Task::(_decref) Task=`b5a1d401-212a-4ec4-9dcd-ca892aeeb147`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:09:28,526::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:28,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354927 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:30,608::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:30,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303288 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:32,686::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:32,757::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358005 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:09:33,113::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:09:33,123::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731414 s, 5.6 MB/s\n'; <rc> = 0 >Thread-53295::DEBUG::2014-05-16 17:09:33,288::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4320133.000000 / 8.008366 / 262500000.000000 = 0.205506 >Thread-53295::DEBUG::2014-05-16 17:09:33,288::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005497203606109809, 'statsAge': 1.7290530204772949, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2055057086799639, 'rxDropped': 0} >Thread-53295::DEBUG::2014-05-16 17:09:33,289::task::579::TaskManager.Task::(_updateState) Task=`ff8d394e-bc8f-47ec-a9aa-ec434b858e6e`::moving from state init -> state preparing >Thread-53295::INFO::2014-05-16 17:09:33,289::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53295::INFO::2014-05-16 17:09:33,289::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731414', 'lastCheck': '0.1', 'valid': True}} >Thread-53295::DEBUG::2014-05-16 17:09:33,289::task::1168::TaskManager.Task::(prepare) Task=`ff8d394e-bc8f-47ec-a9aa-ec434b858e6e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731414', 'lastCheck': '0.1', 'valid': True}} >Thread-53295::DEBUG::2014-05-16 17:09:33,289::task::579::TaskManager.Task::(_updateState) Task=`ff8d394e-bc8f-47ec-a9aa-ec434b858e6e`::moving from state preparing -> state finished >Thread-53295::DEBUG::2014-05-16 17:09:33,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53295::DEBUG::2014-05-16 17:09:33,290::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53295::DEBUG::2014-05-16 17:09:33,290::task::974::TaskManager.Task::(_decref) Task=`ff8d394e-bc8f-47ec-a9aa-ec434b858e6e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:09:34,769::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:34,840::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346059 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:36,852::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:36,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312575 s, 32.8 MB/s\n'; <rc> = 0 >Thread-53298::DEBUG::2014-05-16 17:09:36,941::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53298::DEBUG::2014-05-16 17:09:36,942::task::579::TaskManager.Task::(_updateState) Task=`7a309e63-858b-42e0-82a4-104f0e5e2ddb`::moving from state init -> state preparing >Thread-53298::INFO::2014-05-16 17:09:36,942::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53298::INFO::2014-05-16 17:09:36,942::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53298::DEBUG::2014-05-16 17:09:36,942::task::1168::TaskManager.Task::(prepare) Task=`7a309e63-858b-42e0-82a4-104f0e5e2ddb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53298::DEBUG::2014-05-16 17:09:36,942::task::579::TaskManager.Task::(_updateState) Task=`7a309e63-858b-42e0-82a4-104f0e5e2ddb`::moving from state preparing -> state finished >Thread-53298::DEBUG::2014-05-16 17:09:36,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53298::DEBUG::2014-05-16 17:09:36,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53298::DEBUG::2014-05-16 17:09:36,943::task::974::TaskManager.Task::(_decref) Task=`7a309e63-858b-42e0-82a4-104f0e5e2ddb`::ref 0 aborting False >Thread-53299::DEBUG::2014-05-16 17:09:36,989::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53299::DEBUG::2014-05-16 17:09:36,990::task::579::TaskManager.Task::(_updateState) Task=`4a4c7738-55c7-4472-bb73-bfc81f97ea3b`::moving from state init -> state preparing >Thread-53299::INFO::2014-05-16 17:09:36,990::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53299::DEBUG::2014-05-16 17:09:36,990::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f58cdbf4-cfe8-4d23-9843-21e34970fe65`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53299::DEBUG::2014-05-16 17:09:36,990::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53299::DEBUG::2014-05-16 17:09:36,991::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53299::DEBUG::2014-05-16 17:09:36,991::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f58cdbf4-cfe8-4d23-9843-21e34970fe65`::Granted request >Thread-53299::DEBUG::2014-05-16 17:09:36,991::task::811::TaskManager.Task::(resourceAcquired) Task=`4a4c7738-55c7-4472-bb73-bfc81f97ea3b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53299::DEBUG::2014-05-16 17:09:36,991::task::974::TaskManager.Task::(_decref) Task=`4a4c7738-55c7-4472-bb73-bfc81f97ea3b`::ref 1 aborting False >Thread-53299::INFO::2014-05-16 17:09:36,992::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53299::DEBUG::2014-05-16 17:09:36,992::task::1168::TaskManager.Task::(prepare) Task=`4a4c7738-55c7-4472-bb73-bfc81f97ea3b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53299::DEBUG::2014-05-16 17:09:36,992::task::579::TaskManager.Task::(_updateState) Task=`4a4c7738-55c7-4472-bb73-bfc81f97ea3b`::moving from state preparing -> state finished >Thread-53299::DEBUG::2014-05-16 17:09:36,992::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53299::DEBUG::2014-05-16 17:09:36,992::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53299::DEBUG::2014-05-16 17:09:36,993::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53299::DEBUG::2014-05-16 17:09:36,993::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53299::DEBUG::2014-05-16 17:09:36,993::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53299::DEBUG::2014-05-16 17:09:36,993::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53299::DEBUG::2014-05-16 17:09:36,993::task::974::TaskManager.Task::(_decref) Task=`4a4c7738-55c7-4472-bb73-bfc81f97ea3b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:09:38,931::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:39,003::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356134 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:41,015::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:41,084::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313013 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:43,096::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 17:09:43,289::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:09:43,325::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000738052 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:43,432::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031852 s, 32.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:45,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:45,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457939 s, 22.4 MB/s\n'; <rc> = 0 >Thread-53303::DEBUG::2014-05-16 17:09:47,044::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53303::DEBUG::2014-05-16 17:09:47,045::task::579::TaskManager.Task::(_updateState) Task=`4bf3c40c-e9a3-449e-906a-4f2dcb1a1d85`::moving from state init -> state preparing >Thread-53303::INFO::2014-05-16 17:09:47,045::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53303::INFO::2014-05-16 17:09:47,045::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53303::DEBUG::2014-05-16 17:09:47,046::task::1168::TaskManager.Task::(prepare) Task=`4bf3c40c-e9a3-449e-906a-4f2dcb1a1d85`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53303::DEBUG::2014-05-16 17:09:47,046::task::579::TaskManager.Task::(_updateState) Task=`4bf3c40c-e9a3-449e-906a-4f2dcb1a1d85`::moving from state preparing -> state finished >Thread-53303::DEBUG::2014-05-16 17:09:47,046::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53303::DEBUG::2014-05-16 17:09:47,046::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53303::DEBUG::2014-05-16 17:09:47,046::task::974::TaskManager.Task::(_decref) Task=`4bf3c40c-e9a3-449e-906a-4f2dcb1a1d85`::ref 0 aborting False >Thread-53304::DEBUG::2014-05-16 17:09:47,056::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53304::DEBUG::2014-05-16 17:09:47,057::task::579::TaskManager.Task::(_updateState) Task=`a50e2a77-6a82-4a12-87c9-05c3fbb9a7e8`::moving from state init -> state preparing >Thread-53304::INFO::2014-05-16 17:09:47,057::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53304::DEBUG::2014-05-16 17:09:47,057::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`47c34231-908e-4fcf-848e-5fb1e9d799ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53304::DEBUG::2014-05-16 17:09:47,057::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53304::DEBUG::2014-05-16 17:09:47,058::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53304::DEBUG::2014-05-16 17:09:47,058::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`47c34231-908e-4fcf-848e-5fb1e9d799ab`::Granted request >Thread-53304::DEBUG::2014-05-16 17:09:47,058::task::811::TaskManager.Task::(resourceAcquired) Task=`a50e2a77-6a82-4a12-87c9-05c3fbb9a7e8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53304::DEBUG::2014-05-16 17:09:47,058::task::974::TaskManager.Task::(_decref) Task=`a50e2a77-6a82-4a12-87c9-05c3fbb9a7e8`::ref 1 aborting False >Thread-53304::INFO::2014-05-16 17:09:47,059::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53304::DEBUG::2014-05-16 17:09:47,059::task::1168::TaskManager.Task::(prepare) Task=`a50e2a77-6a82-4a12-87c9-05c3fbb9a7e8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53304::DEBUG::2014-05-16 17:09:47,059::task::579::TaskManager.Task::(_updateState) Task=`a50e2a77-6a82-4a12-87c9-05c3fbb9a7e8`::moving from state preparing -> state finished >Thread-53304::DEBUG::2014-05-16 17:09:47,059::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53304::DEBUG::2014-05-16 17:09:47,059::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53304::DEBUG::2014-05-16 17:09:47,060::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53304::DEBUG::2014-05-16 17:09:47,060::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53304::DEBUG::2014-05-16 17:09:47,060::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53304::DEBUG::2014-05-16 17:09:47,060::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53304::DEBUG::2014-05-16 17:09:47,060::task::974::TaskManager.Task::(_decref) Task=`a50e2a77-6a82-4a12-87c9-05c3fbb9a7e8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:09:47,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:47,620::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396933 s, 25.8 MB/s\n'; <rc> = 0 >Thread-53305::DEBUG::2014-05-16 17:09:48,554::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4311086.000000 / 8.008860 / 262500000.000000 = 0.205063 >Thread-53305::DEBUG::2014-05-16 17:09:48,554::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005112813678236061, 'statsAge': 0.97811293601989746, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20506269973254676, 'rxDropped': 0} >Thread-53305::DEBUG::2014-05-16 17:09:48,555::task::579::TaskManager.Task::(_updateState) Task=`35279d71-d95a-4097-9d3b-4f5e875e1f71`::moving from state init -> state preparing >Thread-53305::INFO::2014-05-16 17:09:48,555::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53305::INFO::2014-05-16 17:09:48,555::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738052', 'lastCheck': '5.1', 'valid': True}} >Thread-53305::DEBUG::2014-05-16 17:09:48,556::task::1168::TaskManager.Task::(prepare) Task=`35279d71-d95a-4097-9d3b-4f5e875e1f71`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738052', 'lastCheck': '5.1', 'valid': True}} >Thread-53305::DEBUG::2014-05-16 17:09:48,556::task::579::TaskManager.Task::(_updateState) Task=`35279d71-d95a-4097-9d3b-4f5e875e1f71`::moving from state preparing -> state finished >Thread-53305::DEBUG::2014-05-16 17:09:48,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53305::DEBUG::2014-05-16 17:09:48,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53305::DEBUG::2014-05-16 17:09:48,556::task::974::TaskManager.Task::(_decref) Task=`35279d71-d95a-4097-9d3b-4f5e875e1f71`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:09:49,632::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:49,704::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355403 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:51,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:51,782::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307356 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:09:53,447::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:09:53,458::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111364 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:53,794::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:53,865::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03512 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:09:55,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:55,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300887 s, 34.0 MB/s\n'; <rc> = 0 >Thread-53309::DEBUG::2014-05-16 17:09:57,128::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53309::DEBUG::2014-05-16 17:09:57,129::task::579::TaskManager.Task::(_updateState) Task=`b7098eaf-0109-486b-a7ee-552ebf94cf2f`::moving from state init -> state preparing >Thread-53309::INFO::2014-05-16 17:09:57,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53309::INFO::2014-05-16 17:09:57,129::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53309::DEBUG::2014-05-16 17:09:57,129::task::1168::TaskManager.Task::(prepare) Task=`b7098eaf-0109-486b-a7ee-552ebf94cf2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53309::DEBUG::2014-05-16 17:09:57,129::task::579::TaskManager.Task::(_updateState) Task=`b7098eaf-0109-486b-a7ee-552ebf94cf2f`::moving from state preparing -> state finished >Thread-53309::DEBUG::2014-05-16 17:09:57,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53309::DEBUG::2014-05-16 17:09:57,130::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53309::DEBUG::2014-05-16 17:09:57,130::task::974::TaskManager.Task::(_decref) Task=`b7098eaf-0109-486b-a7ee-552ebf94cf2f`::ref 0 aborting False >Thread-53310::DEBUG::2014-05-16 17:09:57,166::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53310::DEBUG::2014-05-16 17:09:57,166::task::579::TaskManager.Task::(_updateState) Task=`70289b79-45c7-4016-8a03-9e3adeb5cbba`::moving from state init -> state preparing >Thread-53310::INFO::2014-05-16 17:09:57,166::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53310::DEBUG::2014-05-16 17:09:57,167::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`01b90718-4f5e-47c9-8f6a-566e593292b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53310::DEBUG::2014-05-16 17:09:57,167::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53310::DEBUG::2014-05-16 17:09:57,167::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53310::DEBUG::2014-05-16 17:09:57,167::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`01b90718-4f5e-47c9-8f6a-566e593292b7`::Granted request >Thread-53310::DEBUG::2014-05-16 17:09:57,167::task::811::TaskManager.Task::(resourceAcquired) Task=`70289b79-45c7-4016-8a03-9e3adeb5cbba`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53310::DEBUG::2014-05-16 17:09:57,167::task::974::TaskManager.Task::(_decref) Task=`70289b79-45c7-4016-8a03-9e3adeb5cbba`::ref 1 aborting False >Thread-53310::INFO::2014-05-16 17:09:57,168::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53310::DEBUG::2014-05-16 17:09:57,168::task::1168::TaskManager.Task::(prepare) Task=`70289b79-45c7-4016-8a03-9e3adeb5cbba`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53310::DEBUG::2014-05-16 17:09:57,168::task::579::TaskManager.Task::(_updateState) Task=`70289b79-45c7-4016-8a03-9e3adeb5cbba`::moving from state preparing -> state finished >Thread-53310::DEBUG::2014-05-16 17:09:57,168::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53310::DEBUG::2014-05-16 17:09:57,169::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53310::DEBUG::2014-05-16 17:09:57,169::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53310::DEBUG::2014-05-16 17:09:57,169::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53310::DEBUG::2014-05-16 17:09:57,169::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53310::DEBUG::2014-05-16 17:09:57,169::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53310::DEBUG::2014-05-16 17:09:57,169::task::974::TaskManager.Task::(_decref) Task=`70289b79-45c7-4016-8a03-9e3adeb5cbba`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:09:57,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:09:58,023::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311744 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:00,035::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:00,105::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343587 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:02,117::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:02,189::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356021 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:10:03,491::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:10:03,501::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000967461 s, 4.2 MB/s\n'; <rc> = 0 >Thread-53313::DEBUG::2014-05-16 17:10:03,827::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5411584.000000 / 8.008141 / 262500000.000000 = 0.257433 >Thread-53313::DEBUG::2014-05-16 17:10:03,828::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065685537372399691, 'statsAge': 0.23200488090515137, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25743250512447868, 'rxDropped': 0} >Thread-53313::DEBUG::2014-05-16 17:10:03,828::task::579::TaskManager.Task::(_updateState) Task=`c096a91f-37d9-4e69-a43d-aca57878e7fd`::moving from state init -> state preparing >Thread-53313::INFO::2014-05-16 17:10:03,828::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53313::INFO::2014-05-16 17:10:03,829::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000967461', 'lastCheck': '0.3', 'valid': True}} >Thread-53313::DEBUG::2014-05-16 17:10:03,829::task::1168::TaskManager.Task::(prepare) Task=`c096a91f-37d9-4e69-a43d-aca57878e7fd`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000967461', 'lastCheck': '0.3', 'valid': True}} >Thread-53313::DEBUG::2014-05-16 17:10:03,829::task::579::TaskManager.Task::(_updateState) Task=`c096a91f-37d9-4e69-a43d-aca57878e7fd`::moving from state preparing -> state finished >Thread-53313::DEBUG::2014-05-16 17:10:03,829::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53313::DEBUG::2014-05-16 17:10:03,829::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53313::DEBUG::2014-05-16 17:10:03,829::task::974::TaskManager.Task::(_decref) Task=`c096a91f-37d9-4e69-a43d-aca57878e7fd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:10:04,200::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:04,271::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348054 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:06,282::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:06,349::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309013 s, 33.1 MB/s\n'; <rc> = 0 >Thread-53316::DEBUG::2014-05-16 17:10:07,248::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53316::DEBUG::2014-05-16 17:10:07,248::task::579::TaskManager.Task::(_updateState) Task=`1c6faa00-0a18-4d31-b0d4-9504189a4618`::moving from state init -> state preparing >Thread-53316::INFO::2014-05-16 17:10:07,249::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53316::INFO::2014-05-16 17:10:07,249::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53316::DEBUG::2014-05-16 17:10:07,249::task::1168::TaskManager.Task::(prepare) Task=`1c6faa00-0a18-4d31-b0d4-9504189a4618`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53316::DEBUG::2014-05-16 17:10:07,249::task::579::TaskManager.Task::(_updateState) Task=`1c6faa00-0a18-4d31-b0d4-9504189a4618`::moving from state preparing -> state finished >Thread-53316::DEBUG::2014-05-16 17:10:07,249::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53316::DEBUG::2014-05-16 17:10:07,250::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53316::DEBUG::2014-05-16 17:10:07,250::task::974::TaskManager.Task::(_decref) Task=`1c6faa00-0a18-4d31-b0d4-9504189a4618`::ref 0 aborting False >Thread-53317::DEBUG::2014-05-16 17:10:07,260::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53317::DEBUG::2014-05-16 17:10:07,260::task::579::TaskManager.Task::(_updateState) Task=`67072098-78bc-420c-ae06-f91c4268842b`::moving from state init -> state preparing >Thread-53317::INFO::2014-05-16 17:10:07,260::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53317::DEBUG::2014-05-16 17:10:07,261::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`636e83ed-e4aa-441e-8b6b-1662728b0bbf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53317::DEBUG::2014-05-16 17:10:07,261::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53317::DEBUG::2014-05-16 17:10:07,261::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53317::DEBUG::2014-05-16 17:10:07,261::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`636e83ed-e4aa-441e-8b6b-1662728b0bbf`::Granted request >Thread-53317::DEBUG::2014-05-16 17:10:07,262::task::811::TaskManager.Task::(resourceAcquired) Task=`67072098-78bc-420c-ae06-f91c4268842b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53317::DEBUG::2014-05-16 17:10:07,262::task::974::TaskManager.Task::(_decref) Task=`67072098-78bc-420c-ae06-f91c4268842b`::ref 1 aborting False >Thread-53317::INFO::2014-05-16 17:10:07,263::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53317::DEBUG::2014-05-16 17:10:07,263::task::1168::TaskManager.Task::(prepare) Task=`67072098-78bc-420c-ae06-f91c4268842b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53317::DEBUG::2014-05-16 17:10:07,263::task::579::TaskManager.Task::(_updateState) Task=`67072098-78bc-420c-ae06-f91c4268842b`::moving from state preparing -> state finished >Thread-53317::DEBUG::2014-05-16 17:10:07,263::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53317::DEBUG::2014-05-16 17:10:07,263::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53317::DEBUG::2014-05-16 17:10:07,263::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53317::DEBUG::2014-05-16 17:10:07,264::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53317::DEBUG::2014-05-16 17:10:07,264::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53317::DEBUG::2014-05-16 17:10:07,264::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53317::DEBUG::2014-05-16 17:10:07,264::task::974::TaskManager.Task::(_decref) Task=`67072098-78bc-420c-ae06-f91c4268842b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:10:08,361::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:08,432::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349795 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:10,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:10,511::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305662 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:12,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:12,590::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312473 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:10:13,537::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:10:13,547::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000830665 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:14,601::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:14,672::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034538 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:16,684::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:16,750::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304022 s, 33.7 MB/s\n'; <rc> = 0 >Thread-53321::DEBUG::2014-05-16 17:10:17,315::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53321::DEBUG::2014-05-16 17:10:17,315::task::579::TaskManager.Task::(_updateState) Task=`8a539dc9-f6db-490b-9540-092ff379e322`::moving from state init -> state preparing >Thread-53321::INFO::2014-05-16 17:10:17,315::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53321::INFO::2014-05-16 17:10:17,316::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53321::DEBUG::2014-05-16 17:10:17,316::task::1168::TaskManager.Task::(prepare) Task=`8a539dc9-f6db-490b-9540-092ff379e322`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53321::DEBUG::2014-05-16 17:10:17,316::task::579::TaskManager.Task::(_updateState) Task=`8a539dc9-f6db-490b-9540-092ff379e322`::moving from state preparing -> state finished >Thread-53321::DEBUG::2014-05-16 17:10:17,316::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53321::DEBUG::2014-05-16 17:10:17,316::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53321::DEBUG::2014-05-16 17:10:17,317::task::974::TaskManager.Task::(_decref) Task=`8a539dc9-f6db-490b-9540-092ff379e322`::ref 0 aborting False >Thread-53322::DEBUG::2014-05-16 17:10:17,367::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53322::DEBUG::2014-05-16 17:10:17,367::task::579::TaskManager.Task::(_updateState) Task=`2212d6a7-b250-424a-a1d0-73ec66cd11a3`::moving from state init -> state preparing >Thread-53322::INFO::2014-05-16 17:10:17,367::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53322::DEBUG::2014-05-16 17:10:17,368::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`276d3ccd-b5c3-4c60-9567-278c737aaf4d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53322::DEBUG::2014-05-16 17:10:17,368::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53322::DEBUG::2014-05-16 17:10:17,369::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53322::DEBUG::2014-05-16 17:10:17,369::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`276d3ccd-b5c3-4c60-9567-278c737aaf4d`::Granted request >Thread-53322::DEBUG::2014-05-16 17:10:17,369::task::811::TaskManager.Task::(resourceAcquired) Task=`2212d6a7-b250-424a-a1d0-73ec66cd11a3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53322::DEBUG::2014-05-16 17:10:17,369::task::974::TaskManager.Task::(_decref) Task=`2212d6a7-b250-424a-a1d0-73ec66cd11a3`::ref 1 aborting False >Thread-53322::INFO::2014-05-16 17:10:17,370::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53322::DEBUG::2014-05-16 17:10:17,370::task::1168::TaskManager.Task::(prepare) Task=`2212d6a7-b250-424a-a1d0-73ec66cd11a3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53322::DEBUG::2014-05-16 17:10:17,370::task::579::TaskManager.Task::(_updateState) Task=`2212d6a7-b250-424a-a1d0-73ec66cd11a3`::moving from state preparing -> state finished >Thread-53322::DEBUG::2014-05-16 17:10:17,371::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53322::DEBUG::2014-05-16 17:10:17,371::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53322::DEBUG::2014-05-16 17:10:17,371::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53322::DEBUG::2014-05-16 17:10:17,371::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53322::DEBUG::2014-05-16 17:10:17,371::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53322::DEBUG::2014-05-16 17:10:17,371::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53322::DEBUG::2014-05-16 17:10:17,372::task::974::TaskManager.Task::(_decref) Task=`2212d6a7-b250-424a-a1d0-73ec66cd11a3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:10:18,762::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:18,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353974 s, 28.9 MB/s\n'; <rc> = 0 >Thread-53323::DEBUG::2014-05-16 17:10:19,030::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5414934.000000 / 8.008301 / 262500000.000000 = 0.257587 >Thread-53323::DEBUG::2014-05-16 17:10:19,030::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0064018334722801447, 'statsAge': 1.419748067855835, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25758672094538343, 'rxDropped': 0} >Thread-53323::DEBUG::2014-05-16 17:10:19,031::task::579::TaskManager.Task::(_updateState) Task=`603fecfc-e015-41fe-92fb-ba37eeebce71`::moving from state init -> state preparing >Thread-53323::INFO::2014-05-16 17:10:19,031::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53323::INFO::2014-05-16 17:10:19,031::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830665', 'lastCheck': '5.5', 'valid': True}} >Thread-53323::DEBUG::2014-05-16 17:10:19,031::task::1168::TaskManager.Task::(prepare) Task=`603fecfc-e015-41fe-92fb-ba37eeebce71`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830665', 'lastCheck': '5.5', 'valid': True}} >Thread-53323::DEBUG::2014-05-16 17:10:19,031::task::579::TaskManager.Task::(_updateState) Task=`603fecfc-e015-41fe-92fb-ba37eeebce71`::moving from state preparing -> state finished >Thread-53323::DEBUG::2014-05-16 17:10:19,031::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53323::DEBUG::2014-05-16 17:10:19,032::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53323::DEBUG::2014-05-16 17:10:19,032::task::974::TaskManager.Task::(_decref) Task=`603fecfc-e015-41fe-92fb-ba37eeebce71`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:10:20,844::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:20,915::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345301 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:22,926::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:22,994::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312432 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:10:23,585::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:10:23,595::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759417 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:25,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:25,073::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312232 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:27,084::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:27,151::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031077 s, 33.0 MB/s\n'; <rc> = 0 >Thread-53327::DEBUG::2014-05-16 17:10:27,427::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53327::DEBUG::2014-05-16 17:10:27,428::task::579::TaskManager.Task::(_updateState) Task=`1b9efe2f-518b-4c51-a133-8706f273a58a`::moving from state init -> state preparing >Thread-53327::INFO::2014-05-16 17:10:27,428::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53327::INFO::2014-05-16 17:10:27,428::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53327::DEBUG::2014-05-16 17:10:27,429::task::1168::TaskManager.Task::(prepare) Task=`1b9efe2f-518b-4c51-a133-8706f273a58a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53327::DEBUG::2014-05-16 17:10:27,429::task::579::TaskManager.Task::(_updateState) Task=`1b9efe2f-518b-4c51-a133-8706f273a58a`::moving from state preparing -> state finished >Thread-53327::DEBUG::2014-05-16 17:10:27,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53327::DEBUG::2014-05-16 17:10:27,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53327::DEBUG::2014-05-16 17:10:27,429::task::974::TaskManager.Task::(_decref) Task=`1b9efe2f-518b-4c51-a133-8706f273a58a`::ref 0 aborting False >Thread-53328::DEBUG::2014-05-16 17:10:27,443::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53328::DEBUG::2014-05-16 17:10:27,444::task::579::TaskManager.Task::(_updateState) Task=`2e53821a-3f50-4723-acc3-4788bb68153c`::moving from state init -> state preparing >Thread-53328::INFO::2014-05-16 17:10:27,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53328::DEBUG::2014-05-16 17:10:27,444::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2c65f3b3-b123-44c5-b25f-6c59b08e6b15`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53328::DEBUG::2014-05-16 17:10:27,444::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53328::DEBUG::2014-05-16 17:10:27,445::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53328::DEBUG::2014-05-16 17:10:27,445::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2c65f3b3-b123-44c5-b25f-6c59b08e6b15`::Granted request >Thread-53328::DEBUG::2014-05-16 17:10:27,445::task::811::TaskManager.Task::(resourceAcquired) Task=`2e53821a-3f50-4723-acc3-4788bb68153c`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53328::DEBUG::2014-05-16 17:10:27,445::task::974::TaskManager.Task::(_decref) Task=`2e53821a-3f50-4723-acc3-4788bb68153c`::ref 1 aborting False >Thread-53328::INFO::2014-05-16 17:10:27,446::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53328::DEBUG::2014-05-16 17:10:27,446::task::1168::TaskManager.Task::(prepare) Task=`2e53821a-3f50-4723-acc3-4788bb68153c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53328::DEBUG::2014-05-16 17:10:27,446::task::579::TaskManager.Task::(_updateState) Task=`2e53821a-3f50-4723-acc3-4788bb68153c`::moving from state preparing -> state finished >Thread-53328::DEBUG::2014-05-16 17:10:27,447::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53328::DEBUG::2014-05-16 17:10:27,447::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53328::DEBUG::2014-05-16 17:10:27,447::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53328::DEBUG::2014-05-16 17:10:27,447::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53328::DEBUG::2014-05-16 17:10:27,447::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53328::DEBUG::2014-05-16 17:10:27,447::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53328::DEBUG::2014-05-16 17:10:27,448::task::974::TaskManager.Task::(_decref) Task=`2e53821a-3f50-4723-acc3-4788bb68153c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:10:29,163::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:29,235::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349533 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:31,246::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:31,313::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305067 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:33,324::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:33,391::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311216 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:10:33,636::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:10:33,647::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000844678 s, 4.8 MB/s\n'; <rc> = 0 >Thread-53331::DEBUG::2014-05-16 17:10:34,278::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316811.000000 / 8.008490 / 262500000.000000 = 0.205345 >Thread-53331::DEBUG::2014-05-16 17:10:34,278::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053828588120593251, 'statsAge': 0.65067887306213379, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20534450451877545, 'rxDropped': 0} >Thread-53331::DEBUG::2014-05-16 17:10:34,278::task::579::TaskManager.Task::(_updateState) Task=`c474eb32-8c14-4890-a669-f57b797c2247`::moving from state init -> state preparing >Thread-53331::INFO::2014-05-16 17:10:34,279::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53331::INFO::2014-05-16 17:10:34,279::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000844678', 'lastCheck': '0.6', 'valid': True}} >Thread-53331::DEBUG::2014-05-16 17:10:34,279::task::1168::TaskManager.Task::(prepare) Task=`c474eb32-8c14-4890-a669-f57b797c2247`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000844678', 'lastCheck': '0.6', 'valid': True}} >Thread-53331::DEBUG::2014-05-16 17:10:34,279::task::579::TaskManager.Task::(_updateState) Task=`c474eb32-8c14-4890-a669-f57b797c2247`::moving from state preparing -> state finished >Thread-53331::DEBUG::2014-05-16 17:10:34,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53331::DEBUG::2014-05-16 17:10:34,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53331::DEBUG::2014-05-16 17:10:34,280::task::974::TaskManager.Task::(_decref) Task=`c474eb32-8c14-4890-a669-f57b797c2247`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:10:35,402::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:35,472::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341877 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:37,484::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-53334::DEBUG::2014-05-16 17:10:37,514::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53334::DEBUG::2014-05-16 17:10:37,515::task::579::TaskManager.Task::(_updateState) Task=`245eb926-0dec-41bd-934d-5721998c003f`::moving from state init -> state preparing >Thread-53334::INFO::2014-05-16 17:10:37,515::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53334::INFO::2014-05-16 17:10:37,515::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53334::DEBUG::2014-05-16 17:10:37,516::task::1168::TaskManager.Task::(prepare) Task=`245eb926-0dec-41bd-934d-5721998c003f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53334::DEBUG::2014-05-16 17:10:37,516::task::579::TaskManager.Task::(_updateState) Task=`245eb926-0dec-41bd-934d-5721998c003f`::moving from state preparing -> state finished >Thread-53334::DEBUG::2014-05-16 17:10:37,516::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53334::DEBUG::2014-05-16 17:10:37,516::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53334::DEBUG::2014-05-16 17:10:37,516::task::974::TaskManager.Task::(_decref) Task=`245eb926-0dec-41bd-934d-5721998c003f`::ref 0 aborting False >Thread-53335::DEBUG::2014-05-16 17:10:37,525::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53335::DEBUG::2014-05-16 17:10:37,526::task::579::TaskManager.Task::(_updateState) Task=`bdd2a30a-7b75-4b65-9df5-56c654c66866`::moving from state init -> state preparing >Thread-53335::INFO::2014-05-16 17:10:37,526::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53335::DEBUG::2014-05-16 17:10:37,526::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`337b14af-c6d5-46d9-8dc4-ceee33ba9d65`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53335::DEBUG::2014-05-16 17:10:37,526::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53335::DEBUG::2014-05-16 17:10:37,527::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53335::DEBUG::2014-05-16 17:10:37,527::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`337b14af-c6d5-46d9-8dc4-ceee33ba9d65`::Granted request >Thread-53335::DEBUG::2014-05-16 17:10:37,527::task::811::TaskManager.Task::(resourceAcquired) Task=`bdd2a30a-7b75-4b65-9df5-56c654c66866`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53335::DEBUG::2014-05-16 17:10:37,528::task::974::TaskManager.Task::(_decref) Task=`bdd2a30a-7b75-4b65-9df5-56c654c66866`::ref 1 aborting False >Thread-53335::INFO::2014-05-16 17:10:37,528::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53335::DEBUG::2014-05-16 17:10:37,529::task::1168::TaskManager.Task::(prepare) Task=`bdd2a30a-7b75-4b65-9df5-56c654c66866`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53335::DEBUG::2014-05-16 17:10:37,529::task::579::TaskManager.Task::(_updateState) Task=`bdd2a30a-7b75-4b65-9df5-56c654c66866`::moving from state preparing -> state finished >Thread-53335::DEBUG::2014-05-16 17:10:37,529::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53335::DEBUG::2014-05-16 17:10:37,529::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53335::DEBUG::2014-05-16 17:10:37,530::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53335::DEBUG::2014-05-16 17:10:37,530::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53335::DEBUG::2014-05-16 17:10:37,530::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53335::DEBUG::2014-05-16 17:10:37,530::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53335::DEBUG::2014-05-16 17:10:37,531::task::974::TaskManager.Task::(_decref) Task=`bdd2a30a-7b75-4b65-9df5-56c654c66866`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:10:37,563::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041417 s, 24.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:39,575::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:39,646::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309821 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:41,657::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:41,729::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350399 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:10:43,681::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:10:43,691::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103118 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:43,746::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:43,821::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367358 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:45,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:45,900::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307817 s, 33.3 MB/s\n'; <rc> = 0 >Thread-53339::DEBUG::2014-05-16 17:10:47,576::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53339::DEBUG::2014-05-16 17:10:47,576::task::579::TaskManager.Task::(_updateState) Task=`72d777a1-5051-4958-8faf-b21e5e1ccf6b`::moving from state init -> state preparing >Thread-53339::INFO::2014-05-16 17:10:47,576::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53339::INFO::2014-05-16 17:10:47,577::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53339::DEBUG::2014-05-16 17:10:47,577::task::1168::TaskManager.Task::(prepare) Task=`72d777a1-5051-4958-8faf-b21e5e1ccf6b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53339::DEBUG::2014-05-16 17:10:47,577::task::579::TaskManager.Task::(_updateState) Task=`72d777a1-5051-4958-8faf-b21e5e1ccf6b`::moving from state preparing -> state finished >Thread-53339::DEBUG::2014-05-16 17:10:47,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53339::DEBUG::2014-05-16 17:10:47,577::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53339::DEBUG::2014-05-16 17:10:47,577::task::974::TaskManager.Task::(_decref) Task=`72d777a1-5051-4958-8faf-b21e5e1ccf6b`::ref 0 aborting False >Thread-53340::DEBUG::2014-05-16 17:10:47,597::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53340::DEBUG::2014-05-16 17:10:47,597::task::579::TaskManager.Task::(_updateState) Task=`d881fcd1-c46a-4614-bea2-799fb101a741`::moving from state init -> state preparing >Thread-53340::INFO::2014-05-16 17:10:47,597::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53340::DEBUG::2014-05-16 17:10:47,598::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`aac75d26-d50a-4d00-b2f6-031075e7bd3a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53340::DEBUG::2014-05-16 17:10:47,598::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53340::DEBUG::2014-05-16 17:10:47,598::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53340::DEBUG::2014-05-16 17:10:47,598::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`aac75d26-d50a-4d00-b2f6-031075e7bd3a`::Granted request >Thread-53340::DEBUG::2014-05-16 17:10:47,598::task::811::TaskManager.Task::(resourceAcquired) Task=`d881fcd1-c46a-4614-bea2-799fb101a741`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53340::DEBUG::2014-05-16 17:10:47,599::task::974::TaskManager.Task::(_decref) Task=`d881fcd1-c46a-4614-bea2-799fb101a741`::ref 1 aborting False >Thread-53340::INFO::2014-05-16 17:10:47,599::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53340::DEBUG::2014-05-16 17:10:47,599::task::1168::TaskManager.Task::(prepare) Task=`d881fcd1-c46a-4614-bea2-799fb101a741`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53340::DEBUG::2014-05-16 17:10:47,600::task::579::TaskManager.Task::(_updateState) Task=`d881fcd1-c46a-4614-bea2-799fb101a741`::moving from state preparing -> state finished >Thread-53340::DEBUG::2014-05-16 17:10:47,600::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53340::DEBUG::2014-05-16 17:10:47,600::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53340::DEBUG::2014-05-16 17:10:47,600::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53340::DEBUG::2014-05-16 17:10:47,600::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53340::DEBUG::2014-05-16 17:10:47,600::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53340::DEBUG::2014-05-16 17:10:47,601::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53340::DEBUG::2014-05-16 17:10:47,601::task::974::TaskManager.Task::(_decref) Task=`d881fcd1-c46a-4614-bea2-799fb101a741`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:10:47,912::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:47,983::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352843 s, 29.0 MB/s\n'; <rc> = 0 >Thread-53341::DEBUG::2014-05-16 17:10:49,521::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315162.000000 / 8.010864 / 262500000.000000 = 0.205205 >Thread-53341::DEBUG::2014-05-16 17:10:49,522::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051225673506433032, 'statsAge': 1.8738870620727539, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20520523555455492, 'rxDropped': 0} >Thread-53341::DEBUG::2014-05-16 17:10:49,522::task::579::TaskManager.Task::(_updateState) Task=`ddad42f6-4850-4dd0-9f43-cb9f1b363919`::moving from state init -> state preparing >Thread-53341::INFO::2014-05-16 17:10:49,522::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53341::INFO::2014-05-16 17:10:49,523::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103118', 'lastCheck': '5.8', 'valid': True}} >Thread-53341::DEBUG::2014-05-16 17:10:49,523::task::1168::TaskManager.Task::(prepare) Task=`ddad42f6-4850-4dd0-9f43-cb9f1b363919`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103118', 'lastCheck': '5.8', 'valid': True}} >Thread-53341::DEBUG::2014-05-16 17:10:49,523::task::579::TaskManager.Task::(_updateState) Task=`ddad42f6-4850-4dd0-9f43-cb9f1b363919`::moving from state preparing -> state finished >Thread-53341::DEBUG::2014-05-16 17:10:49,523::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53341::DEBUG::2014-05-16 17:10:49,523::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53341::DEBUG::2014-05-16 17:10:49,523::task::974::TaskManager.Task::(_decref) Task=`ddad42f6-4850-4dd0-9f43-cb9f1b363919`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:10:49,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:50,067::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355959 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:52,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:52,147::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295035 s, 34.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:10:53,728::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:10:53,739::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111298 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:54,159::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:54,226::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313176 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:10:56,238::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:56,310::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357478 s, 28.6 MB/s\n'; <rc> = 0 >Thread-53345::DEBUG::2014-05-16 17:10:57,765::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53345::DEBUG::2014-05-16 17:10:57,765::task::579::TaskManager.Task::(_updateState) Task=`f322d30e-6a40-49b2-bdbb-04fe138b5387`::moving from state init -> state preparing >Thread-53345::INFO::2014-05-16 17:10:57,766::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53345::INFO::2014-05-16 17:10:57,766::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53345::DEBUG::2014-05-16 17:10:57,766::task::1168::TaskManager.Task::(prepare) Task=`f322d30e-6a40-49b2-bdbb-04fe138b5387`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53345::DEBUG::2014-05-16 17:10:57,766::task::579::TaskManager.Task::(_updateState) Task=`f322d30e-6a40-49b2-bdbb-04fe138b5387`::moving from state preparing -> state finished >Thread-53345::DEBUG::2014-05-16 17:10:57,766::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53345::DEBUG::2014-05-16 17:10:57,766::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53345::DEBUG::2014-05-16 17:10:57,767::task::974::TaskManager.Task::(_decref) Task=`f322d30e-6a40-49b2-bdbb-04fe138b5387`::ref 0 aborting False >Thread-53346::DEBUG::2014-05-16 17:10:57,786::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53346::DEBUG::2014-05-16 17:10:57,786::task::579::TaskManager.Task::(_updateState) Task=`5a9c6126-6199-42a7-9fcf-dbb918683b20`::moving from state init -> state preparing >Thread-53346::INFO::2014-05-16 17:10:57,787::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53346::DEBUG::2014-05-16 17:10:57,787::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`341926a7-49af-45f0-a6b6-eeeb813b584d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53346::DEBUG::2014-05-16 17:10:57,787::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53346::DEBUG::2014-05-16 17:10:57,787::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53346::DEBUG::2014-05-16 17:10:57,787::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`341926a7-49af-45f0-a6b6-eeeb813b584d`::Granted request >Thread-53346::DEBUG::2014-05-16 17:10:57,788::task::811::TaskManager.Task::(resourceAcquired) Task=`5a9c6126-6199-42a7-9fcf-dbb918683b20`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53346::DEBUG::2014-05-16 17:10:57,788::task::974::TaskManager.Task::(_decref) Task=`5a9c6126-6199-42a7-9fcf-dbb918683b20`::ref 1 aborting False >Thread-53346::INFO::2014-05-16 17:10:57,788::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53346::DEBUG::2014-05-16 17:10:57,788::task::1168::TaskManager.Task::(prepare) Task=`5a9c6126-6199-42a7-9fcf-dbb918683b20`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53346::DEBUG::2014-05-16 17:10:57,789::task::579::TaskManager.Task::(_updateState) Task=`5a9c6126-6199-42a7-9fcf-dbb918683b20`::moving from state preparing -> state finished >Thread-53346::DEBUG::2014-05-16 17:10:57,789::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53346::DEBUG::2014-05-16 17:10:57,789::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53346::DEBUG::2014-05-16 17:10:57,789::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53346::DEBUG::2014-05-16 17:10:57,789::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53346::DEBUG::2014-05-16 17:10:57,789::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53346::DEBUG::2014-05-16 17:10:57,790::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53346::DEBUG::2014-05-16 17:10:57,790::task::974::TaskManager.Task::(_decref) Task=`5a9c6126-6199-42a7-9fcf-dbb918683b20`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:10:58,321::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:10:58,388::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310601 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:00,399::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:00,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310762 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:02,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:02,550::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035568 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:11:03,772::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:11:03,782::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101358 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:04,562::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:04,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347195 s, 29.5 MB/s\n'; <rc> = 0 >Thread-53349::DEBUG::2014-05-16 17:11:04,949::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5415386.000000 / 8.011013 / 262500000.000000 = 0.257521 >Thread-53349::DEBUG::2014-05-16 17:11:04,949::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0068054885108596282, 'statsAge': 1.2822310924530029, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25752101294699309, 'rxDropped': 0} >Thread-53349::DEBUG::2014-05-16 17:11:04,950::task::579::TaskManager.Task::(_updateState) Task=`832a9136-2921-4ce3-afaa-787c7aca6b7b`::moving from state init -> state preparing >Thread-53349::INFO::2014-05-16 17:11:04,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53349::INFO::2014-05-16 17:11:04,950::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101358', 'lastCheck': '1.1', 'valid': True}} >Thread-53349::DEBUG::2014-05-16 17:11:04,950::task::1168::TaskManager.Task::(prepare) Task=`832a9136-2921-4ce3-afaa-787c7aca6b7b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101358', 'lastCheck': '1.1', 'valid': True}} >Thread-53349::DEBUG::2014-05-16 17:11:04,951::task::579::TaskManager.Task::(_updateState) Task=`832a9136-2921-4ce3-afaa-787c7aca6b7b`::moving from state preparing -> state finished >Thread-53349::DEBUG::2014-05-16 17:11:04,951::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53349::DEBUG::2014-05-16 17:11:04,951::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53349::DEBUG::2014-05-16 17:11:04,951::task::974::TaskManager.Task::(_decref) Task=`832a9136-2921-4ce3-afaa-787c7aca6b7b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:11:06,644::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:06,711::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309116 s, 33.1 MB/s\n'; <rc> = 0 >Thread-53351::DEBUG::2014-05-16 17:11:07,850::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53351::DEBUG::2014-05-16 17:11:07,850::task::579::TaskManager.Task::(_updateState) Task=`ed7fa5ec-4b40-4b78-9408-3f5d1569b493`::moving from state init -> state preparing >Thread-53351::INFO::2014-05-16 17:11:07,850::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53351::INFO::2014-05-16 17:11:07,851::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53351::DEBUG::2014-05-16 17:11:07,851::task::1168::TaskManager.Task::(prepare) Task=`ed7fa5ec-4b40-4b78-9408-3f5d1569b493`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53351::DEBUG::2014-05-16 17:11:07,851::task::579::TaskManager.Task::(_updateState) Task=`ed7fa5ec-4b40-4b78-9408-3f5d1569b493`::moving from state preparing -> state finished >Thread-53351::DEBUG::2014-05-16 17:11:07,851::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53351::DEBUG::2014-05-16 17:11:07,851::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53351::DEBUG::2014-05-16 17:11:07,852::task::974::TaskManager.Task::(_decref) Task=`ed7fa5ec-4b40-4b78-9408-3f5d1569b493`::ref 0 aborting False >Thread-53352::DEBUG::2014-05-16 17:11:07,861::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53352::DEBUG::2014-05-16 17:11:07,861::task::579::TaskManager.Task::(_updateState) Task=`76ae047a-4d38-4fae-af47-efeeab826f3e`::moving from state init -> state preparing >Thread-53352::INFO::2014-05-16 17:11:07,862::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53352::DEBUG::2014-05-16 17:11:07,862::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4d4474d4-f79e-496d-ae1c-056c02db1d73`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53352::DEBUG::2014-05-16 17:11:07,863::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53352::DEBUG::2014-05-16 17:11:07,863::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53352::DEBUG::2014-05-16 17:11:07,863::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4d4474d4-f79e-496d-ae1c-056c02db1d73`::Granted request >Thread-53352::DEBUG::2014-05-16 17:11:07,864::task::811::TaskManager.Task::(resourceAcquired) Task=`76ae047a-4d38-4fae-af47-efeeab826f3e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53352::DEBUG::2014-05-16 17:11:07,864::task::974::TaskManager.Task::(_decref) Task=`76ae047a-4d38-4fae-af47-efeeab826f3e`::ref 1 aborting False >Thread-53352::INFO::2014-05-16 17:11:07,865::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53352::DEBUG::2014-05-16 17:11:07,865::task::1168::TaskManager.Task::(prepare) Task=`76ae047a-4d38-4fae-af47-efeeab826f3e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53352::DEBUG::2014-05-16 17:11:07,865::task::579::TaskManager.Task::(_updateState) Task=`76ae047a-4d38-4fae-af47-efeeab826f3e`::moving from state preparing -> state finished >Thread-53352::DEBUG::2014-05-16 17:11:07,865::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53352::DEBUG::2014-05-16 17:11:07,865::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53352::DEBUG::2014-05-16 17:11:07,865::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53352::DEBUG::2014-05-16 17:11:07,866::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53352::DEBUG::2014-05-16 17:11:07,866::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53352::DEBUG::2014-05-16 17:11:07,866::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53352::DEBUG::2014-05-16 17:11:07,866::task::974::TaskManager.Task::(_decref) Task=`76ae047a-4d38-4fae-af47-efeeab826f3e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:11:08,723::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:08,796::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364078 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:10,808::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:10,873::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303327 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:12,885::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:12,952::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314479 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:11:13,803::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 17:11:13,803::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:11:13,821::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:11:13,829::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000794429 s, 2.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:11:13,830::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000794429 s, 2.6 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 17:11:13,830::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 17:11:13,830::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 17:11:13,830::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:11:13,830::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:11:13,831::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:11:13,831::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:11:13,831::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:11:13,831::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:11:13,832::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:11:13,984::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:11:13,986::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:11:13,986::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 17:11:13,987::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 17:11:13,988::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 17:11:13,988::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 17:11:13,988::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:11:14,137::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:11:14,156::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:11:14,166::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000583802 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:14,963::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:15,035::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358493 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:17,047::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:17,118::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354566 s, 28.9 MB/s\n'; <rc> = 0 >Thread-53357::DEBUG::2014-05-16 17:11:17,920::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53357::DEBUG::2014-05-16 17:11:17,921::task::579::TaskManager.Task::(_updateState) Task=`7e78d206-9795-454e-ba7a-f8992bc2e7a8`::moving from state init -> state preparing >Thread-53357::INFO::2014-05-16 17:11:17,921::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53357::INFO::2014-05-16 17:11:17,921::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53357::DEBUG::2014-05-16 17:11:17,922::task::1168::TaskManager.Task::(prepare) Task=`7e78d206-9795-454e-ba7a-f8992bc2e7a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53357::DEBUG::2014-05-16 17:11:17,922::task::579::TaskManager.Task::(_updateState) Task=`7e78d206-9795-454e-ba7a-f8992bc2e7a8`::moving from state preparing -> state finished >Thread-53357::DEBUG::2014-05-16 17:11:17,922::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53357::DEBUG::2014-05-16 17:11:17,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53357::DEBUG::2014-05-16 17:11:17,922::task::974::TaskManager.Task::(_decref) Task=`7e78d206-9795-454e-ba7a-f8992bc2e7a8`::ref 0 aborting False >Thread-53358::DEBUG::2014-05-16 17:11:17,932::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53358::DEBUG::2014-05-16 17:11:17,932::task::579::TaskManager.Task::(_updateState) Task=`e2142d88-9bb0-4be2-9f58-640c0935e3c2`::moving from state init -> state preparing >Thread-53358::INFO::2014-05-16 17:11:17,933::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53358::DEBUG::2014-05-16 17:11:17,933::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b5655c85-476f-4f81-a39f-bdc9f5272c69`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53358::DEBUG::2014-05-16 17:11:17,933::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53358::DEBUG::2014-05-16 17:11:17,933::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53358::DEBUG::2014-05-16 17:11:17,933::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b5655c85-476f-4f81-a39f-bdc9f5272c69`::Granted request >Thread-53358::DEBUG::2014-05-16 17:11:17,934::task::811::TaskManager.Task::(resourceAcquired) Task=`e2142d88-9bb0-4be2-9f58-640c0935e3c2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53358::DEBUG::2014-05-16 17:11:17,934::task::974::TaskManager.Task::(_decref) Task=`e2142d88-9bb0-4be2-9f58-640c0935e3c2`::ref 1 aborting False >Thread-53358::INFO::2014-05-16 17:11:17,935::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53358::DEBUG::2014-05-16 17:11:17,935::task::1168::TaskManager.Task::(prepare) Task=`e2142d88-9bb0-4be2-9f58-640c0935e3c2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53358::DEBUG::2014-05-16 17:11:17,935::task::579::TaskManager.Task::(_updateState) Task=`e2142d88-9bb0-4be2-9f58-640c0935e3c2`::moving from state preparing -> state finished >Thread-53358::DEBUG::2014-05-16 17:11:17,935::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53358::DEBUG::2014-05-16 17:11:17,935::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53358::DEBUG::2014-05-16 17:11:17,936::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53358::DEBUG::2014-05-16 17:11:17,936::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53358::DEBUG::2014-05-16 17:11:17,936::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53358::DEBUG::2014-05-16 17:11:17,936::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53358::DEBUG::2014-05-16 17:11:17,936::task::974::TaskManager.Task::(_decref) Task=`e2142d88-9bb0-4be2-9f58-640c0935e3c2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:11:19,130::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:19,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035708 s, 28.7 MB/s\n'; <rc> = 0 >Thread-53359::DEBUG::2014-05-16 17:11:20,158::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5537018.000000 / 8.008494 / 262500000.000000 = 0.263388 >Thread-53359::DEBUG::2014-05-16 17:11:20,158::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0071277653049274681, 'statsAge': 0.47419595718383789, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.26338786717448304, 'rxDropped': 0} >Thread-53359::DEBUG::2014-05-16 17:11:20,158::task::579::TaskManager.Task::(_updateState) Task=`340adca0-b533-42ea-9759-fcb3c4061156`::moving from state init -> state preparing >Thread-53359::INFO::2014-05-16 17:11:20,159::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53359::INFO::2014-05-16 17:11:20,159::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583802', 'lastCheck': '6.0', 'valid': True}} >Thread-53359::DEBUG::2014-05-16 17:11:20,159::task::1168::TaskManager.Task::(prepare) Task=`340adca0-b533-42ea-9759-fcb3c4061156`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583802', 'lastCheck': '6.0', 'valid': True}} >Thread-53359::DEBUG::2014-05-16 17:11:20,159::task::579::TaskManager.Task::(_updateState) Task=`340adca0-b533-42ea-9759-fcb3c4061156`::moving from state preparing -> state finished >Thread-53359::DEBUG::2014-05-16 17:11:20,159::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53359::DEBUG::2014-05-16 17:11:20,159::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53359::DEBUG::2014-05-16 17:11:20,160::task::974::TaskManager.Task::(_decref) Task=`340adca0-b533-42ea-9759-fcb3c4061156`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:11:21,212::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:21,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305867 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:23,290::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:23,362::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354421 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:11:24,199::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:11:24,209::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00077754 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:25,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:25,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347953 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:27,455::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:27,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317823 s, 32.2 MB/s\n'; <rc> = 0 >Thread-53363::DEBUG::2014-05-16 17:11:27,998::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53363::DEBUG::2014-05-16 17:11:27,998::task::579::TaskManager.Task::(_updateState) Task=`87dd2df4-db11-4ebd-a130-ef7c82bfa0f4`::moving from state init -> state preparing >Thread-53363::INFO::2014-05-16 17:11:27,998::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53363::INFO::2014-05-16 17:11:27,999::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53363::DEBUG::2014-05-16 17:11:27,999::task::1168::TaskManager.Task::(prepare) Task=`87dd2df4-db11-4ebd-a130-ef7c82bfa0f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53363::DEBUG::2014-05-16 17:11:27,999::task::579::TaskManager.Task::(_updateState) Task=`87dd2df4-db11-4ebd-a130-ef7c82bfa0f4`::moving from state preparing -> state finished >Thread-53363::DEBUG::2014-05-16 17:11:27,999::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53363::DEBUG::2014-05-16 17:11:27,999::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53363::DEBUG::2014-05-16 17:11:28,000::task::974::TaskManager.Task::(_decref) Task=`87dd2df4-db11-4ebd-a130-ef7c82bfa0f4`::ref 0 aborting False >Thread-53364::DEBUG::2014-05-16 17:11:28,054::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53364::DEBUG::2014-05-16 17:11:28,054::task::579::TaskManager.Task::(_updateState) Task=`5fde8697-7b4e-4179-8f92-06ff006c2ae2`::moving from state init -> state preparing >Thread-53364::INFO::2014-05-16 17:11:28,055::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53364::DEBUG::2014-05-16 17:11:28,055::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1bbf2ece-89cf-4427-ae78-8feaf8da1aac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53364::DEBUG::2014-05-16 17:11:28,055::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53364::DEBUG::2014-05-16 17:11:28,055::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53364::DEBUG::2014-05-16 17:11:28,056::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1bbf2ece-89cf-4427-ae78-8feaf8da1aac`::Granted request >Thread-53364::DEBUG::2014-05-16 17:11:28,056::task::811::TaskManager.Task::(resourceAcquired) Task=`5fde8697-7b4e-4179-8f92-06ff006c2ae2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53364::DEBUG::2014-05-16 17:11:28,056::task::974::TaskManager.Task::(_decref) Task=`5fde8697-7b4e-4179-8f92-06ff006c2ae2`::ref 1 aborting False >Thread-53364::INFO::2014-05-16 17:11:28,057::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53364::DEBUG::2014-05-16 17:11:28,057::task::1168::TaskManager.Task::(prepare) Task=`5fde8697-7b4e-4179-8f92-06ff006c2ae2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53364::DEBUG::2014-05-16 17:11:28,057::task::579::TaskManager.Task::(_updateState) Task=`5fde8697-7b4e-4179-8f92-06ff006c2ae2`::moving from state preparing -> state finished >Thread-53364::DEBUG::2014-05-16 17:11:28,057::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53364::DEBUG::2014-05-16 17:11:28,057::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53364::DEBUG::2014-05-16 17:11:28,058::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53364::DEBUG::2014-05-16 17:11:28,058::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53364::DEBUG::2014-05-16 17:11:28,058::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53364::DEBUG::2014-05-16 17:11:28,058::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53364::DEBUG::2014-05-16 17:11:28,058::task::974::TaskManager.Task::(_decref) Task=`5fde8697-7b4e-4179-8f92-06ff006c2ae2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:11:29,534::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:29,605::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353679 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:31,617::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:31,683::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302366 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:33,696::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:33,764::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311876 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:11:34,246::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:11:34,256::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713649 s, 5.7 MB/s\n'; <rc> = 0 >Thread-53367::DEBUG::2014-05-16 17:11:35,409::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314966.000000 / 8.012665 / 262500000.000000 = 0.205150 >Thread-53367::DEBUG::2014-05-16 17:11:35,410::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053770113060908542, 'statsAge': 1.7067978382110596, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20514979280785908, 'rxDropped': 0} >Thread-53367::DEBUG::2014-05-16 17:11:35,410::task::579::TaskManager.Task::(_updateState) Task=`63ae8260-7096-4f22-8fc3-ec0759368de2`::moving from state init -> state preparing >Thread-53367::INFO::2014-05-16 17:11:35,410::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53367::INFO::2014-05-16 17:11:35,410::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713649', 'lastCheck': '1.1', 'valid': True}} >Thread-53367::DEBUG::2014-05-16 17:11:35,411::task::1168::TaskManager.Task::(prepare) Task=`63ae8260-7096-4f22-8fc3-ec0759368de2`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713649', 'lastCheck': '1.1', 'valid': True}} >Thread-53367::DEBUG::2014-05-16 17:11:35,411::task::579::TaskManager.Task::(_updateState) Task=`63ae8260-7096-4f22-8fc3-ec0759368de2`::moving from state preparing -> state finished >Thread-53367::DEBUG::2014-05-16 17:11:35,411::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53367::DEBUG::2014-05-16 17:11:35,411::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53367::DEBUG::2014-05-16 17:11:35,411::task::974::TaskManager.Task::(_decref) Task=`63ae8260-7096-4f22-8fc3-ec0759368de2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:11:35,776::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:35,846::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347018 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:37,858::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:37,925::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305045 s, 33.6 MB/s\n'; <rc> = 0 >Thread-53369::DEBUG::2014-05-16 17:11:38,096::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53369::DEBUG::2014-05-16 17:11:38,096::task::579::TaskManager.Task::(_updateState) Task=`b4c871ca-5605-44df-8a51-f5df257fe0ee`::moving from state init -> state preparing >Thread-53369::INFO::2014-05-16 17:11:38,096::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53369::INFO::2014-05-16 17:11:38,097::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53369::DEBUG::2014-05-16 17:11:38,097::task::1168::TaskManager.Task::(prepare) Task=`b4c871ca-5605-44df-8a51-f5df257fe0ee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53369::DEBUG::2014-05-16 17:11:38,097::task::579::TaskManager.Task::(_updateState) Task=`b4c871ca-5605-44df-8a51-f5df257fe0ee`::moving from state preparing -> state finished >Thread-53369::DEBUG::2014-05-16 17:11:38,097::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53369::DEBUG::2014-05-16 17:11:38,097::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53369::DEBUG::2014-05-16 17:11:38,098::task::974::TaskManager.Task::(_decref) Task=`b4c871ca-5605-44df-8a51-f5df257fe0ee`::ref 0 aborting False >Thread-53370::DEBUG::2014-05-16 17:11:38,107::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53370::DEBUG::2014-05-16 17:11:38,107::task::579::TaskManager.Task::(_updateState) Task=`a55b261a-bdc2-4a7b-b990-3e8484abb2e1`::moving from state init -> state preparing >Thread-53370::INFO::2014-05-16 17:11:38,107::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53370::DEBUG::2014-05-16 17:11:38,107::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b7ab57d4-745d-449a-811d-6412e025ea0b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53370::DEBUG::2014-05-16 17:11:38,108::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53370::DEBUG::2014-05-16 17:11:38,108::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53370::DEBUG::2014-05-16 17:11:38,108::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b7ab57d4-745d-449a-811d-6412e025ea0b`::Granted request >Thread-53370::DEBUG::2014-05-16 17:11:38,108::task::811::TaskManager.Task::(resourceAcquired) Task=`a55b261a-bdc2-4a7b-b990-3e8484abb2e1`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53370::DEBUG::2014-05-16 17:11:38,108::task::974::TaskManager.Task::(_decref) Task=`a55b261a-bdc2-4a7b-b990-3e8484abb2e1`::ref 1 aborting False >Thread-53370::INFO::2014-05-16 17:11:38,109::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53370::DEBUG::2014-05-16 17:11:38,109::task::1168::TaskManager.Task::(prepare) Task=`a55b261a-bdc2-4a7b-b990-3e8484abb2e1`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53370::DEBUG::2014-05-16 17:11:38,110::task::579::TaskManager.Task::(_updateState) Task=`a55b261a-bdc2-4a7b-b990-3e8484abb2e1`::moving from state preparing -> state finished >Thread-53370::DEBUG::2014-05-16 17:11:38,110::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53370::DEBUG::2014-05-16 17:11:38,110::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53370::DEBUG::2014-05-16 17:11:38,110::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53370::DEBUG::2014-05-16 17:11:38,110::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53370::DEBUG::2014-05-16 17:11:38,110::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53370::DEBUG::2014-05-16 17:11:38,111::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53370::DEBUG::2014-05-16 17:11:38,111::task::974::TaskManager.Task::(_decref) Task=`a55b261a-bdc2-4a7b-b990-3e8484abb2e1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:11:39,937::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:40,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030917 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:42,015::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:42,087::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358822 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:44,099::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:44,170::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351333 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:11:44,294::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:11:44,304::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659008 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:46,182::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:46,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302579 s, 33.8 MB/s\n'; <rc> = 0 >Thread-53375::DEBUG::2014-05-16 17:11:48,165::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53375::DEBUG::2014-05-16 17:11:48,166::task::579::TaskManager.Task::(_updateState) Task=`f06d6a08-4eb6-40ac-93c8-13d31505da99`::moving from state init -> state preparing >Thread-53375::INFO::2014-05-16 17:11:48,166::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53375::INFO::2014-05-16 17:11:48,166::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53375::DEBUG::2014-05-16 17:11:48,167::task::1168::TaskManager.Task::(prepare) Task=`f06d6a08-4eb6-40ac-93c8-13d31505da99`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53375::DEBUG::2014-05-16 17:11:48,167::task::579::TaskManager.Task::(_updateState) Task=`f06d6a08-4eb6-40ac-93c8-13d31505da99`::moving from state preparing -> state finished >Thread-53375::DEBUG::2014-05-16 17:11:48,167::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53375::DEBUG::2014-05-16 17:11:48,167::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53375::DEBUG::2014-05-16 17:11:48,167::task::974::TaskManager.Task::(_decref) Task=`f06d6a08-4eb6-40ac-93c8-13d31505da99`::ref 0 aborting False >Thread-53376::DEBUG::2014-05-16 17:11:48,176::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53376::DEBUG::2014-05-16 17:11:48,177::task::579::TaskManager.Task::(_updateState) Task=`d86fe944-8e41-4328-9b83-248ad3b8dc9e`::moving from state init -> state preparing >Thread-53376::INFO::2014-05-16 17:11:48,177::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53376::DEBUG::2014-05-16 17:11:48,177::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e0ebe20c-d2f2-4570-9484-b556e0710cf0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53376::DEBUG::2014-05-16 17:11:48,177::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53376::DEBUG::2014-05-16 17:11:48,178::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53376::DEBUG::2014-05-16 17:11:48,178::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e0ebe20c-d2f2-4570-9484-b556e0710cf0`::Granted request >Thread-53376::DEBUG::2014-05-16 17:11:48,178::task::811::TaskManager.Task::(resourceAcquired) Task=`d86fe944-8e41-4328-9b83-248ad3b8dc9e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53376::DEBUG::2014-05-16 17:11:48,178::task::974::TaskManager.Task::(_decref) Task=`d86fe944-8e41-4328-9b83-248ad3b8dc9e`::ref 1 aborting False >Thread-53376::INFO::2014-05-16 17:11:48,179::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53376::DEBUG::2014-05-16 17:11:48,179::task::1168::TaskManager.Task::(prepare) Task=`d86fe944-8e41-4328-9b83-248ad3b8dc9e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53376::DEBUG::2014-05-16 17:11:48,179::task::579::TaskManager.Task::(_updateState) Task=`d86fe944-8e41-4328-9b83-248ad3b8dc9e`::moving from state preparing -> state finished >Thread-53376::DEBUG::2014-05-16 17:11:48,179::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53376::DEBUG::2014-05-16 17:11:48,179::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53376::DEBUG::2014-05-16 17:11:48,180::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53376::DEBUG::2014-05-16 17:11:48,180::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53376::DEBUG::2014-05-16 17:11:48,180::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53376::DEBUG::2014-05-16 17:11:48,180::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53376::DEBUG::2014-05-16 17:11:48,180::task::974::TaskManager.Task::(_decref) Task=`d86fe944-8e41-4328-9b83-248ad3b8dc9e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:11:48,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:48,327::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312878 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:50,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:50,409::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349951 s, 29.3 MB/s\n'; <rc> = 0 >Thread-53377::DEBUG::2014-05-16 17:11:50,627::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316845.000000 / 8.008237 / 262500000.000000 = 0.205353 >Thread-53377::DEBUG::2014-05-16 17:11:50,628::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053710411873805538, 'statsAge': 0.90784096717834473, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20535260826989943, 'rxDropped': 0} >Thread-53377::DEBUG::2014-05-16 17:11:50,628::task::579::TaskManager.Task::(_updateState) Task=`dd256f61-efe3-44d9-9946-0c42625ed7fa`::moving from state init -> state preparing >Thread-53377::INFO::2014-05-16 17:11:50,628::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53377::INFO::2014-05-16 17:11:50,629::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659008', 'lastCheck': '6.3', 'valid': True}} >Thread-53377::DEBUG::2014-05-16 17:11:50,629::task::1168::TaskManager.Task::(prepare) Task=`dd256f61-efe3-44d9-9946-0c42625ed7fa`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659008', 'lastCheck': '6.3', 'valid': True}} >Thread-53377::DEBUG::2014-05-16 17:11:50,629::task::579::TaskManager.Task::(_updateState) Task=`dd256f61-efe3-44d9-9946-0c42625ed7fa`::moving from state preparing -> state finished >Thread-53377::DEBUG::2014-05-16 17:11:50,629::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53377::DEBUG::2014-05-16 17:11:50,629::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53377::DEBUG::2014-05-16 17:11:50,629::task::974::TaskManager.Task::(_decref) Task=`dd256f61-efe3-44d9-9946-0c42625ed7fa`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:11:52,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:52,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309013 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:11:54,339::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:11:54,349::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105503 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:54,499::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:54,569::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348413 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:11:56,581::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:56,651::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348509 s, 29.4 MB/s\n'; <rc> = 0 >Thread-53381::DEBUG::2014-05-16 17:11:58,256::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53381::DEBUG::2014-05-16 17:11:58,257::task::579::TaskManager.Task::(_updateState) Task=`15c0c458-c116-465d-8e19-3a4812b3155f`::moving from state init -> state preparing >Thread-53381::INFO::2014-05-16 17:11:58,257::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53381::INFO::2014-05-16 17:11:58,258::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53381::DEBUG::2014-05-16 17:11:58,258::task::1168::TaskManager.Task::(prepare) Task=`15c0c458-c116-465d-8e19-3a4812b3155f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53381::DEBUG::2014-05-16 17:11:58,258::task::579::TaskManager.Task::(_updateState) Task=`15c0c458-c116-465d-8e19-3a4812b3155f`::moving from state preparing -> state finished >Thread-53381::DEBUG::2014-05-16 17:11:58,258::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53381::DEBUG::2014-05-16 17:11:58,258::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53381::DEBUG::2014-05-16 17:11:58,258::task::974::TaskManager.Task::(_decref) Task=`15c0c458-c116-465d-8e19-3a4812b3155f`::ref 0 aborting False >Thread-53382::DEBUG::2014-05-16 17:11:58,286::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53382::DEBUG::2014-05-16 17:11:58,286::task::579::TaskManager.Task::(_updateState) Task=`62e04e1c-e506-48d9-ac6a-18cbf9074217`::moving from state init -> state preparing >Thread-53382::INFO::2014-05-16 17:11:58,287::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53382::DEBUG::2014-05-16 17:11:58,287::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`62f3ee3d-e587-40a9-ad0f-e6b3545f6562`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53382::DEBUG::2014-05-16 17:11:58,287::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53382::DEBUG::2014-05-16 17:11:58,287::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53382::DEBUG::2014-05-16 17:11:58,287::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`62f3ee3d-e587-40a9-ad0f-e6b3545f6562`::Granted request >Thread-53382::DEBUG::2014-05-16 17:11:58,288::task::811::TaskManager.Task::(resourceAcquired) Task=`62e04e1c-e506-48d9-ac6a-18cbf9074217`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53382::DEBUG::2014-05-16 17:11:58,288::task::974::TaskManager.Task::(_decref) Task=`62e04e1c-e506-48d9-ac6a-18cbf9074217`::ref 1 aborting False >Thread-53382::INFO::2014-05-16 17:11:58,288::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53382::DEBUG::2014-05-16 17:11:58,289::task::1168::TaskManager.Task::(prepare) Task=`62e04e1c-e506-48d9-ac6a-18cbf9074217`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53382::DEBUG::2014-05-16 17:11:58,289::task::579::TaskManager.Task::(_updateState) Task=`62e04e1c-e506-48d9-ac6a-18cbf9074217`::moving from state preparing -> state finished >Thread-53382::DEBUG::2014-05-16 17:11:58,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53382::DEBUG::2014-05-16 17:11:58,289::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53382::DEBUG::2014-05-16 17:11:58,289::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53382::DEBUG::2014-05-16 17:11:58,289::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53382::DEBUG::2014-05-16 17:11:58,290::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53382::DEBUG::2014-05-16 17:11:58,290::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53382::DEBUG::2014-05-16 17:11:58,290::task::974::TaskManager.Task::(_decref) Task=`62e04e1c-e506-48d9-ac6a-18cbf9074217`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:11:58,663::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:11:58,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306515 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:00,743::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:00,810::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309388 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:02,821::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:02,894::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037114 s, 27.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:12:04,386::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:12:04,397::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000892879 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:04,906::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:04,977::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353121 s, 29.0 MB/s\n'; <rc> = 0 >Thread-53385::DEBUG::2014-05-16 17:12:05,871::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4343420.000000 / 8.008299 / 262500000.000000 = 0.206615 >Thread-53385::DEBUG::2014-05-16 17:12:05,871::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054591939975335638, 'statsAge': 0.13486814498901367, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20661518963391395, 'rxDropped': 0} >Thread-53385::DEBUG::2014-05-16 17:12:05,872::task::579::TaskManager.Task::(_updateState) Task=`66713858-8837-4cc0-a4b4-2124ac2ade03`::moving from state init -> state preparing >Thread-53385::INFO::2014-05-16 17:12:05,873::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53385::INFO::2014-05-16 17:12:05,873::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000892879', 'lastCheck': '1.5', 'valid': True}} >Thread-53385::DEBUG::2014-05-16 17:12:05,873::task::1168::TaskManager.Task::(prepare) Task=`66713858-8837-4cc0-a4b4-2124ac2ade03`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000892879', 'lastCheck': '1.5', 'valid': True}} >Thread-53385::DEBUG::2014-05-16 17:12:05,873::task::579::TaskManager.Task::(_updateState) Task=`66713858-8837-4cc0-a4b4-2124ac2ade03`::moving from state preparing -> state finished >Thread-53385::DEBUG::2014-05-16 17:12:05,873::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53385::DEBUG::2014-05-16 17:12:05,874::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53385::DEBUG::2014-05-16 17:12:05,874::task::974::TaskManager.Task::(_decref) Task=`66713858-8837-4cc0-a4b4-2124ac2ade03`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:12:06,988::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:07,056::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316761 s, 32.3 MB/s\n'; <rc> = 0 >Thread-53387::DEBUG::2014-05-16 17:12:08,325::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53387::DEBUG::2014-05-16 17:12:08,325::task::579::TaskManager.Task::(_updateState) Task=`69cc4040-ef2e-4ec2-946b-bae9424a621b`::moving from state init -> state preparing >Thread-53387::INFO::2014-05-16 17:12:08,326::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53387::INFO::2014-05-16 17:12:08,326::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53387::DEBUG::2014-05-16 17:12:08,326::task::1168::TaskManager.Task::(prepare) Task=`69cc4040-ef2e-4ec2-946b-bae9424a621b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53387::DEBUG::2014-05-16 17:12:08,326::task::579::TaskManager.Task::(_updateState) Task=`69cc4040-ef2e-4ec2-946b-bae9424a621b`::moving from state preparing -> state finished >Thread-53387::DEBUG::2014-05-16 17:12:08,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53387::DEBUG::2014-05-16 17:12:08,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53387::DEBUG::2014-05-16 17:12:08,327::task::974::TaskManager.Task::(_decref) Task=`69cc4040-ef2e-4ec2-946b-bae9424a621b`::ref 0 aborting False >Thread-53388::DEBUG::2014-05-16 17:12:08,335::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53388::DEBUG::2014-05-16 17:12:08,336::task::579::TaskManager.Task::(_updateState) Task=`7bd38f99-a2a7-4556-b617-cad49b68c044`::moving from state init -> state preparing >Thread-53388::INFO::2014-05-16 17:12:08,336::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53388::DEBUG::2014-05-16 17:12:08,336::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5a0c2f6a-5ca0-4c67-8161-45cf7574d82e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53388::DEBUG::2014-05-16 17:12:08,336::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53388::DEBUG::2014-05-16 17:12:08,337::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53388::DEBUG::2014-05-16 17:12:08,337::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5a0c2f6a-5ca0-4c67-8161-45cf7574d82e`::Granted request >Thread-53388::DEBUG::2014-05-16 17:12:08,337::task::811::TaskManager.Task::(resourceAcquired) Task=`7bd38f99-a2a7-4556-b617-cad49b68c044`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53388::DEBUG::2014-05-16 17:12:08,337::task::974::TaskManager.Task::(_decref) Task=`7bd38f99-a2a7-4556-b617-cad49b68c044`::ref 1 aborting False >Thread-53388::INFO::2014-05-16 17:12:08,338::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53388::DEBUG::2014-05-16 17:12:08,338::task::1168::TaskManager.Task::(prepare) Task=`7bd38f99-a2a7-4556-b617-cad49b68c044`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53388::DEBUG::2014-05-16 17:12:08,338::task::579::TaskManager.Task::(_updateState) Task=`7bd38f99-a2a7-4556-b617-cad49b68c044`::moving from state preparing -> state finished >Thread-53388::DEBUG::2014-05-16 17:12:08,338::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53388::DEBUG::2014-05-16 17:12:08,339::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53388::DEBUG::2014-05-16 17:12:08,339::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53388::DEBUG::2014-05-16 17:12:08,339::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53388::DEBUG::2014-05-16 17:12:08,339::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53388::DEBUG::2014-05-16 17:12:08,339::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53388::DEBUG::2014-05-16 17:12:08,340::task::974::TaskManager.Task::(_decref) Task=`7bd38f99-a2a7-4556-b617-cad49b68c044`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:12:09,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:09,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0426113 s, 24.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:11,162::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:11,229::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310334 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:13,241::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:13,308::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309109 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:12:14,435::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:12:14,445::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000794127 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:15,320::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:15,387::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310904 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:17,399::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:17,471::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357244 s, 28.7 MB/s\n'; <rc> = 0 >Thread-53393::DEBUG::2014-05-16 17:12:18,421::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53393::DEBUG::2014-05-16 17:12:18,422::task::579::TaskManager.Task::(_updateState) Task=`4b5ebb01-c005-4ffc-b7f6-bcc9c340a742`::moving from state init -> state preparing >Thread-53393::INFO::2014-05-16 17:12:18,422::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53393::INFO::2014-05-16 17:12:18,422::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53393::DEBUG::2014-05-16 17:12:18,422::task::1168::TaskManager.Task::(prepare) Task=`4b5ebb01-c005-4ffc-b7f6-bcc9c340a742`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53393::DEBUG::2014-05-16 17:12:18,423::task::579::TaskManager.Task::(_updateState) Task=`4b5ebb01-c005-4ffc-b7f6-bcc9c340a742`::moving from state preparing -> state finished >Thread-53393::DEBUG::2014-05-16 17:12:18,423::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53393::DEBUG::2014-05-16 17:12:18,423::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53393::DEBUG::2014-05-16 17:12:18,423::task::974::TaskManager.Task::(_decref) Task=`4b5ebb01-c005-4ffc-b7f6-bcc9c340a742`::ref 0 aborting False >Thread-53394::DEBUG::2014-05-16 17:12:18,431::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53394::DEBUG::2014-05-16 17:12:18,431::task::579::TaskManager.Task::(_updateState) Task=`be3f9973-ec5a-4c30-8420-062f12fa05f5`::moving from state init -> state preparing >Thread-53394::INFO::2014-05-16 17:12:18,431::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53394::DEBUG::2014-05-16 17:12:18,432::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9b899959-85e2-40ac-a110-94d40f404ab1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53394::DEBUG::2014-05-16 17:12:18,432::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53394::DEBUG::2014-05-16 17:12:18,432::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53394::DEBUG::2014-05-16 17:12:18,432::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9b899959-85e2-40ac-a110-94d40f404ab1`::Granted request >Thread-53394::DEBUG::2014-05-16 17:12:18,432::task::811::TaskManager.Task::(resourceAcquired) Task=`be3f9973-ec5a-4c30-8420-062f12fa05f5`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53394::DEBUG::2014-05-16 17:12:18,433::task::974::TaskManager.Task::(_decref) Task=`be3f9973-ec5a-4c30-8420-062f12fa05f5`::ref 1 aborting False >Thread-53394::INFO::2014-05-16 17:12:18,433::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53394::DEBUG::2014-05-16 17:12:18,433::task::1168::TaskManager.Task::(prepare) Task=`be3f9973-ec5a-4c30-8420-062f12fa05f5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53394::DEBUG::2014-05-16 17:12:18,433::task::579::TaskManager.Task::(_updateState) Task=`be3f9973-ec5a-4c30-8420-062f12fa05f5`::moving from state preparing -> state finished >Thread-53394::DEBUG::2014-05-16 17:12:18,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53394::DEBUG::2014-05-16 17:12:18,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53394::DEBUG::2014-05-16 17:12:18,434::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53394::DEBUG::2014-05-16 17:12:18,434::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53394::DEBUG::2014-05-16 17:12:18,434::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53394::DEBUG::2014-05-16 17:12:18,434::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53394::DEBUG::2014-05-16 17:12:18,434::task::974::TaskManager.Task::(_decref) Task=`be3f9973-ec5a-4c30-8420-062f12fa05f5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:12:19,483::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:19,553::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03451 s, 29.7 MB/s\n'; <rc> = 0 >Thread-53395::DEBUG::2014-05-16 17:12:21,069::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5416315.000000 / 8.008383 / 262500000.000000 = 0.257650 >Thread-53395::DEBUG::2014-05-16 17:12:21,069::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.006660829777116354, 'statsAge': 1.3178420066833496, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25764977599727162, 'rxDropped': 0} >Thread-53395::DEBUG::2014-05-16 17:12:21,069::task::579::TaskManager.Task::(_updateState) Task=`20b14d16-9b55-4521-a1bb-4427f17001c1`::moving from state init -> state preparing >Thread-53395::INFO::2014-05-16 17:12:21,070::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53395::INFO::2014-05-16 17:12:21,070::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000794127', 'lastCheck': '6.6', 'valid': True}} >Thread-53395::DEBUG::2014-05-16 17:12:21,070::task::1168::TaskManager.Task::(prepare) Task=`20b14d16-9b55-4521-a1bb-4427f17001c1`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000794127', 'lastCheck': '6.6', 'valid': True}} >Thread-53395::DEBUG::2014-05-16 17:12:21,070::task::579::TaskManager.Task::(_updateState) Task=`20b14d16-9b55-4521-a1bb-4427f17001c1`::moving from state preparing -> state finished >Thread-53395::DEBUG::2014-05-16 17:12:21,070::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53395::DEBUG::2014-05-16 17:12:21,070::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53395::DEBUG::2014-05-16 17:12:21,071::task::974::TaskManager.Task::(_decref) Task=`20b14d16-9b55-4521-a1bb-4427f17001c1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:12:21,564::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:21,631::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308045 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:23,643::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:23,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354081 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:12:24,479::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:12:24,489::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756279 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:25,725::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:25,801::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394738 s, 25.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:27,812::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:27,880::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315386 s, 32.5 MB/s\n'; <rc> = 0 >Thread-53399::DEBUG::2014-05-16 17:12:28,480::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53399::DEBUG::2014-05-16 17:12:28,480::task::579::TaskManager.Task::(_updateState) Task=`b965e908-f0cd-43c7-b19c-57e9d07a4e5a`::moving from state init -> state preparing >Thread-53399::INFO::2014-05-16 17:12:28,480::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53399::INFO::2014-05-16 17:12:28,481::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53399::DEBUG::2014-05-16 17:12:28,481::task::1168::TaskManager.Task::(prepare) Task=`b965e908-f0cd-43c7-b19c-57e9d07a4e5a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53399::DEBUG::2014-05-16 17:12:28,481::task::579::TaskManager.Task::(_updateState) Task=`b965e908-f0cd-43c7-b19c-57e9d07a4e5a`::moving from state preparing -> state finished >Thread-53399::DEBUG::2014-05-16 17:12:28,481::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53399::DEBUG::2014-05-16 17:12:28,481::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53399::DEBUG::2014-05-16 17:12:28,481::task::974::TaskManager.Task::(_decref) Task=`b965e908-f0cd-43c7-b19c-57e9d07a4e5a`::ref 0 aborting False >Thread-53400::DEBUG::2014-05-16 17:12:28,491::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53400::DEBUG::2014-05-16 17:12:28,491::task::579::TaskManager.Task::(_updateState) Task=`dff71130-d934-4705-846b-b66cda9dae4d`::moving from state init -> state preparing >Thread-53400::INFO::2014-05-16 17:12:28,491::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53400::DEBUG::2014-05-16 17:12:28,491::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7a48d6be-c849-434d-8ab5-e6c9be2fbd33`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53400::DEBUG::2014-05-16 17:12:28,492::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53400::DEBUG::2014-05-16 17:12:28,492::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53400::DEBUG::2014-05-16 17:12:28,492::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7a48d6be-c849-434d-8ab5-e6c9be2fbd33`::Granted request >Thread-53400::DEBUG::2014-05-16 17:12:28,492::task::811::TaskManager.Task::(resourceAcquired) Task=`dff71130-d934-4705-846b-b66cda9dae4d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53400::DEBUG::2014-05-16 17:12:28,493::task::974::TaskManager.Task::(_decref) Task=`dff71130-d934-4705-846b-b66cda9dae4d`::ref 1 aborting False >Thread-53400::INFO::2014-05-16 17:12:28,493::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53400::DEBUG::2014-05-16 17:12:28,493::task::1168::TaskManager.Task::(prepare) Task=`dff71130-d934-4705-846b-b66cda9dae4d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53400::DEBUG::2014-05-16 17:12:28,494::task::579::TaskManager.Task::(_updateState) Task=`dff71130-d934-4705-846b-b66cda9dae4d`::moving from state preparing -> state finished >Thread-53400::DEBUG::2014-05-16 17:12:28,494::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53400::DEBUG::2014-05-16 17:12:28,494::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53400::DEBUG::2014-05-16 17:12:28,494::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53400::DEBUG::2014-05-16 17:12:28,494::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53400::DEBUG::2014-05-16 17:12:28,494::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53400::DEBUG::2014-05-16 17:12:28,495::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53400::DEBUG::2014-05-16 17:12:28,495::task::974::TaskManager.Task::(_decref) Task=`dff71130-d934-4705-846b-b66cda9dae4d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:12:29,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:29,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346616 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:31,973::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:32,041::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309382 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:34,052::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:34,120::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312363 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:12:34,526::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:12:34,536::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000745227 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:36,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:36,203::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353893 s, 28.9 MB/s\n'; <rc> = 0 >Thread-53403::DEBUG::2014-05-16 17:12:36,234::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315581.000000 / 8.008003 / 262500000.000000 = 0.205298 >Thread-53403::DEBUG::2014-05-16 17:12:36,234::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052855695935239925, 'statsAge': 0.46384286880493164, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20529848176539825, 'rxDropped': 0} >Thread-53403::DEBUG::2014-05-16 17:12:36,235::task::579::TaskManager.Task::(_updateState) Task=`461942ee-7632-4d7d-b599-1e6a9f92f34e`::moving from state init -> state preparing >Thread-53403::INFO::2014-05-16 17:12:36,235::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53403::INFO::2014-05-16 17:12:36,235::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745227', 'lastCheck': '1.7', 'valid': True}} >Thread-53403::DEBUG::2014-05-16 17:12:36,235::task::1168::TaskManager.Task::(prepare) Task=`461942ee-7632-4d7d-b599-1e6a9f92f34e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745227', 'lastCheck': '1.7', 'valid': True}} >Thread-53403::DEBUG::2014-05-16 17:12:36,236::task::579::TaskManager.Task::(_updateState) Task=`461942ee-7632-4d7d-b599-1e6a9f92f34e`::moving from state preparing -> state finished >Thread-53403::DEBUG::2014-05-16 17:12:36,236::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53403::DEBUG::2014-05-16 17:12:36,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53403::DEBUG::2014-05-16 17:12:36,236::task::974::TaskManager.Task::(_decref) Task=`461942ee-7632-4d7d-b599-1e6a9f92f34e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:12:38,214::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:38,282::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310565 s, 33.0 MB/s\n'; <rc> = 0 >Thread-53405::DEBUG::2014-05-16 17:12:38,536::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53405::DEBUG::2014-05-16 17:12:38,536::task::579::TaskManager.Task::(_updateState) Task=`ecfc6f40-6b21-4fbd-878c-7725dd1a77ac`::moving from state init -> state preparing >Thread-53405::INFO::2014-05-16 17:12:38,536::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53405::INFO::2014-05-16 17:12:38,537::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53405::DEBUG::2014-05-16 17:12:38,537::task::1168::TaskManager.Task::(prepare) Task=`ecfc6f40-6b21-4fbd-878c-7725dd1a77ac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53405::DEBUG::2014-05-16 17:12:38,537::task::579::TaskManager.Task::(_updateState) Task=`ecfc6f40-6b21-4fbd-878c-7725dd1a77ac`::moving from state preparing -> state finished >Thread-53405::DEBUG::2014-05-16 17:12:38,537::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53405::DEBUG::2014-05-16 17:12:38,537::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53405::DEBUG::2014-05-16 17:12:38,537::task::974::TaskManager.Task::(_decref) Task=`ecfc6f40-6b21-4fbd-878c-7725dd1a77ac`::ref 0 aborting False >Thread-53406::DEBUG::2014-05-16 17:12:38,555::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53406::DEBUG::2014-05-16 17:12:38,555::task::579::TaskManager.Task::(_updateState) Task=`9ac4fa8b-5f73-4d25-9447-4e089c61e1ba`::moving from state init -> state preparing >Thread-53406::INFO::2014-05-16 17:12:38,555::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53406::DEBUG::2014-05-16 17:12:38,556::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ff0ea000-e46b-4c03-8951-16761f8ae95e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53406::DEBUG::2014-05-16 17:12:38,556::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53406::DEBUG::2014-05-16 17:12:38,556::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53406::DEBUG::2014-05-16 17:12:38,556::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ff0ea000-e46b-4c03-8951-16761f8ae95e`::Granted request >Thread-53406::DEBUG::2014-05-16 17:12:38,556::task::811::TaskManager.Task::(resourceAcquired) Task=`9ac4fa8b-5f73-4d25-9447-4e089c61e1ba`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53406::DEBUG::2014-05-16 17:12:38,557::task::974::TaskManager.Task::(_decref) Task=`9ac4fa8b-5f73-4d25-9447-4e089c61e1ba`::ref 1 aborting False >Thread-53406::INFO::2014-05-16 17:12:38,557::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53406::DEBUG::2014-05-16 17:12:38,557::task::1168::TaskManager.Task::(prepare) Task=`9ac4fa8b-5f73-4d25-9447-4e089c61e1ba`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53406::DEBUG::2014-05-16 17:12:38,558::task::579::TaskManager.Task::(_updateState) Task=`9ac4fa8b-5f73-4d25-9447-4e089c61e1ba`::moving from state preparing -> state finished >Thread-53406::DEBUG::2014-05-16 17:12:38,558::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53406::DEBUG::2014-05-16 17:12:38,558::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53406::DEBUG::2014-05-16 17:12:38,558::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53406::DEBUG::2014-05-16 17:12:38,558::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53406::DEBUG::2014-05-16 17:12:38,558::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53406::DEBUG::2014-05-16 17:12:38,559::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53406::DEBUG::2014-05-16 17:12:38,559::task::974::TaskManager.Task::(_decref) Task=`9ac4fa8b-5f73-4d25-9447-4e089c61e1ba`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:12:40,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:40,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346589 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:42,376::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:42,443::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313628 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:44,455::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:44,526::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351219 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:12:44,574::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:12:44,584::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000842508 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:46,537::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:46,604::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305303 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:48,616::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:48,682::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311098 s, 32.9 MB/s\n'; <rc> = 0 >Thread-53411::DEBUG::2014-05-16 17:12:48,734::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53411::DEBUG::2014-05-16 17:12:48,734::task::579::TaskManager.Task::(_updateState) Task=`58c12f1c-2c20-42f9-81b0-349e97097404`::moving from state init -> state preparing >Thread-53411::INFO::2014-05-16 17:12:48,735::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53411::INFO::2014-05-16 17:12:48,735::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53411::DEBUG::2014-05-16 17:12:48,735::task::1168::TaskManager.Task::(prepare) Task=`58c12f1c-2c20-42f9-81b0-349e97097404`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53411::DEBUG::2014-05-16 17:12:48,735::task::579::TaskManager.Task::(_updateState) Task=`58c12f1c-2c20-42f9-81b0-349e97097404`::moving from state preparing -> state finished >Thread-53411::DEBUG::2014-05-16 17:12:48,735::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53411::DEBUG::2014-05-16 17:12:48,736::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53411::DEBUG::2014-05-16 17:12:48,736::task::974::TaskManager.Task::(_decref) Task=`58c12f1c-2c20-42f9-81b0-349e97097404`::ref 0 aborting False >Thread-53412::DEBUG::2014-05-16 17:12:48,755::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53412::DEBUG::2014-05-16 17:12:48,755::task::579::TaskManager.Task::(_updateState) Task=`b09d7935-633d-43a0-87d1-1e41f58eeddb`::moving from state init -> state preparing >Thread-53412::INFO::2014-05-16 17:12:48,755::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53412::DEBUG::2014-05-16 17:12:48,756::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`78b04868-550b-4e61-aa2f-83fc0d20c7f7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53412::DEBUG::2014-05-16 17:12:48,756::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53412::DEBUG::2014-05-16 17:12:48,756::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53412::DEBUG::2014-05-16 17:12:48,756::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`78b04868-550b-4e61-aa2f-83fc0d20c7f7`::Granted request >Thread-53412::DEBUG::2014-05-16 17:12:48,757::task::811::TaskManager.Task::(resourceAcquired) Task=`b09d7935-633d-43a0-87d1-1e41f58eeddb`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53412::DEBUG::2014-05-16 17:12:48,757::task::974::TaskManager.Task::(_decref) Task=`b09d7935-633d-43a0-87d1-1e41f58eeddb`::ref 1 aborting False >Thread-53412::INFO::2014-05-16 17:12:48,758::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53412::DEBUG::2014-05-16 17:12:48,758::task::1168::TaskManager.Task::(prepare) Task=`b09d7935-633d-43a0-87d1-1e41f58eeddb`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53412::DEBUG::2014-05-16 17:12:48,758::task::579::TaskManager.Task::(_updateState) Task=`b09d7935-633d-43a0-87d1-1e41f58eeddb`::moving from state preparing -> state finished >Thread-53412::DEBUG::2014-05-16 17:12:48,758::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53412::DEBUG::2014-05-16 17:12:48,758::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53412::DEBUG::2014-05-16 17:12:48,758::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53412::DEBUG::2014-05-16 17:12:48,759::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53412::DEBUG::2014-05-16 17:12:48,759::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53412::DEBUG::2014-05-16 17:12:48,759::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53412::DEBUG::2014-05-16 17:12:48,759::task::974::TaskManager.Task::(_decref) Task=`b09d7935-633d-43a0-87d1-1e41f58eeddb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:12:50,694::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:50,766::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349958 s, 29.3 MB/s\n'; <rc> = 0 >Thread-53413::DEBUG::2014-05-16 17:12:51,394::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317659.000000 / 8.008348 / 262500000.000000 = 0.205388 >Thread-53413::DEBUG::2014-05-16 17:12:51,394::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.00537429669128242, 'statsAge': 1.6094391345977783, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20538848694246456, 'rxDropped': 0} >Thread-53413::DEBUG::2014-05-16 17:12:51,395::task::579::TaskManager.Task::(_updateState) Task=`6cfd01a1-1b0a-4d88-add5-f22af7a41f61`::moving from state init -> state preparing >Thread-53413::INFO::2014-05-16 17:12:51,395::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53413::INFO::2014-05-16 17:12:51,395::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000842508', 'lastCheck': '6.8', 'valid': True}} >Thread-53413::DEBUG::2014-05-16 17:12:51,395::task::1168::TaskManager.Task::(prepare) Task=`6cfd01a1-1b0a-4d88-add5-f22af7a41f61`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000842508', 'lastCheck': '6.8', 'valid': True}} >Thread-53413::DEBUG::2014-05-16 17:12:51,395::task::579::TaskManager.Task::(_updateState) Task=`6cfd01a1-1b0a-4d88-add5-f22af7a41f61`::moving from state preparing -> state finished >Thread-53413::DEBUG::2014-05-16 17:12:51,396::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53413::DEBUG::2014-05-16 17:12:51,396::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53413::DEBUG::2014-05-16 17:12:51,396::task::974::TaskManager.Task::(_decref) Task=`6cfd01a1-1b0a-4d88-add5-f22af7a41f61`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:12:52,778::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:52,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299754 s, 34.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:12:54,622::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:12:54,632::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101565 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:54,855::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:54,926::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034795 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:12:56,937::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:57,008::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348162 s, 29.4 MB/s\n'; <rc> = 0 >Thread-53417::DEBUG::2014-05-16 17:12:58,851::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53417::DEBUG::2014-05-16 17:12:58,852::task::579::TaskManager.Task::(_updateState) Task=`830730ce-9c1c-4656-b38f-3eed77964f3e`::moving from state init -> state preparing >Thread-53417::INFO::2014-05-16 17:12:58,852::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53417::INFO::2014-05-16 17:12:58,852::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53417::DEBUG::2014-05-16 17:12:58,852::task::1168::TaskManager.Task::(prepare) Task=`830730ce-9c1c-4656-b38f-3eed77964f3e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53417::DEBUG::2014-05-16 17:12:58,853::task::579::TaskManager.Task::(_updateState) Task=`830730ce-9c1c-4656-b38f-3eed77964f3e`::moving from state preparing -> state finished >Thread-53417::DEBUG::2014-05-16 17:12:58,853::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53417::DEBUG::2014-05-16 17:12:58,853::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53417::DEBUG::2014-05-16 17:12:58,853::task::974::TaskManager.Task::(_decref) Task=`830730ce-9c1c-4656-b38f-3eed77964f3e`::ref 0 aborting False >Thread-53418::DEBUG::2014-05-16 17:12:58,861::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53418::DEBUG::2014-05-16 17:12:58,861::task::579::TaskManager.Task::(_updateState) Task=`54363477-7cb5-4182-a4b7-f1e3a3cb360f`::moving from state init -> state preparing >Thread-53418::INFO::2014-05-16 17:12:58,862::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53418::DEBUG::2014-05-16 17:12:58,862::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a90a6b40-dd98-4436-9958-0acd5800b60f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53418::DEBUG::2014-05-16 17:12:58,862::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53418::DEBUG::2014-05-16 17:12:58,862::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53418::DEBUG::2014-05-16 17:12:58,862::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a90a6b40-dd98-4436-9958-0acd5800b60f`::Granted request >Thread-53418::DEBUG::2014-05-16 17:12:58,863::task::811::TaskManager.Task::(resourceAcquired) Task=`54363477-7cb5-4182-a4b7-f1e3a3cb360f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53418::DEBUG::2014-05-16 17:12:58,863::task::974::TaskManager.Task::(_decref) Task=`54363477-7cb5-4182-a4b7-f1e3a3cb360f`::ref 1 aborting False >Thread-53418::INFO::2014-05-16 17:12:58,863::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53418::DEBUG::2014-05-16 17:12:58,864::task::1168::TaskManager.Task::(prepare) Task=`54363477-7cb5-4182-a4b7-f1e3a3cb360f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53418::DEBUG::2014-05-16 17:12:58,864::task::579::TaskManager.Task::(_updateState) Task=`54363477-7cb5-4182-a4b7-f1e3a3cb360f`::moving from state preparing -> state finished >Thread-53418::DEBUG::2014-05-16 17:12:58,864::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53418::DEBUG::2014-05-16 17:12:58,864::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53418::DEBUG::2014-05-16 17:12:58,864::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53418::DEBUG::2014-05-16 17:12:58,864::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53418::DEBUG::2014-05-16 17:12:58,865::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53418::DEBUG::2014-05-16 17:12:58,865::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53418::DEBUG::2014-05-16 17:12:58,865::task::974::TaskManager.Task::(_decref) Task=`54363477-7cb5-4182-a4b7-f1e3a3cb360f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:12:59,019::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:12:59,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320035 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:01,100::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:01,167::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306585 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:03,179::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:03,251::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358975 s, 28.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:13:04,669::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:13:04,679::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010325 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:05,262::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:05,333::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352288 s, 29.1 MB/s\n'; <rc> = 0 >Thread-53421::DEBUG::2014-05-16 17:13:06,631::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413331.000000 / 8.008402 / 262500000.000000 = 0.257507 >Thread-53421::DEBUG::2014-05-16 17:13:06,631::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065867012747411408, 'statsAge': 0.82962298393249512, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25750721619961386, 'rxDropped': 0} >Thread-53421::DEBUG::2014-05-16 17:13:06,632::task::579::TaskManager.Task::(_updateState) Task=`064a3b1a-ea3a-4ea8-8ae4-ab0f009fd453`::moving from state init -> state preparing >Thread-53421::INFO::2014-05-16 17:13:06,632::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53421::INFO::2014-05-16 17:13:06,632::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010325', 'lastCheck': '1.9', 'valid': True}} >Thread-53421::DEBUG::2014-05-16 17:13:06,632::task::1168::TaskManager.Task::(prepare) Task=`064a3b1a-ea3a-4ea8-8ae4-ab0f009fd453`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010325', 'lastCheck': '1.9', 'valid': True}} >Thread-53421::DEBUG::2014-05-16 17:13:06,632::task::579::TaskManager.Task::(_updateState) Task=`064a3b1a-ea3a-4ea8-8ae4-ab0f009fd453`::moving from state preparing -> state finished >Thread-53421::DEBUG::2014-05-16 17:13:06,632::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53421::DEBUG::2014-05-16 17:13:06,632::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53421::DEBUG::2014-05-16 17:13:06,633::task::974::TaskManager.Task::(_decref) Task=`064a3b1a-ea3a-4ea8-8ae4-ab0f009fd453`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:13:07,345::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:07,412::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311978 s, 32.8 MB/s\n'; <rc> = 0 >Thread-53423::DEBUG::2014-05-16 17:13:08,907::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53423::DEBUG::2014-05-16 17:13:08,907::task::579::TaskManager.Task::(_updateState) Task=`a75cf694-a8e1-47d8-8b91-830a552d1aa9`::moving from state init -> state preparing >Thread-53423::INFO::2014-05-16 17:13:08,908::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53423::INFO::2014-05-16 17:13:08,908::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53423::DEBUG::2014-05-16 17:13:08,908::task::1168::TaskManager.Task::(prepare) Task=`a75cf694-a8e1-47d8-8b91-830a552d1aa9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53423::DEBUG::2014-05-16 17:13:08,908::task::579::TaskManager.Task::(_updateState) Task=`a75cf694-a8e1-47d8-8b91-830a552d1aa9`::moving from state preparing -> state finished >Thread-53423::DEBUG::2014-05-16 17:13:08,908::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53423::DEBUG::2014-05-16 17:13:08,908::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53423::DEBUG::2014-05-16 17:13:08,909::task::974::TaskManager.Task::(_decref) Task=`a75cf694-a8e1-47d8-8b91-830a552d1aa9`::ref 0 aborting False >Thread-53424::DEBUG::2014-05-16 17:13:08,933::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53424::DEBUG::2014-05-16 17:13:08,933::task::579::TaskManager.Task::(_updateState) Task=`8809d4eb-b758-44d8-bce6-3a5878edcd5d`::moving from state init -> state preparing >Thread-53424::INFO::2014-05-16 17:13:08,933::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53424::DEBUG::2014-05-16 17:13:08,934::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8683dc71-08e1-4641-96d1-4d0a08e2442c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53424::DEBUG::2014-05-16 17:13:08,934::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53424::DEBUG::2014-05-16 17:13:08,934::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53424::DEBUG::2014-05-16 17:13:08,934::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8683dc71-08e1-4641-96d1-4d0a08e2442c`::Granted request >Thread-53424::DEBUG::2014-05-16 17:13:08,934::task::811::TaskManager.Task::(resourceAcquired) Task=`8809d4eb-b758-44d8-bce6-3a5878edcd5d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53424::DEBUG::2014-05-16 17:13:08,935::task::974::TaskManager.Task::(_decref) Task=`8809d4eb-b758-44d8-bce6-3a5878edcd5d`::ref 1 aborting False >Thread-53424::INFO::2014-05-16 17:13:08,935::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53424::DEBUG::2014-05-16 17:13:08,935::task::1168::TaskManager.Task::(prepare) Task=`8809d4eb-b758-44d8-bce6-3a5878edcd5d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53424::DEBUG::2014-05-16 17:13:08,936::task::579::TaskManager.Task::(_updateState) Task=`8809d4eb-b758-44d8-bce6-3a5878edcd5d`::moving from state preparing -> state finished >Thread-53424::DEBUG::2014-05-16 17:13:08,936::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53424::DEBUG::2014-05-16 17:13:08,936::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53424::DEBUG::2014-05-16 17:13:08,936::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53424::DEBUG::2014-05-16 17:13:08,936::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53424::DEBUG::2014-05-16 17:13:08,936::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53424::DEBUG::2014-05-16 17:13:08,937::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53424::DEBUG::2014-05-16 17:13:08,937::task::974::TaskManager.Task::(_decref) Task=`8809d4eb-b758-44d8-bce6-3a5878edcd5d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:13:09,424::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:09,495::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349942 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:11,507::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:11,578::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348468 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:13,590::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:13,657::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308638 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:13:14,716::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:13:14,726::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000811181 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:15,669::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:15,735::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307591 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:17,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:17,830::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361362 s, 28.3 MB/s\n'; <rc> = 0 >Thread-53429::DEBUG::2014-05-16 17:13:18,970::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53429::DEBUG::2014-05-16 17:13:18,971::task::579::TaskManager.Task::(_updateState) Task=`d5f22019-6a5a-4a92-b5b9-cd568d81b630`::moving from state init -> state preparing >Thread-53429::INFO::2014-05-16 17:13:18,971::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53429::INFO::2014-05-16 17:13:18,971::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53429::DEBUG::2014-05-16 17:13:18,971::task::1168::TaskManager.Task::(prepare) Task=`d5f22019-6a5a-4a92-b5b9-cd568d81b630`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53429::DEBUG::2014-05-16 17:13:18,972::task::579::TaskManager.Task::(_updateState) Task=`d5f22019-6a5a-4a92-b5b9-cd568d81b630`::moving from state preparing -> state finished >Thread-53429::DEBUG::2014-05-16 17:13:18,972::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53429::DEBUG::2014-05-16 17:13:18,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53429::DEBUG::2014-05-16 17:13:18,972::task::974::TaskManager.Task::(_decref) Task=`d5f22019-6a5a-4a92-b5b9-cd568d81b630`::ref 0 aborting False >Thread-53430::DEBUG::2014-05-16 17:13:18,981::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53430::DEBUG::2014-05-16 17:13:18,981::task::579::TaskManager.Task::(_updateState) Task=`77eeddf0-c837-4046-b8a8-12d97c995e63`::moving from state init -> state preparing >Thread-53430::INFO::2014-05-16 17:13:18,981::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53430::DEBUG::2014-05-16 17:13:18,982::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ed8fcaf6-8328-4b6d-a510-9ba6c665496d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53430::DEBUG::2014-05-16 17:13:18,982::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53430::DEBUG::2014-05-16 17:13:18,982::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53430::DEBUG::2014-05-16 17:13:18,982::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ed8fcaf6-8328-4b6d-a510-9ba6c665496d`::Granted request >Thread-53430::DEBUG::2014-05-16 17:13:18,982::task::811::TaskManager.Task::(resourceAcquired) Task=`77eeddf0-c837-4046-b8a8-12d97c995e63`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53430::DEBUG::2014-05-16 17:13:18,983::task::974::TaskManager.Task::(_decref) Task=`77eeddf0-c837-4046-b8a8-12d97c995e63`::ref 1 aborting False >Thread-53430::INFO::2014-05-16 17:13:18,983::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53430::DEBUG::2014-05-16 17:13:18,983::task::1168::TaskManager.Task::(prepare) Task=`77eeddf0-c837-4046-b8a8-12d97c995e63`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53430::DEBUG::2014-05-16 17:13:18,983::task::579::TaskManager.Task::(_updateState) Task=`77eeddf0-c837-4046-b8a8-12d97c995e63`::moving from state preparing -> state finished >Thread-53430::DEBUG::2014-05-16 17:13:18,984::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53430::DEBUG::2014-05-16 17:13:18,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53430::DEBUG::2014-05-16 17:13:18,984::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53430::DEBUG::2014-05-16 17:13:18,984::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53430::DEBUG::2014-05-16 17:13:18,984::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53430::DEBUG::2014-05-16 17:13:18,984::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53430::DEBUG::2014-05-16 17:13:18,984::task::974::TaskManager.Task::(_decref) Task=`77eeddf0-c837-4046-b8a8-12d97c995e63`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:13:19,841::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:19,912::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351939 s, 29.1 MB/s\n'; <rc> = 0 >Thread-53431::DEBUG::2014-05-16 17:13:21,783::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3241731.000000 / 8.011138 / 262500000.000000 = 0.154154 >Thread-53431::DEBUG::2014-05-16 17:13:21,783::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041473687025897366, 'statsAge': 1.9638180732727051, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15415352333992535, 'rxDropped': 0} >Thread-53431::DEBUG::2014-05-16 17:13:21,783::task::579::TaskManager.Task::(_updateState) Task=`7b697606-3702-4b2a-98ea-e4df2c227acf`::moving from state init -> state preparing >Thread-53431::INFO::2014-05-16 17:13:21,783::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53431::INFO::2014-05-16 17:13:21,784::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811181', 'lastCheck': '7.0', 'valid': True}} >Thread-53431::DEBUG::2014-05-16 17:13:21,784::task::1168::TaskManager.Task::(prepare) Task=`7b697606-3702-4b2a-98ea-e4df2c227acf`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811181', 'lastCheck': '7.0', 'valid': True}} >Thread-53431::DEBUG::2014-05-16 17:13:21,784::task::579::TaskManager.Task::(_updateState) Task=`7b697606-3702-4b2a-98ea-e4df2c227acf`::moving from state preparing -> state finished >Thread-53431::DEBUG::2014-05-16 17:13:21,784::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53431::DEBUG::2014-05-16 17:13:21,784::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53431::DEBUG::2014-05-16 17:13:21,784::task::974::TaskManager.Task::(_decref) Task=`7b697606-3702-4b2a-98ea-e4df2c227acf`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:13:21,924::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:21,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030487 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:24,001::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:24,074::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036557 s, 28.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:13:24,764::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:13:24,774::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000819638 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:26,085::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:26,156::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351519 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:28,168::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:28,234::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307731 s, 33.3 MB/s\n'; <rc> = 0 >Thread-53435::DEBUG::2014-05-16 17:13:29,044::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53435::DEBUG::2014-05-16 17:13:29,046::task::579::TaskManager.Task::(_updateState) Task=`784be881-ded0-4723-b844-425eb040997d`::moving from state init -> state preparing >Thread-53435::INFO::2014-05-16 17:13:29,046::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53435::INFO::2014-05-16 17:13:29,046::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53435::DEBUG::2014-05-16 17:13:29,046::task::1168::TaskManager.Task::(prepare) Task=`784be881-ded0-4723-b844-425eb040997d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53435::DEBUG::2014-05-16 17:13:29,047::task::579::TaskManager.Task::(_updateState) Task=`784be881-ded0-4723-b844-425eb040997d`::moving from state preparing -> state finished >Thread-53435::DEBUG::2014-05-16 17:13:29,047::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53435::DEBUG::2014-05-16 17:13:29,047::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53435::DEBUG::2014-05-16 17:13:29,047::task::974::TaskManager.Task::(_decref) Task=`784be881-ded0-4723-b844-425eb040997d`::ref 0 aborting False >Thread-53436::DEBUG::2014-05-16 17:13:29,061::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53436::DEBUG::2014-05-16 17:13:29,061::task::579::TaskManager.Task::(_updateState) Task=`f5a45999-385b-4fec-83b6-1f63cd8fdcf4`::moving from state init -> state preparing >Thread-53436::INFO::2014-05-16 17:13:29,062::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53436::DEBUG::2014-05-16 17:13:29,062::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`128d74f5-fd73-4dbd-b3f3-5083994ddb28`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53436::DEBUG::2014-05-16 17:13:29,062::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53436::DEBUG::2014-05-16 17:13:29,062::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53436::DEBUG::2014-05-16 17:13:29,063::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`128d74f5-fd73-4dbd-b3f3-5083994ddb28`::Granted request >Thread-53436::DEBUG::2014-05-16 17:13:29,063::task::811::TaskManager.Task::(resourceAcquired) Task=`f5a45999-385b-4fec-83b6-1f63cd8fdcf4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53436::DEBUG::2014-05-16 17:13:29,063::task::974::TaskManager.Task::(_decref) Task=`f5a45999-385b-4fec-83b6-1f63cd8fdcf4`::ref 1 aborting False >Thread-53436::INFO::2014-05-16 17:13:29,064::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53436::DEBUG::2014-05-16 17:13:29,064::task::1168::TaskManager.Task::(prepare) Task=`f5a45999-385b-4fec-83b6-1f63cd8fdcf4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53436::DEBUG::2014-05-16 17:13:29,064::task::579::TaskManager.Task::(_updateState) Task=`f5a45999-385b-4fec-83b6-1f63cd8fdcf4`::moving from state preparing -> state finished >Thread-53436::DEBUG::2014-05-16 17:13:29,064::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53436::DEBUG::2014-05-16 17:13:29,064::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53436::DEBUG::2014-05-16 17:13:29,064::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53436::DEBUG::2014-05-16 17:13:29,065::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53436::DEBUG::2014-05-16 17:13:29,065::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53436::DEBUG::2014-05-16 17:13:29,065::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53436::DEBUG::2014-05-16 17:13:29,065::task::974::TaskManager.Task::(_decref) Task=`f5a45999-385b-4fec-83b6-1f63cd8fdcf4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:13:30,246::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:30,312::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349253 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:32,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:32,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306608 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:34,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:34,464::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031009 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:13:34,813::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:13:34,823::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000758536 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:36,482::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:36,548::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301346 s, 34.0 MB/s\n'; <rc> = 0 >Thread-53439::DEBUG::2014-05-16 17:13:36,946::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315313.000000 / 8.008102 / 262500000.000000 = 0.205283 >Thread-53439::DEBUG::2014-05-16 17:13:36,946::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053600002712499957, 'statsAge': 1.1105291843414307, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20528319621677257, 'rxDropped': 0} >Thread-53439::DEBUG::2014-05-16 17:13:36,946::task::579::TaskManager.Task::(_updateState) Task=`e2f5b4af-ed2c-4f54-b854-b69298cf4811`::moving from state init -> state preparing >Thread-53439::INFO::2014-05-16 17:13:36,947::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53439::INFO::2014-05-16 17:13:36,947::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000758536', 'lastCheck': '2.1', 'valid': True}} >Thread-53439::DEBUG::2014-05-16 17:13:36,947::task::1168::TaskManager.Task::(prepare) Task=`e2f5b4af-ed2c-4f54-b854-b69298cf4811`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000758536', 'lastCheck': '2.1', 'valid': True}} >Thread-53439::DEBUG::2014-05-16 17:13:36,947::task::579::TaskManager.Task::(_updateState) Task=`e2f5b4af-ed2c-4f54-b854-b69298cf4811`::moving from state preparing -> state finished >Thread-53439::DEBUG::2014-05-16 17:13:36,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53439::DEBUG::2014-05-16 17:13:36,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53439::DEBUG::2014-05-16 17:13:36,948::task::974::TaskManager.Task::(_decref) Task=`e2f5b4af-ed2c-4f54-b854-b69298cf4811`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:13:38,560::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:38,631::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353593 s, 29.0 MB/s\n'; <rc> = 0 >Thread-53441::DEBUG::2014-05-16 17:13:39,103::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53441::DEBUG::2014-05-16 17:13:39,104::task::579::TaskManager.Task::(_updateState) Task=`6e766d45-3949-462a-bbe6-ad245611ddb3`::moving from state init -> state preparing >Thread-53441::INFO::2014-05-16 17:13:39,104::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53441::INFO::2014-05-16 17:13:39,105::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53441::DEBUG::2014-05-16 17:13:39,105::task::1168::TaskManager.Task::(prepare) Task=`6e766d45-3949-462a-bbe6-ad245611ddb3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53441::DEBUG::2014-05-16 17:13:39,105::task::579::TaskManager.Task::(_updateState) Task=`6e766d45-3949-462a-bbe6-ad245611ddb3`::moving from state preparing -> state finished >Thread-53441::DEBUG::2014-05-16 17:13:39,105::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53441::DEBUG::2014-05-16 17:13:39,105::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53441::DEBUG::2014-05-16 17:13:39,105::task::974::TaskManager.Task::(_decref) Task=`6e766d45-3949-462a-bbe6-ad245611ddb3`::ref 0 aborting False >Thread-53442::DEBUG::2014-05-16 17:13:39,114::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53442::DEBUG::2014-05-16 17:13:39,115::task::579::TaskManager.Task::(_updateState) Task=`de674539-7dd3-4a1d-9255-1e3883c3f654`::moving from state init -> state preparing >Thread-53442::INFO::2014-05-16 17:13:39,115::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53442::DEBUG::2014-05-16 17:13:39,115::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4ac5ef34-5edc-4985-86fd-933dcdcd637d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53442::DEBUG::2014-05-16 17:13:39,115::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53442::DEBUG::2014-05-16 17:13:39,116::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53442::DEBUG::2014-05-16 17:13:39,116::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4ac5ef34-5edc-4985-86fd-933dcdcd637d`::Granted request >Thread-53442::DEBUG::2014-05-16 17:13:39,116::task::811::TaskManager.Task::(resourceAcquired) Task=`de674539-7dd3-4a1d-9255-1e3883c3f654`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53442::DEBUG::2014-05-16 17:13:39,116::task::974::TaskManager.Task::(_decref) Task=`de674539-7dd3-4a1d-9255-1e3883c3f654`::ref 1 aborting False >Thread-53442::INFO::2014-05-16 17:13:39,117::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53442::DEBUG::2014-05-16 17:13:39,117::task::1168::TaskManager.Task::(prepare) Task=`de674539-7dd3-4a1d-9255-1e3883c3f654`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53442::DEBUG::2014-05-16 17:13:39,117::task::579::TaskManager.Task::(_updateState) Task=`de674539-7dd3-4a1d-9255-1e3883c3f654`::moving from state preparing -> state finished >Thread-53442::DEBUG::2014-05-16 17:13:39,118::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53442::DEBUG::2014-05-16 17:13:39,118::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53442::DEBUG::2014-05-16 17:13:39,118::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53442::DEBUG::2014-05-16 17:13:39,118::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53442::DEBUG::2014-05-16 17:13:39,118::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53442::DEBUG::2014-05-16 17:13:39,118::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53442::DEBUG::2014-05-16 17:13:39,119::task::974::TaskManager.Task::(_decref) Task=`de674539-7dd3-4a1d-9255-1e3883c3f654`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:13:40,643::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:40,718::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388955 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:42,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:42,797::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308782 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:44,809::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 17:13:44,962::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:13:44,999::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756375 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:45,144::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.129815 s, 7.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:47,156::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:47,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302635 s, 33.8 MB/s\n'; <rc> = 0 >Thread-53447::DEBUG::2014-05-16 17:13:49,146::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53447::DEBUG::2014-05-16 17:13:49,146::task::579::TaskManager.Task::(_updateState) Task=`406c03f1-bcf4-4f86-a58f-fd3637280800`::moving from state init -> state preparing >Thread-53447::INFO::2014-05-16 17:13:49,146::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53447::INFO::2014-05-16 17:13:49,147::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53447::DEBUG::2014-05-16 17:13:49,147::task::1168::TaskManager.Task::(prepare) Task=`406c03f1-bcf4-4f86-a58f-fd3637280800`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53447::DEBUG::2014-05-16 17:13:49,147::task::579::TaskManager.Task::(_updateState) Task=`406c03f1-bcf4-4f86-a58f-fd3637280800`::moving from state preparing -> state finished >Thread-53447::DEBUG::2014-05-16 17:13:49,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53447::DEBUG::2014-05-16 17:13:49,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53447::DEBUG::2014-05-16 17:13:49,147::task::974::TaskManager.Task::(_decref) Task=`406c03f1-bcf4-4f86-a58f-fd3637280800`::ref 0 aborting False >Thread-53448::DEBUG::2014-05-16 17:13:49,157::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53448::DEBUG::2014-05-16 17:13:49,157::task::579::TaskManager.Task::(_updateState) Task=`583cd3e4-872e-4a90-ab4a-cf9536c69bca`::moving from state init -> state preparing >Thread-53448::INFO::2014-05-16 17:13:49,157::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53448::DEBUG::2014-05-16 17:13:49,157::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d4a170c0-8f49-4d29-9f37-95cc69296008`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53448::DEBUG::2014-05-16 17:13:49,157::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53448::DEBUG::2014-05-16 17:13:49,158::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53448::DEBUG::2014-05-16 17:13:49,158::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d4a170c0-8f49-4d29-9f37-95cc69296008`::Granted request >Thread-53448::DEBUG::2014-05-16 17:13:49,158::task::811::TaskManager.Task::(resourceAcquired) Task=`583cd3e4-872e-4a90-ab4a-cf9536c69bca`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53448::DEBUG::2014-05-16 17:13:49,158::task::974::TaskManager.Task::(_decref) Task=`583cd3e4-872e-4a90-ab4a-cf9536c69bca`::ref 1 aborting False >Thread-53448::INFO::2014-05-16 17:13:49,159::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53448::DEBUG::2014-05-16 17:13:49,159::task::1168::TaskManager.Task::(prepare) Task=`583cd3e4-872e-4a90-ab4a-cf9536c69bca`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53448::DEBUG::2014-05-16 17:13:49,159::task::579::TaskManager.Task::(_updateState) Task=`583cd3e4-872e-4a90-ab4a-cf9536c69bca`::moving from state preparing -> state finished >Thread-53448::DEBUG::2014-05-16 17:13:49,159::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53448::DEBUG::2014-05-16 17:13:49,159::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53448::DEBUG::2014-05-16 17:13:49,160::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53448::DEBUG::2014-05-16 17:13:49,160::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53448::DEBUG::2014-05-16 17:13:49,160::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53448::DEBUG::2014-05-16 17:13:49,160::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53448::DEBUG::2014-05-16 17:13:49,160::task::974::TaskManager.Task::(_decref) Task=`583cd3e4-872e-4a90-ab4a-cf9536c69bca`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:13:49,234::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:49,301::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310747 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:51,313::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:51,380::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314826 s, 32.5 MB/s\n'; <rc> = 0 >Thread-53449::DEBUG::2014-05-16 17:13:52,107::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316028.000000 / 8.008277 / 262500000.000000 = 0.205313 >Thread-53449::DEBUG::2014-05-16 17:13:52,107::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053261085628976985, 'statsAge': 0.25495815277099609, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20531272273682816, 'rxDropped': 0} >Thread-53449::DEBUG::2014-05-16 17:13:52,108::task::579::TaskManager.Task::(_updateState) Task=`37160179-ac3e-43ae-98f3-84d6ed52c680`::moving from state init -> state preparing >Thread-53449::INFO::2014-05-16 17:13:52,108::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53449::INFO::2014-05-16 17:13:52,108::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756375', 'lastCheck': '7.0', 'valid': True}} >Thread-53449::DEBUG::2014-05-16 17:13:52,108::task::1168::TaskManager.Task::(prepare) Task=`37160179-ac3e-43ae-98f3-84d6ed52c680`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756375', 'lastCheck': '7.0', 'valid': True}} >Thread-53449::DEBUG::2014-05-16 17:13:52,108::task::579::TaskManager.Task::(_updateState) Task=`37160179-ac3e-43ae-98f3-84d6ed52c680`::moving from state preparing -> state finished >Thread-53449::DEBUG::2014-05-16 17:13:52,108::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53449::DEBUG::2014-05-16 17:13:52,109::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53449::DEBUG::2014-05-16 17:13:52,109::task::974::TaskManager.Task::(_decref) Task=`37160179-ac3e-43ae-98f3-84d6ed52c680`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:13:53,391::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:53,463::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351327 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:13:55,144::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:13:55,155::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000868719 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:55,474::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:55,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346141 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:13:57,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:57,623::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030906 s, 33.1 MB/s\n'; <rc> = 0 >Thread-53453::DEBUG::2014-05-16 17:13:59,194::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53453::DEBUG::2014-05-16 17:13:59,194::task::579::TaskManager.Task::(_updateState) Task=`7bd6ec1d-2ff4-4c13-b45e-99f1392a4003`::moving from state init -> state preparing >Thread-53453::INFO::2014-05-16 17:13:59,194::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53453::INFO::2014-05-16 17:13:59,195::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53453::DEBUG::2014-05-16 17:13:59,195::task::1168::TaskManager.Task::(prepare) Task=`7bd6ec1d-2ff4-4c13-b45e-99f1392a4003`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53453::DEBUG::2014-05-16 17:13:59,195::task::579::TaskManager.Task::(_updateState) Task=`7bd6ec1d-2ff4-4c13-b45e-99f1392a4003`::moving from state preparing -> state finished >Thread-53453::DEBUG::2014-05-16 17:13:59,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53453::DEBUG::2014-05-16 17:13:59,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53453::DEBUG::2014-05-16 17:13:59,195::task::974::TaskManager.Task::(_decref) Task=`7bd6ec1d-2ff4-4c13-b45e-99f1392a4003`::ref 0 aborting False >Thread-53454::DEBUG::2014-05-16 17:13:59,205::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53454::DEBUG::2014-05-16 17:13:59,205::task::579::TaskManager.Task::(_updateState) Task=`136e3e88-ce15-42aa-9cf8-489a1ed464e2`::moving from state init -> state preparing >Thread-53454::INFO::2014-05-16 17:13:59,205::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53454::DEBUG::2014-05-16 17:13:59,206::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c9b9e304-2f9a-43aa-8a84-c9981b67bdf7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53454::DEBUG::2014-05-16 17:13:59,206::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53454::DEBUG::2014-05-16 17:13:59,206::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53454::DEBUG::2014-05-16 17:13:59,206::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c9b9e304-2f9a-43aa-8a84-c9981b67bdf7`::Granted request >Thread-53454::DEBUG::2014-05-16 17:13:59,207::task::811::TaskManager.Task::(resourceAcquired) Task=`136e3e88-ce15-42aa-9cf8-489a1ed464e2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53454::DEBUG::2014-05-16 17:13:59,207::task::974::TaskManager.Task::(_decref) Task=`136e3e88-ce15-42aa-9cf8-489a1ed464e2`::ref 1 aborting False >Thread-53454::INFO::2014-05-16 17:13:59,207::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53454::DEBUG::2014-05-16 17:13:59,208::task::1168::TaskManager.Task::(prepare) Task=`136e3e88-ce15-42aa-9cf8-489a1ed464e2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53454::DEBUG::2014-05-16 17:13:59,208::task::579::TaskManager.Task::(_updateState) Task=`136e3e88-ce15-42aa-9cf8-489a1ed464e2`::moving from state preparing -> state finished >Thread-53454::DEBUG::2014-05-16 17:13:59,208::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53454::DEBUG::2014-05-16 17:13:59,208::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53454::DEBUG::2014-05-16 17:13:59,208::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53454::DEBUG::2014-05-16 17:13:59,208::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53454::DEBUG::2014-05-16 17:13:59,209::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53454::DEBUG::2014-05-16 17:13:59,209::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53454::DEBUG::2014-05-16 17:13:59,209::task::974::TaskManager.Task::(_decref) Task=`136e3e88-ce15-42aa-9cf8-489a1ed464e2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:13:59,634::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:13:59,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344236 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:01,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:01,781::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296405 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:03,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:03,860::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316772 s, 32.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:14:05,193::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:14:05,204::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101932 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:05,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:05,946::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345452 s, 29.6 MB/s\n'; <rc> = 0 >Thread-53457::DEBUG::2014-05-16 17:14:07,295::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4339515.000000 / 8.010855 / 262500000.000000 = 0.206364 >Thread-53457::DEBUG::2014-05-16 17:14:07,295::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054576421458481178, 'statsAge': 1.4256749153137207, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20636355677238991, 'rxDropped': 0} >Thread-53457::DEBUG::2014-05-16 17:14:07,295::task::579::TaskManager.Task::(_updateState) Task=`2884510c-f8e2-47ba-beb5-7b0531985d06`::moving from state init -> state preparing >Thread-53457::INFO::2014-05-16 17:14:07,296::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53457::INFO::2014-05-16 17:14:07,296::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101932', 'lastCheck': '2.1', 'valid': True}} >Thread-53457::DEBUG::2014-05-16 17:14:07,296::task::1168::TaskManager.Task::(prepare) Task=`2884510c-f8e2-47ba-beb5-7b0531985d06`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101932', 'lastCheck': '2.1', 'valid': True}} >Thread-53457::DEBUG::2014-05-16 17:14:07,296::task::579::TaskManager.Task::(_updateState) Task=`2884510c-f8e2-47ba-beb5-7b0531985d06`::moving from state preparing -> state finished >Thread-53457::DEBUG::2014-05-16 17:14:07,296::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53457::DEBUG::2014-05-16 17:14:07,296::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53457::DEBUG::2014-05-16 17:14:07,297::task::974::TaskManager.Task::(_decref) Task=`2884510c-f8e2-47ba-beb5-7b0531985d06`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:14:07,958::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:08,025::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306036 s, 33.5 MB/s\n'; <rc> = 0 >Thread-53459::DEBUG::2014-05-16 17:14:09,249::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53459::DEBUG::2014-05-16 17:14:09,250::task::579::TaskManager.Task::(_updateState) Task=`9c469828-158c-4c38-bd9b-254cd0c38f03`::moving from state init -> state preparing >Thread-53459::INFO::2014-05-16 17:14:09,250::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53459::INFO::2014-05-16 17:14:09,250::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53459::DEBUG::2014-05-16 17:14:09,250::task::1168::TaskManager.Task::(prepare) Task=`9c469828-158c-4c38-bd9b-254cd0c38f03`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53459::DEBUG::2014-05-16 17:14:09,250::task::579::TaskManager.Task::(_updateState) Task=`9c469828-158c-4c38-bd9b-254cd0c38f03`::moving from state preparing -> state finished >Thread-53459::DEBUG::2014-05-16 17:14:09,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53459::DEBUG::2014-05-16 17:14:09,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53459::DEBUG::2014-05-16 17:14:09,251::task::974::TaskManager.Task::(_decref) Task=`9c469828-158c-4c38-bd9b-254cd0c38f03`::ref 0 aborting False >Thread-53460::DEBUG::2014-05-16 17:14:09,261::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53460::DEBUG::2014-05-16 17:14:09,261::task::579::TaskManager.Task::(_updateState) Task=`7cdc4c56-0270-4e3c-a7f2-38f3ea216bb9`::moving from state init -> state preparing >Thread-53460::INFO::2014-05-16 17:14:09,261::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53460::DEBUG::2014-05-16 17:14:09,261::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f6af83b6-0953-4bf2-9ca5-78fd919e1a6b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53460::DEBUG::2014-05-16 17:14:09,262::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53460::DEBUG::2014-05-16 17:14:09,262::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53460::DEBUG::2014-05-16 17:14:09,262::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f6af83b6-0953-4bf2-9ca5-78fd919e1a6b`::Granted request >Thread-53460::DEBUG::2014-05-16 17:14:09,263::task::811::TaskManager.Task::(resourceAcquired) Task=`7cdc4c56-0270-4e3c-a7f2-38f3ea216bb9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53460::DEBUG::2014-05-16 17:14:09,263::task::974::TaskManager.Task::(_decref) Task=`7cdc4c56-0270-4e3c-a7f2-38f3ea216bb9`::ref 1 aborting False >Thread-53460::INFO::2014-05-16 17:14:09,264::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53460::DEBUG::2014-05-16 17:14:09,264::task::1168::TaskManager.Task::(prepare) Task=`7cdc4c56-0270-4e3c-a7f2-38f3ea216bb9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53460::DEBUG::2014-05-16 17:14:09,264::task::579::TaskManager.Task::(_updateState) Task=`7cdc4c56-0270-4e3c-a7f2-38f3ea216bb9`::moving from state preparing -> state finished >Thread-53460::DEBUG::2014-05-16 17:14:09,264::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53460::DEBUG::2014-05-16 17:14:09,265::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53460::DEBUG::2014-05-16 17:14:09,265::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53460::DEBUG::2014-05-16 17:14:09,265::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53460::DEBUG::2014-05-16 17:14:09,265::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53460::DEBUG::2014-05-16 17:14:09,265::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53460::DEBUG::2014-05-16 17:14:09,265::task::974::TaskManager.Task::(_decref) Task=`7cdc4c56-0270-4e3c-a7f2-38f3ea216bb9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:14:10,037::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:10,107::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348987 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:12,119::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:12,189::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034135 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:14,200::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:14,267::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031221 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:14:15,241::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:14:15,252::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601736 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:16,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:16,345::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303258 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:18,357::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:18,424::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312705 s, 32.7 MB/s\n'; <rc> = 0 >Thread-53464::DEBUG::2014-05-16 17:14:19,298::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53464::DEBUG::2014-05-16 17:14:19,298::task::579::TaskManager.Task::(_updateState) Task=`e6692bd1-c0ff-4dd7-ad64-7789f95cf5e7`::moving from state init -> state preparing >Thread-53464::INFO::2014-05-16 17:14:19,298::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53464::INFO::2014-05-16 17:14:19,299::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53464::DEBUG::2014-05-16 17:14:19,299::task::1168::TaskManager.Task::(prepare) Task=`e6692bd1-c0ff-4dd7-ad64-7789f95cf5e7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53464::DEBUG::2014-05-16 17:14:19,299::task::579::TaskManager.Task::(_updateState) Task=`e6692bd1-c0ff-4dd7-ad64-7789f95cf5e7`::moving from state preparing -> state finished >Thread-53464::DEBUG::2014-05-16 17:14:19,299::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53464::DEBUG::2014-05-16 17:14:19,299::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53464::DEBUG::2014-05-16 17:14:19,300::task::974::TaskManager.Task::(_decref) Task=`e6692bd1-c0ff-4dd7-ad64-7789f95cf5e7`::ref 0 aborting False >Thread-53465::DEBUG::2014-05-16 17:14:19,308::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53465::DEBUG::2014-05-16 17:14:19,309::task::579::TaskManager.Task::(_updateState) Task=`fec839a5-958c-48c2-8ee6-3fcb2e7fdcae`::moving from state init -> state preparing >Thread-53465::INFO::2014-05-16 17:14:19,309::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53465::DEBUG::2014-05-16 17:14:19,309::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f722d945-a75e-41f5-ab4c-41af3287d15a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53465::DEBUG::2014-05-16 17:14:19,309::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53465::DEBUG::2014-05-16 17:14:19,310::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53465::DEBUG::2014-05-16 17:14:19,310::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f722d945-a75e-41f5-ab4c-41af3287d15a`::Granted request >Thread-53465::DEBUG::2014-05-16 17:14:19,310::task::811::TaskManager.Task::(resourceAcquired) Task=`fec839a5-958c-48c2-8ee6-3fcb2e7fdcae`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53465::DEBUG::2014-05-16 17:14:19,310::task::974::TaskManager.Task::(_decref) Task=`fec839a5-958c-48c2-8ee6-3fcb2e7fdcae`::ref 1 aborting False >Thread-53465::INFO::2014-05-16 17:14:19,311::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53465::DEBUG::2014-05-16 17:14:19,311::task::1168::TaskManager.Task::(prepare) Task=`fec839a5-958c-48c2-8ee6-3fcb2e7fdcae`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53465::DEBUG::2014-05-16 17:14:19,311::task::579::TaskManager.Task::(_updateState) Task=`fec839a5-958c-48c2-8ee6-3fcb2e7fdcae`::moving from state preparing -> state finished >Thread-53465::DEBUG::2014-05-16 17:14:19,311::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53465::DEBUG::2014-05-16 17:14:19,312::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53465::DEBUG::2014-05-16 17:14:19,312::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53465::DEBUG::2014-05-16 17:14:19,312::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53465::DEBUG::2014-05-16 17:14:19,312::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53465::DEBUG::2014-05-16 17:14:19,312::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53465::DEBUG::2014-05-16 17:14:19,313::task::974::TaskManager.Task::(_decref) Task=`fec839a5-958c-48c2-8ee6-3fcb2e7fdcae`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:14:20,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:20,506::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348506 s, 29.4 MB/s\n'; <rc> = 0 >Thread-53467::DEBUG::2014-05-16 17:14:22,457::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5418517.000000 / 8.008248 / 262500000.000000 = 0.257759 >Thread-53467::DEBUG::2014-05-16 17:14:22,457::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065689416323797822, 'statsAge': 0.57173490524291992, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25775886673225867, 'rxDropped': 0} >Thread-53467::DEBUG::2014-05-16 17:14:22,458::task::579::TaskManager.Task::(_updateState) Task=`daf6b92f-13a6-4ee5-b92e-ae1b5522e44a`::moving from state init -> state preparing >Thread-53467::INFO::2014-05-16 17:14:22,458::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53467::INFO::2014-05-16 17:14:22,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601736', 'lastCheck': '7.2', 'valid': True}} >Thread-53467::DEBUG::2014-05-16 17:14:22,458::task::1168::TaskManager.Task::(prepare) Task=`daf6b92f-13a6-4ee5-b92e-ae1b5522e44a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601736', 'lastCheck': '7.2', 'valid': True}} >Thread-53467::DEBUG::2014-05-16 17:14:22,459::task::579::TaskManager.Task::(_updateState) Task=`daf6b92f-13a6-4ee5-b92e-ae1b5522e44a`::moving from state preparing -> state finished >Thread-53467::DEBUG::2014-05-16 17:14:22,459::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53467::DEBUG::2014-05-16 17:14:22,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53467::DEBUG::2014-05-16 17:14:22,459::task::974::TaskManager.Task::(_decref) Task=`daf6b92f-13a6-4ee5-b92e-ae1b5522e44a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:14:22,518::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:22,583::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029756 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:24,595::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:24,663::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314833 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:14:25,289::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:14:25,300::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000815381 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:26,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:26,745::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034851 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:28,756::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:28,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307374 s, 33.3 MB/s\n'; <rc> = 0 >Thread-53471::DEBUG::2014-05-16 17:14:29,353::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53471::DEBUG::2014-05-16 17:14:29,354::task::579::TaskManager.Task::(_updateState) Task=`c8d855cb-b659-4af9-b8dd-8c903817ee76`::moving from state init -> state preparing >Thread-53471::INFO::2014-05-16 17:14:29,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53471::INFO::2014-05-16 17:14:29,354::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53471::DEBUG::2014-05-16 17:14:29,354::task::1168::TaskManager.Task::(prepare) Task=`c8d855cb-b659-4af9-b8dd-8c903817ee76`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53471::DEBUG::2014-05-16 17:14:29,355::task::579::TaskManager.Task::(_updateState) Task=`c8d855cb-b659-4af9-b8dd-8c903817ee76`::moving from state preparing -> state finished >Thread-53471::DEBUG::2014-05-16 17:14:29,355::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53471::DEBUG::2014-05-16 17:14:29,355::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53471::DEBUG::2014-05-16 17:14:29,355::task::974::TaskManager.Task::(_decref) Task=`c8d855cb-b659-4af9-b8dd-8c903817ee76`::ref 0 aborting False >Thread-53472::DEBUG::2014-05-16 17:14:29,364::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53472::DEBUG::2014-05-16 17:14:29,364::task::579::TaskManager.Task::(_updateState) Task=`73479d00-cee0-4f11-aa36-8d49a549fe5d`::moving from state init -> state preparing >Thread-53472::INFO::2014-05-16 17:14:29,364::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53472::DEBUG::2014-05-16 17:14:29,365::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`087f6d7c-05e6-4613-a829-b52c3d908bb7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53472::DEBUG::2014-05-16 17:14:29,365::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53472::DEBUG::2014-05-16 17:14:29,365::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53472::DEBUG::2014-05-16 17:14:29,365::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`087f6d7c-05e6-4613-a829-b52c3d908bb7`::Granted request >Thread-53472::DEBUG::2014-05-16 17:14:29,366::task::811::TaskManager.Task::(resourceAcquired) Task=`73479d00-cee0-4f11-aa36-8d49a549fe5d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53472::DEBUG::2014-05-16 17:14:29,366::task::974::TaskManager.Task::(_decref) Task=`73479d00-cee0-4f11-aa36-8d49a549fe5d`::ref 1 aborting False >Thread-53472::INFO::2014-05-16 17:14:29,367::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53472::DEBUG::2014-05-16 17:14:29,367::task::1168::TaskManager.Task::(prepare) Task=`73479d00-cee0-4f11-aa36-8d49a549fe5d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53472::DEBUG::2014-05-16 17:14:29,367::task::579::TaskManager.Task::(_updateState) Task=`73479d00-cee0-4f11-aa36-8d49a549fe5d`::moving from state preparing -> state finished >Thread-53472::DEBUG::2014-05-16 17:14:29,367::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53472::DEBUG::2014-05-16 17:14:29,367::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53472::DEBUG::2014-05-16 17:14:29,367::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53472::DEBUG::2014-05-16 17:14:29,368::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53472::DEBUG::2014-05-16 17:14:29,368::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53472::DEBUG::2014-05-16 17:14:29,368::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53472::DEBUG::2014-05-16 17:14:29,368::task::974::TaskManager.Task::(_decref) Task=`73479d00-cee0-4f11-aa36-8d49a549fe5d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:14:30,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:30,902::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030701 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:32,914::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:32,986::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358241 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:34,998::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:35,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350325 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:14:35,338::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:14:35,348::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000799187 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:37,080::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:37,147::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304568 s, 33.6 MB/s\n'; <rc> = 0 >Thread-53475::DEBUG::2014-05-16 17:14:37,644::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314342.000000 / 8.008153 / 262500000.000000 = 0.205236 >Thread-53475::DEBUG::2014-05-16 17:14:37,645::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054598643133282236, 'statsAge': 1.7442970275878906, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20523569729462349, 'rxDropped': 0} >Thread-53475::DEBUG::2014-05-16 17:14:37,645::task::579::TaskManager.Task::(_updateState) Task=`29a49655-c573-42fc-a852-aa173de22f3b`::moving from state init -> state preparing >Thread-53475::INFO::2014-05-16 17:14:37,645::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53475::INFO::2014-05-16 17:14:37,646::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799187', 'lastCheck': '2.3', 'valid': True}} >Thread-53475::DEBUG::2014-05-16 17:14:37,646::task::1168::TaskManager.Task::(prepare) Task=`29a49655-c573-42fc-a852-aa173de22f3b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799187', 'lastCheck': '2.3', 'valid': True}} >Thread-53475::DEBUG::2014-05-16 17:14:37,646::task::579::TaskManager.Task::(_updateState) Task=`29a49655-c573-42fc-a852-aa173de22f3b`::moving from state preparing -> state finished >Thread-53475::DEBUG::2014-05-16 17:14:37,646::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53475::DEBUG::2014-05-16 17:14:37,646::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53475::DEBUG::2014-05-16 17:14:37,647::task::974::TaskManager.Task::(_decref) Task=`29a49655-c573-42fc-a852-aa173de22f3b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:14:39,158::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:39,230::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357644 s, 28.6 MB/s\n'; <rc> = 0 >Thread-53477::DEBUG::2014-05-16 17:14:39,410::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53477::DEBUG::2014-05-16 17:14:39,411::task::579::TaskManager.Task::(_updateState) Task=`2e2909bf-5721-465a-a483-8d26e1d134c5`::moving from state init -> state preparing >Thread-53477::INFO::2014-05-16 17:14:39,411::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53477::INFO::2014-05-16 17:14:39,411::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53477::DEBUG::2014-05-16 17:14:39,411::task::1168::TaskManager.Task::(prepare) Task=`2e2909bf-5721-465a-a483-8d26e1d134c5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53477::DEBUG::2014-05-16 17:14:39,411::task::579::TaskManager.Task::(_updateState) Task=`2e2909bf-5721-465a-a483-8d26e1d134c5`::moving from state preparing -> state finished >Thread-53477::DEBUG::2014-05-16 17:14:39,412::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53477::DEBUG::2014-05-16 17:14:39,412::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53477::DEBUG::2014-05-16 17:14:39,412::task::974::TaskManager.Task::(_decref) Task=`2e2909bf-5721-465a-a483-8d26e1d134c5`::ref 0 aborting False >Thread-53478::DEBUG::2014-05-16 17:14:39,420::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53478::DEBUG::2014-05-16 17:14:39,421::task::579::TaskManager.Task::(_updateState) Task=`474d5592-f8d1-46e4-acf5-3d3b64369cfb`::moving from state init -> state preparing >Thread-53478::INFO::2014-05-16 17:14:39,421::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53478::DEBUG::2014-05-16 17:14:39,421::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cd0512b8-1719-4530-9b4e-de355c52ba5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53478::DEBUG::2014-05-16 17:14:39,421::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53478::DEBUG::2014-05-16 17:14:39,421::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53478::DEBUG::2014-05-16 17:14:39,422::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cd0512b8-1719-4530-9b4e-de355c52ba5f`::Granted request >Thread-53478::DEBUG::2014-05-16 17:14:39,422::task::811::TaskManager.Task::(resourceAcquired) Task=`474d5592-f8d1-46e4-acf5-3d3b64369cfb`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53478::DEBUG::2014-05-16 17:14:39,422::task::974::TaskManager.Task::(_decref) Task=`474d5592-f8d1-46e4-acf5-3d3b64369cfb`::ref 1 aborting False >Thread-53478::INFO::2014-05-16 17:14:39,423::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53478::DEBUG::2014-05-16 17:14:39,423::task::1168::TaskManager.Task::(prepare) Task=`474d5592-f8d1-46e4-acf5-3d3b64369cfb`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53478::DEBUG::2014-05-16 17:14:39,423::task::579::TaskManager.Task::(_updateState) Task=`474d5592-f8d1-46e4-acf5-3d3b64369cfb`::moving from state preparing -> state finished >Thread-53478::DEBUG::2014-05-16 17:14:39,423::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53478::DEBUG::2014-05-16 17:14:39,423::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53478::DEBUG::2014-05-16 17:14:39,423::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53478::DEBUG::2014-05-16 17:14:39,424::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53478::DEBUG::2014-05-16 17:14:39,424::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53478::DEBUG::2014-05-16 17:14:39,424::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53478::DEBUG::2014-05-16 17:14:39,424::task::974::TaskManager.Task::(_decref) Task=`474d5592-f8d1-46e4-acf5-3d3b64369cfb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:14:41,241::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:41,312::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348338 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:43,324::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:43,391::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310247 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:14:45,384::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:14:45,395::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105997 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:45,404::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:45,524::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0826857 s, 12.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:47,536::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:47,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351735 s, 29.1 MB/s\n'; <rc> = 0 >Thread-53482::DEBUG::2014-05-16 17:14:49,487::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53482::DEBUG::2014-05-16 17:14:49,487::task::579::TaskManager.Task::(_updateState) Task=`304d61bd-8696-4f40-891c-7911c2fb730e`::moving from state init -> state preparing >Thread-53482::INFO::2014-05-16 17:14:49,488::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53482::INFO::2014-05-16 17:14:49,488::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53482::DEBUG::2014-05-16 17:14:49,488::task::1168::TaskManager.Task::(prepare) Task=`304d61bd-8696-4f40-891c-7911c2fb730e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53482::DEBUG::2014-05-16 17:14:49,488::task::579::TaskManager.Task::(_updateState) Task=`304d61bd-8696-4f40-891c-7911c2fb730e`::moving from state preparing -> state finished >Thread-53482::DEBUG::2014-05-16 17:14:49,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53482::DEBUG::2014-05-16 17:14:49,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53482::DEBUG::2014-05-16 17:14:49,489::task::974::TaskManager.Task::(_decref) Task=`304d61bd-8696-4f40-891c-7911c2fb730e`::ref 0 aborting False >Thread-53483::DEBUG::2014-05-16 17:14:49,497::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53483::DEBUG::2014-05-16 17:14:49,497::task::579::TaskManager.Task::(_updateState) Task=`dcac5b4b-4944-4bb9-9e00-afe1c461499f`::moving from state init -> state preparing >Thread-53483::INFO::2014-05-16 17:14:49,498::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53483::DEBUG::2014-05-16 17:14:49,498::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`12dea303-a724-4c5b-8654-a22162db03d2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53483::DEBUG::2014-05-16 17:14:49,498::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53483::DEBUG::2014-05-16 17:14:49,498::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53483::DEBUG::2014-05-16 17:14:49,498::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`12dea303-a724-4c5b-8654-a22162db03d2`::Granted request >Thread-53483::DEBUG::2014-05-16 17:14:49,499::task::811::TaskManager.Task::(resourceAcquired) Task=`dcac5b4b-4944-4bb9-9e00-afe1c461499f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53483::DEBUG::2014-05-16 17:14:49,499::task::974::TaskManager.Task::(_decref) Task=`dcac5b4b-4944-4bb9-9e00-afe1c461499f`::ref 1 aborting False >Thread-53483::INFO::2014-05-16 17:14:49,499::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53483::DEBUG::2014-05-16 17:14:49,499::task::1168::TaskManager.Task::(prepare) Task=`dcac5b4b-4944-4bb9-9e00-afe1c461499f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53483::DEBUG::2014-05-16 17:14:49,500::task::579::TaskManager.Task::(_updateState) Task=`dcac5b4b-4944-4bb9-9e00-afe1c461499f`::moving from state preparing -> state finished >Thread-53483::DEBUG::2014-05-16 17:14:49,500::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53483::DEBUG::2014-05-16 17:14:49,500::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53483::DEBUG::2014-05-16 17:14:49,500::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53483::DEBUG::2014-05-16 17:14:49,500::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53483::DEBUG::2014-05-16 17:14:49,500::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53483::DEBUG::2014-05-16 17:14:49,500::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53483::DEBUG::2014-05-16 17:14:49,501::task::974::TaskManager.Task::(_decref) Task=`dcac5b4b-4944-4bb9-9e00-afe1c461499f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:14:49,618::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:49,697::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308293 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:51,712::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:51,779::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302717 s, 33.8 MB/s\n'; <rc> = 0 >Thread-53485::DEBUG::2014-05-16 17:14:52,796::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314787.000000 / 8.008513 / 262500000.000000 = 0.205248 >Thread-53485::DEBUG::2014-05-16 17:14:52,797::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005294080739395253, 'statsAge': 0.87955999374389648, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20524763914760027, 'rxDropped': 0} >Thread-53485::DEBUG::2014-05-16 17:14:52,797::task::579::TaskManager.Task::(_updateState) Task=`11f73918-8461-45b0-af96-d456d099145b`::moving from state init -> state preparing >Thread-53485::INFO::2014-05-16 17:14:52,797::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53485::INFO::2014-05-16 17:14:52,798::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105997', 'lastCheck': '7.3', 'valid': True}} >Thread-53485::DEBUG::2014-05-16 17:14:52,798::task::1168::TaskManager.Task::(prepare) Task=`11f73918-8461-45b0-af96-d456d099145b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105997', 'lastCheck': '7.3', 'valid': True}} >Thread-53485::DEBUG::2014-05-16 17:14:52,798::task::579::TaskManager.Task::(_updateState) Task=`11f73918-8461-45b0-af96-d456d099145b`::moving from state preparing -> state finished >Thread-53485::DEBUG::2014-05-16 17:14:52,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53485::DEBUG::2014-05-16 17:14:52,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53485::DEBUG::2014-05-16 17:14:52,798::task::974::TaskManager.Task::(_decref) Task=`11f73918-8461-45b0-af96-d456d099145b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:14:53,791::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:53,862::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354632 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:14:55,491::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:14:55,502::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103371 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:55,875::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:55,949::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338424 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:14:57,961::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:14:58,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309297 s, 33.1 MB/s\n'; <rc> = 0 >Thread-53489::DEBUG::2014-05-16 17:14:59,562::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53489::DEBUG::2014-05-16 17:14:59,563::task::579::TaskManager.Task::(_updateState) Task=`5d836732-0167-443d-9920-837a64716522`::moving from state init -> state preparing >Thread-53489::INFO::2014-05-16 17:14:59,564::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53489::INFO::2014-05-16 17:14:59,564::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53489::DEBUG::2014-05-16 17:14:59,564::task::1168::TaskManager.Task::(prepare) Task=`5d836732-0167-443d-9920-837a64716522`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53489::DEBUG::2014-05-16 17:14:59,564::task::579::TaskManager.Task::(_updateState) Task=`5d836732-0167-443d-9920-837a64716522`::moving from state preparing -> state finished >Thread-53489::DEBUG::2014-05-16 17:14:59,565::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53489::DEBUG::2014-05-16 17:14:59,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53489::DEBUG::2014-05-16 17:14:59,565::task::974::TaskManager.Task::(_decref) Task=`5d836732-0167-443d-9920-837a64716522`::ref 0 aborting False >Thread-53490::DEBUG::2014-05-16 17:14:59,573::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53490::DEBUG::2014-05-16 17:14:59,574::task::579::TaskManager.Task::(_updateState) Task=`172b15b9-9035-439e-8289-fad407af294b`::moving from state init -> state preparing >Thread-53490::INFO::2014-05-16 17:14:59,574::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53490::DEBUG::2014-05-16 17:14:59,574::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5790b417-b2a7-448e-a513-21b572dbd3ff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53490::DEBUG::2014-05-16 17:14:59,574::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53490::DEBUG::2014-05-16 17:14:59,575::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53490::DEBUG::2014-05-16 17:14:59,575::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5790b417-b2a7-448e-a513-21b572dbd3ff`::Granted request >Thread-53490::DEBUG::2014-05-16 17:14:59,575::task::811::TaskManager.Task::(resourceAcquired) Task=`172b15b9-9035-439e-8289-fad407af294b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53490::DEBUG::2014-05-16 17:14:59,575::task::974::TaskManager.Task::(_decref) Task=`172b15b9-9035-439e-8289-fad407af294b`::ref 1 aborting False >Thread-53490::INFO::2014-05-16 17:14:59,576::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53490::DEBUG::2014-05-16 17:14:59,576::task::1168::TaskManager.Task::(prepare) Task=`172b15b9-9035-439e-8289-fad407af294b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53490::DEBUG::2014-05-16 17:14:59,576::task::579::TaskManager.Task::(_updateState) Task=`172b15b9-9035-439e-8289-fad407af294b`::moving from state preparing -> state finished >Thread-53490::DEBUG::2014-05-16 17:14:59,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53490::DEBUG::2014-05-16 17:14:59,577::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53490::DEBUG::2014-05-16 17:14:59,577::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53490::DEBUG::2014-05-16 17:14:59,577::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53490::DEBUG::2014-05-16 17:14:59,577::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53490::DEBUG::2014-05-16 17:14:59,577::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53490::DEBUG::2014-05-16 17:14:59,578::task::974::TaskManager.Task::(_decref) Task=`172b15b9-9035-439e-8289-fad407af294b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:15:00,040::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:00,111::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349413 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:02,123::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:02,190::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309825 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:04,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:04,267::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306727 s, 33.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:15:05,537::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:15:05,548::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000969503 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:06,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:06,416::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344557 s, 29.7 MB/s\n'; <rc> = 0 >Thread-53493::DEBUG::2014-05-16 17:15:07,951::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5414448.000000 / 8.008431 / 262500000.000000 = 0.257559 >Thread-53493::DEBUG::2014-05-16 17:15:07,951::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0063480718640169043, 'statsAge': 0.014520168304443359, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25755942306468788, 'rxDropped': 0} >Thread-53493::DEBUG::2014-05-16 17:15:07,952::task::579::TaskManager.Task::(_updateState) Task=`ee6d8288-6643-40c4-9154-76e12692a4a5`::moving from state init -> state preparing >Thread-53493::INFO::2014-05-16 17:15:07,952::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53493::INFO::2014-05-16 17:15:07,952::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000969503', 'lastCheck': '2.4', 'valid': True}} >Thread-53493::DEBUG::2014-05-16 17:15:07,952::task::1168::TaskManager.Task::(prepare) Task=`ee6d8288-6643-40c4-9154-76e12692a4a5`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000969503', 'lastCheck': '2.4', 'valid': True}} >Thread-53493::DEBUG::2014-05-16 17:15:07,953::task::579::TaskManager.Task::(_updateState) Task=`ee6d8288-6643-40c4-9154-76e12692a4a5`::moving from state preparing -> state finished >Thread-53493::DEBUG::2014-05-16 17:15:07,953::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53493::DEBUG::2014-05-16 17:15:07,953::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53493::DEBUG::2014-05-16 17:15:07,953::task::974::TaskManager.Task::(_decref) Task=`ee6d8288-6643-40c4-9154-76e12692a4a5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:15:08,423::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:08,490::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317073 s, 32.3 MB/s\n'; <rc> = 0 >Thread-53495::DEBUG::2014-05-16 17:15:09,630::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53495::DEBUG::2014-05-16 17:15:09,631::task::579::TaskManager.Task::(_updateState) Task=`b5043385-6f1a-45b5-81f2-a89205e3f087`::moving from state init -> state preparing >Thread-53495::INFO::2014-05-16 17:15:09,631::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53495::INFO::2014-05-16 17:15:09,632::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53495::DEBUG::2014-05-16 17:15:09,632::task::1168::TaskManager.Task::(prepare) Task=`b5043385-6f1a-45b5-81f2-a89205e3f087`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53495::DEBUG::2014-05-16 17:15:09,632::task::579::TaskManager.Task::(_updateState) Task=`b5043385-6f1a-45b5-81f2-a89205e3f087`::moving from state preparing -> state finished >Thread-53495::DEBUG::2014-05-16 17:15:09,632::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53495::DEBUG::2014-05-16 17:15:09,632::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53495::DEBUG::2014-05-16 17:15:09,632::task::974::TaskManager.Task::(_decref) Task=`b5043385-6f1a-45b5-81f2-a89205e3f087`::ref 0 aborting False >Thread-53496::DEBUG::2014-05-16 17:15:09,641::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53496::DEBUG::2014-05-16 17:15:09,641::task::579::TaskManager.Task::(_updateState) Task=`6dc065ff-719c-49e3-99ac-714c1fc485c5`::moving from state init -> state preparing >Thread-53496::INFO::2014-05-16 17:15:09,642::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53496::DEBUG::2014-05-16 17:15:09,642::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`67bd159c-e530-4692-aedb-002c444251f8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53496::DEBUG::2014-05-16 17:15:09,642::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53496::DEBUG::2014-05-16 17:15:09,642::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53496::DEBUG::2014-05-16 17:15:09,642::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`67bd159c-e530-4692-aedb-002c444251f8`::Granted request >Thread-53496::DEBUG::2014-05-16 17:15:09,643::task::811::TaskManager.Task::(resourceAcquired) Task=`6dc065ff-719c-49e3-99ac-714c1fc485c5`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53496::DEBUG::2014-05-16 17:15:09,643::task::974::TaskManager.Task::(_decref) Task=`6dc065ff-719c-49e3-99ac-714c1fc485c5`::ref 1 aborting False >Thread-53496::INFO::2014-05-16 17:15:09,643::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53496::DEBUG::2014-05-16 17:15:09,644::task::1168::TaskManager.Task::(prepare) Task=`6dc065ff-719c-49e3-99ac-714c1fc485c5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53496::DEBUG::2014-05-16 17:15:09,644::task::579::TaskManager.Task::(_updateState) Task=`6dc065ff-719c-49e3-99ac-714c1fc485c5`::moving from state preparing -> state finished >Thread-53496::DEBUG::2014-05-16 17:15:09,644::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53496::DEBUG::2014-05-16 17:15:09,644::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53496::DEBUG::2014-05-16 17:15:09,644::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53496::DEBUG::2014-05-16 17:15:09,644::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53496::DEBUG::2014-05-16 17:15:09,644::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53496::DEBUG::2014-05-16 17:15:09,645::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53496::DEBUG::2014-05-16 17:15:09,645::task::974::TaskManager.Task::(_decref) Task=`6dc065ff-719c-49e3-99ac-714c1fc485c5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:15:10,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:10,573::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349829 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:12,585::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:12,651::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309671 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:14,663::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:14,734::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353302 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:15:15,582::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:15:15,592::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000807271 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:16,746::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:16,817::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034366 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:18,829::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:18,896::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306458 s, 33.4 MB/s\n'; <rc> = 0 >Thread-53500::DEBUG::2014-05-16 17:15:19,684::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53500::DEBUG::2014-05-16 17:15:19,685::task::579::TaskManager.Task::(_updateState) Task=`2d6669a9-34f9-49c7-a400-c9e1bee55f33`::moving from state init -> state preparing >Thread-53500::INFO::2014-05-16 17:15:19,685::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53500::INFO::2014-05-16 17:15:19,685::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53500::DEBUG::2014-05-16 17:15:19,685::task::1168::TaskManager.Task::(prepare) Task=`2d6669a9-34f9-49c7-a400-c9e1bee55f33`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53500::DEBUG::2014-05-16 17:15:19,685::task::579::TaskManager.Task::(_updateState) Task=`2d6669a9-34f9-49c7-a400-c9e1bee55f33`::moving from state preparing -> state finished >Thread-53500::DEBUG::2014-05-16 17:15:19,686::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53500::DEBUG::2014-05-16 17:15:19,686::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53500::DEBUG::2014-05-16 17:15:19,686::task::974::TaskManager.Task::(_decref) Task=`2d6669a9-34f9-49c7-a400-c9e1bee55f33`::ref 0 aborting False >Thread-53501::DEBUG::2014-05-16 17:15:19,695::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53501::DEBUG::2014-05-16 17:15:19,696::task::579::TaskManager.Task::(_updateState) Task=`9da41d75-037f-4683-b6d5-4be6e5b966cd`::moving from state init -> state preparing >Thread-53501::INFO::2014-05-16 17:15:19,696::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53501::DEBUG::2014-05-16 17:15:19,696::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`601b4b37-b7b8-4170-a380-45f6d51766e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53501::DEBUG::2014-05-16 17:15:19,696::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53501::DEBUG::2014-05-16 17:15:19,697::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53501::DEBUG::2014-05-16 17:15:19,697::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`601b4b37-b7b8-4170-a380-45f6d51766e1`::Granted request >Thread-53501::DEBUG::2014-05-16 17:15:19,697::task::811::TaskManager.Task::(resourceAcquired) Task=`9da41d75-037f-4683-b6d5-4be6e5b966cd`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53501::DEBUG::2014-05-16 17:15:19,697::task::974::TaskManager.Task::(_decref) Task=`9da41d75-037f-4683-b6d5-4be6e5b966cd`::ref 1 aborting False >Thread-53501::INFO::2014-05-16 17:15:19,698::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53501::DEBUG::2014-05-16 17:15:19,698::task::1168::TaskManager.Task::(prepare) Task=`9da41d75-037f-4683-b6d5-4be6e5b966cd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53501::DEBUG::2014-05-16 17:15:19,698::task::579::TaskManager.Task::(_updateState) Task=`9da41d75-037f-4683-b6d5-4be6e5b966cd`::moving from state preparing -> state finished >Thread-53501::DEBUG::2014-05-16 17:15:19,698::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53501::DEBUG::2014-05-16 17:15:19,699::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53501::DEBUG::2014-05-16 17:15:19,699::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53501::DEBUG::2014-05-16 17:15:19,699::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53501::DEBUG::2014-05-16 17:15:19,699::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53501::DEBUG::2014-05-16 17:15:19,699::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53501::DEBUG::2014-05-16 17:15:19,699::task::974::TaskManager.Task::(_decref) Task=`9da41d75-037f-4683-b6d5-4be6e5b966cd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:15:20,907::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:20,977::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348123 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:22,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:23,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318706 s, 32.1 MB/s\n'; <rc> = 0 >Thread-53503::DEBUG::2014-05-16 17:15:23,115::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313367.000000 / 8.008493 / 262500000.000000 = 0.205181 >Thread-53503::DEBUG::2014-05-16 17:15:23,115::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053866622125138498, 'statsAge': 1.1629509925842285, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20518059897213201, 'rxDropped': 0} >Thread-53503::DEBUG::2014-05-16 17:15:23,115::task::579::TaskManager.Task::(_updateState) Task=`9617dcd9-29f9-42ec-bec1-ca6401dba9bd`::moving from state init -> state preparing >Thread-53503::INFO::2014-05-16 17:15:23,116::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53503::INFO::2014-05-16 17:15:23,116::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807271', 'lastCheck': '7.5', 'valid': True}} >Thread-53503::DEBUG::2014-05-16 17:15:23,116::task::1168::TaskManager.Task::(prepare) Task=`9617dcd9-29f9-42ec-bec1-ca6401dba9bd`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807271', 'lastCheck': '7.5', 'valid': True}} >Thread-53503::DEBUG::2014-05-16 17:15:23,116::task::579::TaskManager.Task::(_updateState) Task=`9617dcd9-29f9-42ec-bec1-ca6401dba9bd`::moving from state preparing -> state finished >Thread-53503::DEBUG::2014-05-16 17:15:23,116::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53503::DEBUG::2014-05-16 17:15:23,116::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53503::DEBUG::2014-05-16 17:15:23,117::task::974::TaskManager.Task::(_decref) Task=`9617dcd9-29f9-42ec-bec1-ca6401dba9bd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:15:25,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:25,139::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346083 s, 29.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:15:25,628::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:15:25,638::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000738547 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:27,151::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:27,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347355 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:29,233::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:29,301::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307872 s, 33.3 MB/s\n'; <rc> = 0 >Thread-53507::DEBUG::2014-05-16 17:15:29,736::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53507::DEBUG::2014-05-16 17:15:29,736::task::579::TaskManager.Task::(_updateState) Task=`eaacb2ee-dfb5-4204-a66e-91e2ebd15e3f`::moving from state init -> state preparing >Thread-53507::INFO::2014-05-16 17:15:29,737::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53507::INFO::2014-05-16 17:15:29,737::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53507::DEBUG::2014-05-16 17:15:29,737::task::1168::TaskManager.Task::(prepare) Task=`eaacb2ee-dfb5-4204-a66e-91e2ebd15e3f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53507::DEBUG::2014-05-16 17:15:29,737::task::579::TaskManager.Task::(_updateState) Task=`eaacb2ee-dfb5-4204-a66e-91e2ebd15e3f`::moving from state preparing -> state finished >Thread-53507::DEBUG::2014-05-16 17:15:29,737::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53507::DEBUG::2014-05-16 17:15:29,738::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53507::DEBUG::2014-05-16 17:15:29,738::task::974::TaskManager.Task::(_decref) Task=`eaacb2ee-dfb5-4204-a66e-91e2ebd15e3f`::ref 0 aborting False >Thread-53508::DEBUG::2014-05-16 17:15:29,747::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53508::DEBUG::2014-05-16 17:15:29,747::task::579::TaskManager.Task::(_updateState) Task=`13e6aa33-261d-4339-841c-2c4fd30fd5a9`::moving from state init -> state preparing >Thread-53508::INFO::2014-05-16 17:15:29,747::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53508::DEBUG::2014-05-16 17:15:29,747::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`48fdd4db-a847-4ca1-978c-3a8f56f50b7e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53508::DEBUG::2014-05-16 17:15:29,748::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53508::DEBUG::2014-05-16 17:15:29,748::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53508::DEBUG::2014-05-16 17:15:29,748::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`48fdd4db-a847-4ca1-978c-3a8f56f50b7e`::Granted request >Thread-53508::DEBUG::2014-05-16 17:15:29,748::task::811::TaskManager.Task::(resourceAcquired) Task=`13e6aa33-261d-4339-841c-2c4fd30fd5a9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53508::DEBUG::2014-05-16 17:15:29,748::task::974::TaskManager.Task::(_decref) Task=`13e6aa33-261d-4339-841c-2c4fd30fd5a9`::ref 1 aborting False >Thread-53508::INFO::2014-05-16 17:15:29,749::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53508::DEBUG::2014-05-16 17:15:29,749::task::1168::TaskManager.Task::(prepare) Task=`13e6aa33-261d-4339-841c-2c4fd30fd5a9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53508::DEBUG::2014-05-16 17:15:29,749::task::579::TaskManager.Task::(_updateState) Task=`13e6aa33-261d-4339-841c-2c4fd30fd5a9`::moving from state preparing -> state finished >Thread-53508::DEBUG::2014-05-16 17:15:29,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53508::DEBUG::2014-05-16 17:15:29,750::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53508::DEBUG::2014-05-16 17:15:29,750::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53508::DEBUG::2014-05-16 17:15:29,750::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53508::DEBUG::2014-05-16 17:15:29,750::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53508::DEBUG::2014-05-16 17:15:29,750::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53508::DEBUG::2014-05-16 17:15:29,751::task::974::TaskManager.Task::(_decref) Task=`13e6aa33-261d-4339-841c-2c4fd30fd5a9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:15:31,316::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:31,383::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308348 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:33,394::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:33,465::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342006 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:35,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:35,548::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347385 s, 29.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:15:35,677::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:15:35,687::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000763907 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:37,560::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:37,626::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308893 s, 33.2 MB/s\n'; <rc> = 0 >Thread-53511::DEBUG::2014-05-16 17:15:38,364::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4310783.000000 / 8.013620 / 262500000.000000 = 0.204926 >Thread-53511::DEBUG::2014-05-16 17:15:38,364::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0050227821097334037, 'statsAge': 0.39085602760314941, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20492649616065886, 'rxDropped': 0} >Thread-53511::DEBUG::2014-05-16 17:15:38,365::task::579::TaskManager.Task::(_updateState) Task=`ce63d381-0ab1-4fa5-b31f-b7049fe8a6a4`::moving from state init -> state preparing >Thread-53511::INFO::2014-05-16 17:15:38,365::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53511::INFO::2014-05-16 17:15:38,366::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000763907', 'lastCheck': '2.7', 'valid': True}} >Thread-53511::DEBUG::2014-05-16 17:15:38,366::task::1168::TaskManager.Task::(prepare) Task=`ce63d381-0ab1-4fa5-b31f-b7049fe8a6a4`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000763907', 'lastCheck': '2.7', 'valid': True}} >Thread-53511::DEBUG::2014-05-16 17:15:38,366::task::579::TaskManager.Task::(_updateState) Task=`ce63d381-0ab1-4fa5-b31f-b7049fe8a6a4`::moving from state preparing -> state finished >Thread-53511::DEBUG::2014-05-16 17:15:38,366::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53511::DEBUG::2014-05-16 17:15:38,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53511::DEBUG::2014-05-16 17:15:38,366::task::974::TaskManager.Task::(_decref) Task=`ce63d381-0ab1-4fa5-b31f-b7049fe8a6a4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:15:39,638::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:39,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308801 s, 33.2 MB/s\n'; <rc> = 0 >Thread-53513::DEBUG::2014-05-16 17:15:39,791::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53513::DEBUG::2014-05-16 17:15:39,791::task::579::TaskManager.Task::(_updateState) Task=`e6636ebd-9ecd-49ff-9ca8-15d186d3beb9`::moving from state init -> state preparing >Thread-53513::INFO::2014-05-16 17:15:39,792::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53513::INFO::2014-05-16 17:15:39,792::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53513::DEBUG::2014-05-16 17:15:39,792::task::1168::TaskManager.Task::(prepare) Task=`e6636ebd-9ecd-49ff-9ca8-15d186d3beb9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53513::DEBUG::2014-05-16 17:15:39,792::task::579::TaskManager.Task::(_updateState) Task=`e6636ebd-9ecd-49ff-9ca8-15d186d3beb9`::moving from state preparing -> state finished >Thread-53513::DEBUG::2014-05-16 17:15:39,793::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53513::DEBUG::2014-05-16 17:15:39,793::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53513::DEBUG::2014-05-16 17:15:39,793::task::974::TaskManager.Task::(_decref) Task=`e6636ebd-9ecd-49ff-9ca8-15d186d3beb9`::ref 0 aborting False >Thread-53514::DEBUG::2014-05-16 17:15:39,802::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53514::DEBUG::2014-05-16 17:15:39,802::task::579::TaskManager.Task::(_updateState) Task=`b06af7d9-b5bd-4b54-972f-67db328c1d9a`::moving from state init -> state preparing >Thread-53514::INFO::2014-05-16 17:15:39,802::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53514::DEBUG::2014-05-16 17:15:39,803::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`32489849-b4a4-42e5-b8fd-d246bf33748f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53514::DEBUG::2014-05-16 17:15:39,803::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53514::DEBUG::2014-05-16 17:15:39,803::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53514::DEBUG::2014-05-16 17:15:39,803::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`32489849-b4a4-42e5-b8fd-d246bf33748f`::Granted request >Thread-53514::DEBUG::2014-05-16 17:15:39,804::task::811::TaskManager.Task::(resourceAcquired) Task=`b06af7d9-b5bd-4b54-972f-67db328c1d9a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53514::DEBUG::2014-05-16 17:15:39,804::task::974::TaskManager.Task::(_decref) Task=`b06af7d9-b5bd-4b54-972f-67db328c1d9a`::ref 1 aborting False >Thread-53514::INFO::2014-05-16 17:15:39,804::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53514::DEBUG::2014-05-16 17:15:39,805::task::1168::TaskManager.Task::(prepare) Task=`b06af7d9-b5bd-4b54-972f-67db328c1d9a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53514::DEBUG::2014-05-16 17:15:39,805::task::579::TaskManager.Task::(_updateState) Task=`b06af7d9-b5bd-4b54-972f-67db328c1d9a`::moving from state preparing -> state finished >Thread-53514::DEBUG::2014-05-16 17:15:39,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53514::DEBUG::2014-05-16 17:15:39,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53514::DEBUG::2014-05-16 17:15:39,805::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53514::DEBUG::2014-05-16 17:15:39,805::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53514::DEBUG::2014-05-16 17:15:39,806::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53514::DEBUG::2014-05-16 17:15:39,806::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53514::DEBUG::2014-05-16 17:15:39,806::task::974::TaskManager.Task::(_decref) Task=`b06af7d9-b5bd-4b54-972f-67db328c1d9a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:15:41,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:41,788::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351141 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:43,800::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:43,867::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303797 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:15:45,722::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:15:45,733::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000964226 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:45,878::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:45,950::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350456 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:47,961::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:48,038::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0404841 s, 25.3 MB/s\n'; <rc> = 0 >Thread-53518::DEBUG::2014-05-16 17:15:49,838::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53518::DEBUG::2014-05-16 17:15:49,840::task::579::TaskManager.Task::(_updateState) Task=`a28026f8-050b-4872-9c81-ed4be50af252`::moving from state init -> state preparing >Thread-53518::INFO::2014-05-16 17:15:49,840::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53518::INFO::2014-05-16 17:15:49,840::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53518::DEBUG::2014-05-16 17:15:49,840::task::1168::TaskManager.Task::(prepare) Task=`a28026f8-050b-4872-9c81-ed4be50af252`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53518::DEBUG::2014-05-16 17:15:49,840::task::579::TaskManager.Task::(_updateState) Task=`a28026f8-050b-4872-9c81-ed4be50af252`::moving from state preparing -> state finished >Thread-53518::DEBUG::2014-05-16 17:15:49,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53518::DEBUG::2014-05-16 17:15:49,841::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53518::DEBUG::2014-05-16 17:15:49,841::task::974::TaskManager.Task::(_decref) Task=`a28026f8-050b-4872-9c81-ed4be50af252`::ref 0 aborting False >Thread-53519::DEBUG::2014-05-16 17:15:49,850::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53519::DEBUG::2014-05-16 17:15:49,851::task::579::TaskManager.Task::(_updateState) Task=`ace3068a-f28b-414c-a5e4-ccb970b60aa0`::moving from state init -> state preparing >Thread-53519::INFO::2014-05-16 17:15:49,851::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53519::DEBUG::2014-05-16 17:15:49,851::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5ab97273-5724-4412-9181-ce718179d236`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53519::DEBUG::2014-05-16 17:15:49,851::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53519::DEBUG::2014-05-16 17:15:49,852::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53519::DEBUG::2014-05-16 17:15:49,852::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5ab97273-5724-4412-9181-ce718179d236`::Granted request >Thread-53519::DEBUG::2014-05-16 17:15:49,852::task::811::TaskManager.Task::(resourceAcquired) Task=`ace3068a-f28b-414c-a5e4-ccb970b60aa0`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53519::DEBUG::2014-05-16 17:15:49,852::task::974::TaskManager.Task::(_decref) Task=`ace3068a-f28b-414c-a5e4-ccb970b60aa0`::ref 1 aborting False >Thread-53519::INFO::2014-05-16 17:15:49,853::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53519::DEBUG::2014-05-16 17:15:49,853::task::1168::TaskManager.Task::(prepare) Task=`ace3068a-f28b-414c-a5e4-ccb970b60aa0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53519::DEBUG::2014-05-16 17:15:49,853::task::579::TaskManager.Task::(_updateState) Task=`ace3068a-f28b-414c-a5e4-ccb970b60aa0`::moving from state preparing -> state finished >Thread-53519::DEBUG::2014-05-16 17:15:49,853::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53519::DEBUG::2014-05-16 17:15:49,853::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53519::DEBUG::2014-05-16 17:15:49,853::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53519::DEBUG::2014-05-16 17:15:49,853::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53519::DEBUG::2014-05-16 17:15:49,854::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53519::DEBUG::2014-05-16 17:15:49,854::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53519::DEBUG::2014-05-16 17:15:49,854::task::974::TaskManager.Task::(_decref) Task=`ace3068a-f28b-414c-a5e4-ccb970b60aa0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:15:50,054::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:50,129::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365607 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:52,141::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:52,208::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310084 s, 33.0 MB/s\n'; <rc> = 0 >Thread-53521::DEBUG::2014-05-16 17:15:53,527::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5316795.000000 / 8.011031 / 262500000.000000 = 0.252832 >Thread-53521::DEBUG::2014-05-16 17:15:53,527::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.00652195948548287, 'statsAge': 1.5357849597930908, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25283209320173455, 'rxDropped': 0} >Thread-53521::DEBUG::2014-05-16 17:15:53,527::task::579::TaskManager.Task::(_updateState) Task=`519bd7eb-c534-4ba7-8a25-caac6ee37c05`::moving from state init -> state preparing >Thread-53521::INFO::2014-05-16 17:15:53,528::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53521::INFO::2014-05-16 17:15:53,528::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000964226', 'lastCheck': '7.8', 'valid': True}} >Thread-53521::DEBUG::2014-05-16 17:15:53,528::task::1168::TaskManager.Task::(prepare) Task=`519bd7eb-c534-4ba7-8a25-caac6ee37c05`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000964226', 'lastCheck': '7.8', 'valid': True}} >Thread-53521::DEBUG::2014-05-16 17:15:53,528::task::579::TaskManager.Task::(_updateState) Task=`519bd7eb-c534-4ba7-8a25-caac6ee37c05`::moving from state preparing -> state finished >Thread-53521::DEBUG::2014-05-16 17:15:53,528::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53521::DEBUG::2014-05-16 17:15:53,528::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53521::DEBUG::2014-05-16 17:15:53,529::task::974::TaskManager.Task::(_decref) Task=`519bd7eb-c534-4ba7-8a25-caac6ee37c05`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:15:54,220::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:54,291::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354522 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:15:55,768::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:15:55,779::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100196 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:56,303::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:56,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035044 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:15:58,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:15:58,455::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033451 s, 30.6 MB/s\n'; <rc> = 0 >Thread-53525::DEBUG::2014-05-16 17:15:59,891::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53525::DEBUG::2014-05-16 17:15:59,892::task::579::TaskManager.Task::(_updateState) Task=`82973328-9deb-4cd3-b549-b0979762cdb1`::moving from state init -> state preparing >Thread-53525::INFO::2014-05-16 17:15:59,892::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53525::INFO::2014-05-16 17:15:59,892::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53525::DEBUG::2014-05-16 17:15:59,892::task::1168::TaskManager.Task::(prepare) Task=`82973328-9deb-4cd3-b549-b0979762cdb1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53525::DEBUG::2014-05-16 17:15:59,892::task::579::TaskManager.Task::(_updateState) Task=`82973328-9deb-4cd3-b549-b0979762cdb1`::moving from state preparing -> state finished >Thread-53525::DEBUG::2014-05-16 17:15:59,893::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53525::DEBUG::2014-05-16 17:15:59,893::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53525::DEBUG::2014-05-16 17:15:59,893::task::974::TaskManager.Task::(_decref) Task=`82973328-9deb-4cd3-b549-b0979762cdb1`::ref 0 aborting False >Thread-53526::DEBUG::2014-05-16 17:15:59,901::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53526::DEBUG::2014-05-16 17:15:59,901::task::579::TaskManager.Task::(_updateState) Task=`73d50cb3-b519-46c5-a5eb-c290c0c24c01`::moving from state init -> state preparing >Thread-53526::INFO::2014-05-16 17:15:59,902::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53526::DEBUG::2014-05-16 17:15:59,902::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e942f543-aa0c-4e3f-9389-8fe8206b412b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53526::DEBUG::2014-05-16 17:15:59,902::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53526::DEBUG::2014-05-16 17:15:59,902::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53526::DEBUG::2014-05-16 17:15:59,903::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e942f543-aa0c-4e3f-9389-8fe8206b412b`::Granted request >Thread-53526::DEBUG::2014-05-16 17:15:59,903::task::811::TaskManager.Task::(resourceAcquired) Task=`73d50cb3-b519-46c5-a5eb-c290c0c24c01`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53526::DEBUG::2014-05-16 17:15:59,903::task::974::TaskManager.Task::(_decref) Task=`73d50cb3-b519-46c5-a5eb-c290c0c24c01`::ref 1 aborting False >Thread-53526::INFO::2014-05-16 17:15:59,904::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53526::DEBUG::2014-05-16 17:15:59,904::task::1168::TaskManager.Task::(prepare) Task=`73d50cb3-b519-46c5-a5eb-c290c0c24c01`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53526::DEBUG::2014-05-16 17:15:59,904::task::579::TaskManager.Task::(_updateState) Task=`73d50cb3-b519-46c5-a5eb-c290c0c24c01`::moving from state preparing -> state finished >Thread-53526::DEBUG::2014-05-16 17:15:59,904::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53526::DEBUG::2014-05-16 17:15:59,904::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53526::DEBUG::2014-05-16 17:15:59,905::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53526::DEBUG::2014-05-16 17:15:59,905::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53526::DEBUG::2014-05-16 17:15:59,905::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53526::DEBUG::2014-05-16 17:15:59,905::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53526::DEBUG::2014-05-16 17:15:59,905::task::974::TaskManager.Task::(_decref) Task=`73d50cb3-b519-46c5-a5eb-c290c0c24c01`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:16:00,467::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:00,534::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311477 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:02,546::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:02,618::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361133 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:04,629::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:04,696::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302966 s, 33.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:16:05,815::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:16:05,826::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746321 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:06,708::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:06,774::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301783 s, 33.9 MB/s\n'; <rc> = 0 >Thread-53529::DEBUG::2014-05-16 17:16:08,684::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5416467.000000 / 8.008412 / 262500000.000000 = 0.257656 >Thread-53529::DEBUG::2014-05-16 17:16:08,684::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0067614616479223736, 'statsAge': 0.67673087120056152, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25765607068901897, 'rxDropped': 0} >Thread-53529::DEBUG::2014-05-16 17:16:08,685::task::579::TaskManager.Task::(_updateState) Task=`990dc307-8079-4770-9ab6-6339a6bd454d`::moving from state init -> state preparing >Thread-53529::INFO::2014-05-16 17:16:08,685::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53529::INFO::2014-05-16 17:16:08,685::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746321', 'lastCheck': '2.8', 'valid': True}} >Thread-53529::DEBUG::2014-05-16 17:16:08,686::task::1168::TaskManager.Task::(prepare) Task=`990dc307-8079-4770-9ab6-6339a6bd454d`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746321', 'lastCheck': '2.8', 'valid': True}} >Thread-53529::DEBUG::2014-05-16 17:16:08,686::task::579::TaskManager.Task::(_updateState) Task=`990dc307-8079-4770-9ab6-6339a6bd454d`::moving from state preparing -> state finished >Thread-53529::DEBUG::2014-05-16 17:16:08,686::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53529::DEBUG::2014-05-16 17:16:08,686::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53529::DEBUG::2014-05-16 17:16:08,686::task::974::TaskManager.Task::(_decref) Task=`990dc307-8079-4770-9ab6-6339a6bd454d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:16:08,786::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:08,858::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363429 s, 28.2 MB/s\n'; <rc> = 0 >Thread-53531::DEBUG::2014-05-16 17:16:09,933::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53531::DEBUG::2014-05-16 17:16:09,934::task::579::TaskManager.Task::(_updateState) Task=`5bcf3585-6f52-4f61-98fe-813d001a1e9f`::moving from state init -> state preparing >Thread-53531::INFO::2014-05-16 17:16:09,934::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53531::INFO::2014-05-16 17:16:09,934::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53531::DEBUG::2014-05-16 17:16:09,934::task::1168::TaskManager.Task::(prepare) Task=`5bcf3585-6f52-4f61-98fe-813d001a1e9f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53531::DEBUG::2014-05-16 17:16:09,935::task::579::TaskManager.Task::(_updateState) Task=`5bcf3585-6f52-4f61-98fe-813d001a1e9f`::moving from state preparing -> state finished >Thread-53531::DEBUG::2014-05-16 17:16:09,935::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53531::DEBUG::2014-05-16 17:16:09,935::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53531::DEBUG::2014-05-16 17:16:09,935::task::974::TaskManager.Task::(_decref) Task=`5bcf3585-6f52-4f61-98fe-813d001a1e9f`::ref 0 aborting False >Thread-53532::DEBUG::2014-05-16 17:16:09,943::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53532::DEBUG::2014-05-16 17:16:09,943::task::579::TaskManager.Task::(_updateState) Task=`e3680f1c-f525-4d35-bb13-0fc496d3c66e`::moving from state init -> state preparing >Thread-53532::INFO::2014-05-16 17:16:09,944::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53532::DEBUG::2014-05-16 17:16:09,944::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c39ac174-e92c-47f8-8723-2e5925469516`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53532::DEBUG::2014-05-16 17:16:09,944::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53532::DEBUG::2014-05-16 17:16:09,944::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53532::DEBUG::2014-05-16 17:16:09,944::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c39ac174-e92c-47f8-8723-2e5925469516`::Granted request >Thread-53532::DEBUG::2014-05-16 17:16:09,945::task::811::TaskManager.Task::(resourceAcquired) Task=`e3680f1c-f525-4d35-bb13-0fc496d3c66e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53532::DEBUG::2014-05-16 17:16:09,945::task::974::TaskManager.Task::(_decref) Task=`e3680f1c-f525-4d35-bb13-0fc496d3c66e`::ref 1 aborting False >Thread-53532::INFO::2014-05-16 17:16:09,946::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53532::DEBUG::2014-05-16 17:16:09,946::task::1168::TaskManager.Task::(prepare) Task=`e3680f1c-f525-4d35-bb13-0fc496d3c66e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53532::DEBUG::2014-05-16 17:16:09,946::task::579::TaskManager.Task::(_updateState) Task=`e3680f1c-f525-4d35-bb13-0fc496d3c66e`::moving from state preparing -> state finished >Thread-53532::DEBUG::2014-05-16 17:16:09,946::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53532::DEBUG::2014-05-16 17:16:09,946::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53532::DEBUG::2014-05-16 17:16:09,946::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53532::DEBUG::2014-05-16 17:16:09,946::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53532::DEBUG::2014-05-16 17:16:09,947::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53532::DEBUG::2014-05-16 17:16:09,947::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53532::DEBUG::2014-05-16 17:16:09,947::task::974::TaskManager.Task::(_decref) Task=`e3680f1c-f525-4d35-bb13-0fc496d3c66e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:16:10,870::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:10,941::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350372 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:12,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:13,021::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314812 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:15,033::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:15,105::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355449 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:16:15,846::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 17:16:15,846::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:16:15,860::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:16:15,869::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000763684 s, 2.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:16:15,869::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000763684 s, 2.7 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 17:16:15,869::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 17:16:15,870::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 17:16:15,870::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:16:15,870::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:16:15,870::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:16:15,871::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:16:15,871::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:16:15,871::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:16:15,872::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:16:16,023::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:16:16,024::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:16:16,024::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 17:16:16,025::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 17:16:16,025::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 17:16:16,026::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 17:16:16,026::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:16:16,169::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:16:16,190::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:16:16,200::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000557279 s, 7.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:17,117::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:17,188::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354668 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:19,200::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:19,268::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03164 s, 32.4 MB/s\n'; <rc> = 0 >Thread-53536::DEBUG::2014-05-16 17:16:19,983::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53536::DEBUG::2014-05-16 17:16:19,984::task::579::TaskManager.Task::(_updateState) Task=`d8db0d56-b56a-493c-9fb1-c711f540762e`::moving from state init -> state preparing >Thread-53536::INFO::2014-05-16 17:16:19,984::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53536::INFO::2014-05-16 17:16:19,984::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53536::DEBUG::2014-05-16 17:16:19,984::task::1168::TaskManager.Task::(prepare) Task=`d8db0d56-b56a-493c-9fb1-c711f540762e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53536::DEBUG::2014-05-16 17:16:19,984::task::579::TaskManager.Task::(_updateState) Task=`d8db0d56-b56a-493c-9fb1-c711f540762e`::moving from state preparing -> state finished >Thread-53536::DEBUG::2014-05-16 17:16:19,985::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53536::DEBUG::2014-05-16 17:16:19,985::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53536::DEBUG::2014-05-16 17:16:19,985::task::974::TaskManager.Task::(_decref) Task=`d8db0d56-b56a-493c-9fb1-c711f540762e`::ref 0 aborting False >Thread-53537::DEBUG::2014-05-16 17:16:19,994::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53537::DEBUG::2014-05-16 17:16:19,994::task::579::TaskManager.Task::(_updateState) Task=`640c77f4-d12b-4c59-9eec-d1679bc479fd`::moving from state init -> state preparing >Thread-53537::INFO::2014-05-16 17:16:19,994::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53537::DEBUG::2014-05-16 17:16:19,995::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9461f348-8f65-45ec-910d-877f825b5111`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53537::DEBUG::2014-05-16 17:16:19,995::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53537::DEBUG::2014-05-16 17:16:19,995::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53537::DEBUG::2014-05-16 17:16:19,995::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9461f348-8f65-45ec-910d-877f825b5111`::Granted request >Thread-53537::DEBUG::2014-05-16 17:16:19,995::task::811::TaskManager.Task::(resourceAcquired) Task=`640c77f4-d12b-4c59-9eec-d1679bc479fd`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53537::DEBUG::2014-05-16 17:16:19,996::task::974::TaskManager.Task::(_decref) Task=`640c77f4-d12b-4c59-9eec-d1679bc479fd`::ref 1 aborting False >Thread-53537::INFO::2014-05-16 17:16:19,996::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53537::DEBUG::2014-05-16 17:16:19,996::task::1168::TaskManager.Task::(prepare) Task=`640c77f4-d12b-4c59-9eec-d1679bc479fd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53537::DEBUG::2014-05-16 17:16:19,997::task::579::TaskManager.Task::(_updateState) Task=`640c77f4-d12b-4c59-9eec-d1679bc479fd`::moving from state preparing -> state finished >Thread-53537::DEBUG::2014-05-16 17:16:19,997::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53537::DEBUG::2014-05-16 17:16:19,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53537::DEBUG::2014-05-16 17:16:19,997::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53537::DEBUG::2014-05-16 17:16:19,997::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53537::DEBUG::2014-05-16 17:16:19,997::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53537::DEBUG::2014-05-16 17:16:19,998::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53537::DEBUG::2014-05-16 17:16:19,998::task::974::TaskManager.Task::(_decref) Task=`640c77f4-d12b-4c59-9eec-d1679bc479fd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:16:21,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:21,351::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353227 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:23,362::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:23,430::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313566 s, 32.7 MB/s\n'; <rc> = 0 >Thread-53539::DEBUG::2014-05-16 17:16:23,842::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4438039.000000 / 8.008725 / 262500000.000000 = 0.211105 >Thread-53539::DEBUG::2014-05-16 17:16:23,842::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0058779703439481596, 'statsAge': 1.8190820217132568, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.21110495603603846, 'rxDropped': 0} >Thread-53539::DEBUG::2014-05-16 17:16:23,842::task::579::TaskManager.Task::(_updateState) Task=`4bff4886-9fd9-42b7-b655-74955e1d403f`::moving from state init -> state preparing >Thread-53539::INFO::2014-05-16 17:16:23,843::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53539::INFO::2014-05-16 17:16:23,843::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557279', 'lastCheck': '7.6', 'valid': True}} >Thread-53539::DEBUG::2014-05-16 17:16:23,843::task::1168::TaskManager.Task::(prepare) Task=`4bff4886-9fd9-42b7-b655-74955e1d403f`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557279', 'lastCheck': '7.6', 'valid': True}} >Thread-53539::DEBUG::2014-05-16 17:16:23,843::task::579::TaskManager.Task::(_updateState) Task=`4bff4886-9fd9-42b7-b655-74955e1d403f`::moving from state preparing -> state finished >Thread-53539::DEBUG::2014-05-16 17:16:23,843::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53539::DEBUG::2014-05-16 17:16:23,843::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53539::DEBUG::2014-05-16 17:16:23,843::task::974::TaskManager.Task::(_decref) Task=`4bff4886-9fd9-42b7-b655-74955e1d403f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:16:25,441::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:25,511::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343027 s, 29.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:16:26,238::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:16:26,249::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000715815 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:27,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:27,590::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312413 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:29,602::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:29,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356388 s, 28.7 MB/s\n'; <rc> = 0 >Thread-53543::DEBUG::2014-05-16 17:16:30,034::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53543::DEBUG::2014-05-16 17:16:30,034::task::579::TaskManager.Task::(_updateState) Task=`2ace9097-9a26-4430-a558-c2ab46dc9f73`::moving from state init -> state preparing >Thread-53543::INFO::2014-05-16 17:16:30,035::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53543::INFO::2014-05-16 17:16:30,035::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53543::DEBUG::2014-05-16 17:16:30,035::task::1168::TaskManager.Task::(prepare) Task=`2ace9097-9a26-4430-a558-c2ab46dc9f73`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53543::DEBUG::2014-05-16 17:16:30,035::task::579::TaskManager.Task::(_updateState) Task=`2ace9097-9a26-4430-a558-c2ab46dc9f73`::moving from state preparing -> state finished >Thread-53543::DEBUG::2014-05-16 17:16:30,035::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53543::DEBUG::2014-05-16 17:16:30,036::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53543::DEBUG::2014-05-16 17:16:30,036::task::974::TaskManager.Task::(_decref) Task=`2ace9097-9a26-4430-a558-c2ab46dc9f73`::ref 0 aborting False >Thread-53544::DEBUG::2014-05-16 17:16:30,068::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53544::DEBUG::2014-05-16 17:16:30,068::task::579::TaskManager.Task::(_updateState) Task=`b3769aea-efd0-4663-a433-342cd64e0da9`::moving from state init -> state preparing >Thread-53544::INFO::2014-05-16 17:16:30,068::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53544::DEBUG::2014-05-16 17:16:30,069::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6d64b2fb-7925-40d8-be5d-e034e3d7074d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53544::DEBUG::2014-05-16 17:16:30,069::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53544::DEBUG::2014-05-16 17:16:30,069::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53544::DEBUG::2014-05-16 17:16:30,069::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6d64b2fb-7925-40d8-be5d-e034e3d7074d`::Granted request >Thread-53544::DEBUG::2014-05-16 17:16:30,070::task::811::TaskManager.Task::(resourceAcquired) Task=`b3769aea-efd0-4663-a433-342cd64e0da9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53544::DEBUG::2014-05-16 17:16:30,070::task::974::TaskManager.Task::(_decref) Task=`b3769aea-efd0-4663-a433-342cd64e0da9`::ref 1 aborting False >Thread-53544::INFO::2014-05-16 17:16:30,070::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53544::DEBUG::2014-05-16 17:16:30,071::task::1168::TaskManager.Task::(prepare) Task=`b3769aea-efd0-4663-a433-342cd64e0da9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53544::DEBUG::2014-05-16 17:16:30,071::task::579::TaskManager.Task::(_updateState) Task=`b3769aea-efd0-4663-a433-342cd64e0da9`::moving from state preparing -> state finished >Thread-53544::DEBUG::2014-05-16 17:16:30,071::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53544::DEBUG::2014-05-16 17:16:30,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53544::DEBUG::2014-05-16 17:16:30,071::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53544::DEBUG::2014-05-16 17:16:30,071::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53544::DEBUG::2014-05-16 17:16:30,072::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53544::DEBUG::2014-05-16 17:16:30,072::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53544::DEBUG::2014-05-16 17:16:30,072::task::974::TaskManager.Task::(_decref) Task=`b3769aea-efd0-4663-a433-342cd64e0da9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:16:31,686::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:31,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305117 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:33,764::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:33,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318997 s, 32.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:35,846::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:35,917::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349115 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:16:36,284::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:16:36,295::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000792043 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:37,928::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:37,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313559 s, 32.7 MB/s\n'; <rc> = 0 >Thread-53547::DEBUG::2014-05-16 17:16:39,016::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3238401.000000 / 8.009937 / 262500000.000000 = 0.154018 >Thread-53547::DEBUG::2014-05-16 17:16:39,017::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041758606531004513, 'statsAge': 0.97579407691955566, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15401826057334861, 'rxDropped': 0} >Thread-53547::DEBUG::2014-05-16 17:16:39,017::task::579::TaskManager.Task::(_updateState) Task=`206fecbe-52f4-4cec-8490-cac69c841747`::moving from state init -> state preparing >Thread-53547::INFO::2014-05-16 17:16:39,017::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53547::INFO::2014-05-16 17:16:39,018::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000792043', 'lastCheck': '2.7', 'valid': True}} >Thread-53547::DEBUG::2014-05-16 17:16:39,018::task::1168::TaskManager.Task::(prepare) Task=`206fecbe-52f4-4cec-8490-cac69c841747`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000792043', 'lastCheck': '2.7', 'valid': True}} >Thread-53547::DEBUG::2014-05-16 17:16:39,018::task::579::TaskManager.Task::(_updateState) Task=`206fecbe-52f4-4cec-8490-cac69c841747`::moving from state preparing -> state finished >Thread-53547::DEBUG::2014-05-16 17:16:39,018::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53547::DEBUG::2014-05-16 17:16:39,018::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53547::DEBUG::2014-05-16 17:16:39,018::task::974::TaskManager.Task::(_decref) Task=`206fecbe-52f4-4cec-8490-cac69c841747`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:16:40,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:40,078::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342264 s, 29.9 MB/s\n'; <rc> = 0 >Thread-53549::DEBUG::2014-05-16 17:16:40,100::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53549::DEBUG::2014-05-16 17:16:40,101::task::579::TaskManager.Task::(_updateState) Task=`6469f970-ad69-4adb-ad65-323fe8a9e282`::moving from state init -> state preparing >Thread-53549::INFO::2014-05-16 17:16:40,101::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53549::INFO::2014-05-16 17:16:40,101::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53549::DEBUG::2014-05-16 17:16:40,102::task::1168::TaskManager.Task::(prepare) Task=`6469f970-ad69-4adb-ad65-323fe8a9e282`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53549::DEBUG::2014-05-16 17:16:40,102::task::579::TaskManager.Task::(_updateState) Task=`6469f970-ad69-4adb-ad65-323fe8a9e282`::moving from state preparing -> state finished >Thread-53549::DEBUG::2014-05-16 17:16:40,102::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53549::DEBUG::2014-05-16 17:16:40,102::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53549::DEBUG::2014-05-16 17:16:40,102::task::974::TaskManager.Task::(_decref) Task=`6469f970-ad69-4adb-ad65-323fe8a9e282`::ref 0 aborting False >Thread-53550::DEBUG::2014-05-16 17:16:40,125::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53550::DEBUG::2014-05-16 17:16:40,125::task::579::TaskManager.Task::(_updateState) Task=`441907d6-51f8-482b-8592-1c3cf5707203`::moving from state init -> state preparing >Thread-53550::INFO::2014-05-16 17:16:40,125::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53550::DEBUG::2014-05-16 17:16:40,126::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d1e28215-e7ba-4fbe-92da-8f27ea454258`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53550::DEBUG::2014-05-16 17:16:40,126::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53550::DEBUG::2014-05-16 17:16:40,126::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53550::DEBUG::2014-05-16 17:16:40,126::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d1e28215-e7ba-4fbe-92da-8f27ea454258`::Granted request >Thread-53550::DEBUG::2014-05-16 17:16:40,126::task::811::TaskManager.Task::(resourceAcquired) Task=`441907d6-51f8-482b-8592-1c3cf5707203`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53550::DEBUG::2014-05-16 17:16:40,127::task::974::TaskManager.Task::(_decref) Task=`441907d6-51f8-482b-8592-1c3cf5707203`::ref 1 aborting False >Thread-53550::INFO::2014-05-16 17:16:40,127::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53550::DEBUG::2014-05-16 17:16:40,127::task::1168::TaskManager.Task::(prepare) Task=`441907d6-51f8-482b-8592-1c3cf5707203`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53550::DEBUG::2014-05-16 17:16:40,128::task::579::TaskManager.Task::(_updateState) Task=`441907d6-51f8-482b-8592-1c3cf5707203`::moving from state preparing -> state finished >Thread-53550::DEBUG::2014-05-16 17:16:40,128::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53550::DEBUG::2014-05-16 17:16:40,128::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53550::DEBUG::2014-05-16 17:16:40,128::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53550::DEBUG::2014-05-16 17:16:40,128::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53550::DEBUG::2014-05-16 17:16:40,129::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53550::DEBUG::2014-05-16 17:16:40,129::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53550::DEBUG::2014-05-16 17:16:40,129::task::974::TaskManager.Task::(_decref) Task=`441907d6-51f8-482b-8592-1c3cf5707203`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:16:42,090::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:42,167::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0410157 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:44,179::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:44,246::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314008 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:46,258::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 17:16:46,425::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:46,441::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030773 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:16:46,451::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000773612 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:48,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:48,612::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316219 s, 32.4 MB/s\n'; <rc> = 0 >Thread-53554::DEBUG::2014-05-16 17:16:50,160::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53554::DEBUG::2014-05-16 17:16:50,160::task::579::TaskManager.Task::(_updateState) Task=`5782ecf9-83e3-4a8f-adca-1f29cacb7f60`::moving from state init -> state preparing >Thread-53554::INFO::2014-05-16 17:16:50,161::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53554::INFO::2014-05-16 17:16:50,161::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53554::DEBUG::2014-05-16 17:16:50,161::task::1168::TaskManager.Task::(prepare) Task=`5782ecf9-83e3-4a8f-adca-1f29cacb7f60`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53554::DEBUG::2014-05-16 17:16:50,161::task::579::TaskManager.Task::(_updateState) Task=`5782ecf9-83e3-4a8f-adca-1f29cacb7f60`::moving from state preparing -> state finished >Thread-53554::DEBUG::2014-05-16 17:16:50,161::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53554::DEBUG::2014-05-16 17:16:50,162::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53554::DEBUG::2014-05-16 17:16:50,162::task::974::TaskManager.Task::(_decref) Task=`5782ecf9-83e3-4a8f-adca-1f29cacb7f60`::ref 0 aborting False >Thread-53555::DEBUG::2014-05-16 17:16:50,177::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53555::DEBUG::2014-05-16 17:16:50,177::task::579::TaskManager.Task::(_updateState) Task=`de376b95-c68a-42be-87c7-a9fab2685f31`::moving from state init -> state preparing >Thread-53555::INFO::2014-05-16 17:16:50,177::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53555::DEBUG::2014-05-16 17:16:50,178::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3655e497-4b9b-4488-89bd-63c2ed62ece8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53555::DEBUG::2014-05-16 17:16:50,178::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53555::DEBUG::2014-05-16 17:16:50,178::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53555::DEBUG::2014-05-16 17:16:50,178::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3655e497-4b9b-4488-89bd-63c2ed62ece8`::Granted request >Thread-53555::DEBUG::2014-05-16 17:16:50,179::task::811::TaskManager.Task::(resourceAcquired) Task=`de376b95-c68a-42be-87c7-a9fab2685f31`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53555::DEBUG::2014-05-16 17:16:50,179::task::974::TaskManager.Task::(_decref) Task=`de376b95-c68a-42be-87c7-a9fab2685f31`::ref 1 aborting False >Thread-53555::INFO::2014-05-16 17:16:50,179::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53555::DEBUG::2014-05-16 17:16:50,180::task::1168::TaskManager.Task::(prepare) Task=`de376b95-c68a-42be-87c7-a9fab2685f31`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53555::DEBUG::2014-05-16 17:16:50,180::task::579::TaskManager.Task::(_updateState) Task=`de376b95-c68a-42be-87c7-a9fab2685f31`::moving from state preparing -> state finished >Thread-53555::DEBUG::2014-05-16 17:16:50,180::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53555::DEBUG::2014-05-16 17:16:50,180::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53555::DEBUG::2014-05-16 17:16:50,180::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53555::DEBUG::2014-05-16 17:16:50,181::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53555::DEBUG::2014-05-16 17:16:50,181::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53555::DEBUG::2014-05-16 17:16:50,181::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53555::DEBUG::2014-05-16 17:16:50,181::task::974::TaskManager.Task::(_decref) Task=`de376b95-c68a-42be-87c7-a9fab2685f31`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:16:50,624::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:50,695::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348454 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:52,707::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:52,776::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319881 s, 32.0 MB/s\n'; <rc> = 0 >Thread-53557::DEBUG::2014-05-16 17:16:54,240::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317205.000000 / 8.008200 / 262500000.000000 = 0.205371 >Thread-53557::DEBUG::2014-05-16 17:16:54,240::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052944779681876192, 'statsAge': 0.1807100772857666, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20537068731378311, 'rxDropped': 0} >Thread-53557::DEBUG::2014-05-16 17:16:54,241::task::579::TaskManager.Task::(_updateState) Task=`7e1c8763-bf67-4319-ae0a-520f08ced673`::moving from state init -> state preparing >Thread-53557::INFO::2014-05-16 17:16:54,241::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53557::INFO::2014-05-16 17:16:54,241::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000773612', 'lastCheck': '7.7', 'valid': True}} >Thread-53557::DEBUG::2014-05-16 17:16:54,241::task::1168::TaskManager.Task::(prepare) Task=`7e1c8763-bf67-4319-ae0a-520f08ced673`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000773612', 'lastCheck': '7.7', 'valid': True}} >Thread-53557::DEBUG::2014-05-16 17:16:54,241::task::579::TaskManager.Task::(_updateState) Task=`7e1c8763-bf67-4319-ae0a-520f08ced673`::moving from state preparing -> state finished >Thread-53557::DEBUG::2014-05-16 17:16:54,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53557::DEBUG::2014-05-16 17:16:54,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53557::DEBUG::2014-05-16 17:16:54,242::task::974::TaskManager.Task::(_decref) Task=`7e1c8763-bf67-4319-ae0a-520f08ced673`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:16:54,788::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:54,854::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306498 s, 33.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:16:56,557::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:16:56,568::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107976 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:56,866::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:56,936::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346775 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:16:58,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:16:59,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313949 s, 32.6 MB/s\n'; <rc> = 0 >Thread-53560::DEBUG::2014-05-16 17:17:00,222::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53560::DEBUG::2014-05-16 17:17:00,223::task::579::TaskManager.Task::(_updateState) Task=`4ca23070-a5d3-4a32-a71d-19664b95ee7c`::moving from state init -> state preparing >Thread-53560::INFO::2014-05-16 17:17:00,223::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53560::INFO::2014-05-16 17:17:00,223::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53560::DEBUG::2014-05-16 17:17:00,223::task::1168::TaskManager.Task::(prepare) Task=`4ca23070-a5d3-4a32-a71d-19664b95ee7c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53560::DEBUG::2014-05-16 17:17:00,224::task::579::TaskManager.Task::(_updateState) Task=`4ca23070-a5d3-4a32-a71d-19664b95ee7c`::moving from state preparing -> state finished >Thread-53560::DEBUG::2014-05-16 17:17:00,224::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53560::DEBUG::2014-05-16 17:17:00,224::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53560::DEBUG::2014-05-16 17:17:00,224::task::974::TaskManager.Task::(_decref) Task=`4ca23070-a5d3-4a32-a71d-19664b95ee7c`::ref 0 aborting False >Thread-53561::DEBUG::2014-05-16 17:17:00,233::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53561::DEBUG::2014-05-16 17:17:00,233::task::579::TaskManager.Task::(_updateState) Task=`25ab5391-8099-4f4c-bc75-f47519034d9d`::moving from state init -> state preparing >Thread-53561::INFO::2014-05-16 17:17:00,233::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53561::DEBUG::2014-05-16 17:17:00,234::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f8a031a8-f1a6-49b3-81a5-193b4234c410`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53561::DEBUG::2014-05-16 17:17:00,234::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53561::DEBUG::2014-05-16 17:17:00,234::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53561::DEBUG::2014-05-16 17:17:00,234::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f8a031a8-f1a6-49b3-81a5-193b4234c410`::Granted request >Thread-53561::DEBUG::2014-05-16 17:17:00,235::task::811::TaskManager.Task::(resourceAcquired) Task=`25ab5391-8099-4f4c-bc75-f47519034d9d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53561::DEBUG::2014-05-16 17:17:00,235::task::974::TaskManager.Task::(_decref) Task=`25ab5391-8099-4f4c-bc75-f47519034d9d`::ref 1 aborting False >Thread-53561::INFO::2014-05-16 17:17:00,235::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53561::DEBUG::2014-05-16 17:17:00,236::task::1168::TaskManager.Task::(prepare) Task=`25ab5391-8099-4f4c-bc75-f47519034d9d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53561::DEBUG::2014-05-16 17:17:00,236::task::579::TaskManager.Task::(_updateState) Task=`25ab5391-8099-4f4c-bc75-f47519034d9d`::moving from state preparing -> state finished >Thread-53561::DEBUG::2014-05-16 17:17:00,236::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53561::DEBUG::2014-05-16 17:17:00,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53561::DEBUG::2014-05-16 17:17:00,236::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53561::DEBUG::2014-05-16 17:17:00,237::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53561::DEBUG::2014-05-16 17:17:00,237::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53561::DEBUG::2014-05-16 17:17:00,237::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53561::DEBUG::2014-05-16 17:17:00,237::task::974::TaskManager.Task::(_decref) Task=`25ab5391-8099-4f4c-bc75-f47519034d9d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:17:01,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:01,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308532 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:03,106::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:03,178::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354041 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:05,189::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:05,256::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306786 s, 33.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:17:06,602::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:17:06,612::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000586391 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:07,268::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:07,339::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355481 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:09,351::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-53565::DEBUG::2014-05-16 17:17:09,390::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5418429.000000 / 8.008679 / 262500000.000000 = 0.257741 >Thread-53565::DEBUG::2014-05-16 17:17:09,391::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066948322546618068, 'statsAge': 1.3147540092468262, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25774081480414734, 'rxDropped': 0} >Thread-53565::DEBUG::2014-05-16 17:17:09,392::task::579::TaskManager.Task::(_updateState) Task=`7833b574-efe3-4fef-9139-2806629b3992`::moving from state init -> state preparing >Thread-53565::INFO::2014-05-16 17:17:09,393::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53565::INFO::2014-05-16 17:17:09,395::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586391', 'lastCheck': '2.8', 'valid': True}} >Thread-53565::DEBUG::2014-05-16 17:17:09,395::task::1168::TaskManager.Task::(prepare) Task=`7833b574-efe3-4fef-9139-2806629b3992`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586391', 'lastCheck': '2.8', 'valid': True}} >Thread-53565::DEBUG::2014-05-16 17:17:09,396::task::579::TaskManager.Task::(_updateState) Task=`7833b574-efe3-4fef-9139-2806629b3992`::moving from state preparing -> state finished >Thread-53565::DEBUG::2014-05-16 17:17:09,397::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53565::DEBUG::2014-05-16 17:17:09,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53565::DEBUG::2014-05-16 17:17:09,399::task::974::TaskManager.Task::(_decref) Task=`7833b574-efe3-4fef-9139-2806629b3992`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:17:09,450::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.062054 s, 16.5 MB/s\n'; <rc> = 0 >Thread-53567::DEBUG::2014-05-16 17:17:10,266::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53567::DEBUG::2014-05-16 17:17:10,266::task::579::TaskManager.Task::(_updateState) Task=`d4735a86-1d69-4e26-b629-36025ddf4757`::moving from state init -> state preparing >Thread-53567::INFO::2014-05-16 17:17:10,266::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53567::INFO::2014-05-16 17:17:10,266::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53567::DEBUG::2014-05-16 17:17:10,266::task::1168::TaskManager.Task::(prepare) Task=`d4735a86-1d69-4e26-b629-36025ddf4757`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53567::DEBUG::2014-05-16 17:17:10,267::task::579::TaskManager.Task::(_updateState) Task=`d4735a86-1d69-4e26-b629-36025ddf4757`::moving from state preparing -> state finished >Thread-53567::DEBUG::2014-05-16 17:17:10,267::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53567::DEBUG::2014-05-16 17:17:10,267::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53567::DEBUG::2014-05-16 17:17:10,267::task::974::TaskManager.Task::(_decref) Task=`d4735a86-1d69-4e26-b629-36025ddf4757`::ref 0 aborting False >Thread-53568::DEBUG::2014-05-16 17:17:10,286::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53568::DEBUG::2014-05-16 17:17:10,286::task::579::TaskManager.Task::(_updateState) Task=`7c9d5d52-e268-4f6a-b85a-6e2ea7e9896e`::moving from state init -> state preparing >Thread-53568::INFO::2014-05-16 17:17:10,287::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53568::DEBUG::2014-05-16 17:17:10,287::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f0d4ab97-7a30-4dd3-a8ca-1b6adca6230b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53568::DEBUG::2014-05-16 17:17:10,287::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53568::DEBUG::2014-05-16 17:17:10,287::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53568::DEBUG::2014-05-16 17:17:10,287::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f0d4ab97-7a30-4dd3-a8ca-1b6adca6230b`::Granted request >Thread-53568::DEBUG::2014-05-16 17:17:10,288::task::811::TaskManager.Task::(resourceAcquired) Task=`7c9d5d52-e268-4f6a-b85a-6e2ea7e9896e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53568::DEBUG::2014-05-16 17:17:10,288::task::974::TaskManager.Task::(_decref) Task=`7c9d5d52-e268-4f6a-b85a-6e2ea7e9896e`::ref 1 aborting False >Thread-53568::INFO::2014-05-16 17:17:10,288::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53568::DEBUG::2014-05-16 17:17:10,289::task::1168::TaskManager.Task::(prepare) Task=`7c9d5d52-e268-4f6a-b85a-6e2ea7e9896e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53568::DEBUG::2014-05-16 17:17:10,289::task::579::TaskManager.Task::(_updateState) Task=`7c9d5d52-e268-4f6a-b85a-6e2ea7e9896e`::moving from state preparing -> state finished >Thread-53568::DEBUG::2014-05-16 17:17:10,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53568::DEBUG::2014-05-16 17:17:10,289::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53568::DEBUG::2014-05-16 17:17:10,289::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53568::DEBUG::2014-05-16 17:17:10,289::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53568::DEBUG::2014-05-16 17:17:10,289::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53568::DEBUG::2014-05-16 17:17:10,290::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53568::DEBUG::2014-05-16 17:17:10,290::task::974::TaskManager.Task::(_decref) Task=`7c9d5d52-e268-4f6a-b85a-6e2ea7e9896e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:17:11,463::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:11,535::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352085 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:13,546::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:13,614::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316102 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:15,626::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:15,692::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304909 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:17:16,650::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:17:16,660::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000775567 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:17,703::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:17,776::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355045 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:19,787::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:19,854::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317921 s, 32.2 MB/s\n'; <rc> = 0 >Thread-53572::DEBUG::2014-05-16 17:17:20,324::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53572::DEBUG::2014-05-16 17:17:20,325::task::579::TaskManager.Task::(_updateState) Task=`c6a78767-14a7-4c27-909b-ceffc28bc6e1`::moving from state init -> state preparing >Thread-53572::INFO::2014-05-16 17:17:20,325::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53572::INFO::2014-05-16 17:17:20,325::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53572::DEBUG::2014-05-16 17:17:20,325::task::1168::TaskManager.Task::(prepare) Task=`c6a78767-14a7-4c27-909b-ceffc28bc6e1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53572::DEBUG::2014-05-16 17:17:20,325::task::579::TaskManager.Task::(_updateState) Task=`c6a78767-14a7-4c27-909b-ceffc28bc6e1`::moving from state preparing -> state finished >Thread-53572::DEBUG::2014-05-16 17:17:20,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53572::DEBUG::2014-05-16 17:17:20,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53572::DEBUG::2014-05-16 17:17:20,326::task::974::TaskManager.Task::(_decref) Task=`c6a78767-14a7-4c27-909b-ceffc28bc6e1`::ref 0 aborting False >Thread-53573::DEBUG::2014-05-16 17:17:20,334::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53573::DEBUG::2014-05-16 17:17:20,334::task::579::TaskManager.Task::(_updateState) Task=`c234547c-470f-4177-a390-4c8b9c6d57de`::moving from state init -> state preparing >Thread-53573::INFO::2014-05-16 17:17:20,335::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53573::DEBUG::2014-05-16 17:17:20,335::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`44d4367d-6ec1-4612-a6cd-c2d73af5f0e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53573::DEBUG::2014-05-16 17:17:20,335::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53573::DEBUG::2014-05-16 17:17:20,335::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53573::DEBUG::2014-05-16 17:17:20,336::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`44d4367d-6ec1-4612-a6cd-c2d73af5f0e0`::Granted request >Thread-53573::DEBUG::2014-05-16 17:17:20,336::task::811::TaskManager.Task::(resourceAcquired) Task=`c234547c-470f-4177-a390-4c8b9c6d57de`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53573::DEBUG::2014-05-16 17:17:20,336::task::974::TaskManager.Task::(_decref) Task=`c234547c-470f-4177-a390-4c8b9c6d57de`::ref 1 aborting False >Thread-53573::INFO::2014-05-16 17:17:20,337::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53573::DEBUG::2014-05-16 17:17:20,337::task::1168::TaskManager.Task::(prepare) Task=`c234547c-470f-4177-a390-4c8b9c6d57de`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53573::DEBUG::2014-05-16 17:17:20,337::task::579::TaskManager.Task::(_updateState) Task=`c234547c-470f-4177-a390-4c8b9c6d57de`::moving from state preparing -> state finished >Thread-53573::DEBUG::2014-05-16 17:17:20,337::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53573::DEBUG::2014-05-16 17:17:20,337::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53573::DEBUG::2014-05-16 17:17:20,338::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53573::DEBUG::2014-05-16 17:17:20,338::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53573::DEBUG::2014-05-16 17:17:20,338::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53573::DEBUG::2014-05-16 17:17:20,338::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53573::DEBUG::2014-05-16 17:17:20,338::task::974::TaskManager.Task::(_decref) Task=`c234547c-470f-4177-a390-4c8b9c6d57de`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:17:21,866::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:21,933::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311616 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:23,944::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:24,018::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035512 s, 28.8 MB/s\n'; <rc> = 0 >Thread-53575::DEBUG::2014-05-16 17:17:24,587::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3243895.000000 / 8.008455 / 262500000.000000 = 0.154308 >Thread-53575::DEBUG::2014-05-16 17:17:24,587::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0040999525574155985, 'statsAge': 0.49595403671264648, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15430810536300815, 'rxDropped': 0} >Thread-53575::DEBUG::2014-05-16 17:17:24,588::task::579::TaskManager.Task::(_updateState) Task=`dd5806f3-3025-4e16-8b94-dff409c57e1c`::moving from state init -> state preparing >Thread-53575::INFO::2014-05-16 17:17:24,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53575::INFO::2014-05-16 17:17:24,588::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775567', 'lastCheck': '7.9', 'valid': True}} >Thread-53575::DEBUG::2014-05-16 17:17:24,588::task::1168::TaskManager.Task::(prepare) Task=`dd5806f3-3025-4e16-8b94-dff409c57e1c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775567', 'lastCheck': '7.9', 'valid': True}} >Thread-53575::DEBUG::2014-05-16 17:17:24,588::task::579::TaskManager.Task::(_updateState) Task=`dd5806f3-3025-4e16-8b94-dff409c57e1c`::moving from state preparing -> state finished >Thread-53575::DEBUG::2014-05-16 17:17:24,589::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53575::DEBUG::2014-05-16 17:17:24,589::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53575::DEBUG::2014-05-16 17:17:24,589::task::974::TaskManager.Task::(_decref) Task=`dd5806f3-3025-4e16-8b94-dff409c57e1c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:17:26,030::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:26,105::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351988 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:17:26,699::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:17:26,709::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600612 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:28,117::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:28,184::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310546 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:30,196::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:30,267::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353152 s, 29.0 MB/s\n'; <rc> = 0 >Thread-53578::DEBUG::2014-05-16 17:17:30,386::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [62fee17b] >Thread-53578::DEBUG::2014-05-16 17:17:30,386::task::579::TaskManager.Task::(_updateState) Task=`b027645d-a397-4ac8-bed7-faff67edafbe`::moving from state init -> state preparing >Thread-53578::INFO::2014-05-16 17:17:30,386::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53578::INFO::2014-05-16 17:17:30,387::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53578::DEBUG::2014-05-16 17:17:30,387::task::1168::TaskManager.Task::(prepare) Task=`b027645d-a397-4ac8-bed7-faff67edafbe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53578::DEBUG::2014-05-16 17:17:30,387::task::579::TaskManager.Task::(_updateState) Task=`b027645d-a397-4ac8-bed7-faff67edafbe`::moving from state preparing -> state finished >Thread-53578::DEBUG::2014-05-16 17:17:30,387::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53578::DEBUG::2014-05-16 17:17:30,387::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53578::DEBUG::2014-05-16 17:17:30,388::task::974::TaskManager.Task::(_decref) Task=`b027645d-a397-4ac8-bed7-faff67edafbe`::ref 0 aborting False >Thread-53579::DEBUG::2014-05-16 17:17:30,399::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [62fee17b] >Thread-53579::DEBUG::2014-05-16 17:17:30,399::task::579::TaskManager.Task::(_updateState) Task=`55bd94b4-041b-4785-9e56-0c490c2ffb85`::moving from state init -> state preparing >Thread-53579::INFO::2014-05-16 17:17:30,399::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53579::DEBUG::2014-05-16 17:17:30,400::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`095b40d2-b23c-4980-bed7-dc5d15d7bb3e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53579::DEBUG::2014-05-16 17:17:30,400::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53579::DEBUG::2014-05-16 17:17:30,401::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53579::DEBUG::2014-05-16 17:17:30,401::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`095b40d2-b23c-4980-bed7-dc5d15d7bb3e`::Granted request >Thread-53579::DEBUG::2014-05-16 17:17:30,401::task::811::TaskManager.Task::(resourceAcquired) Task=`55bd94b4-041b-4785-9e56-0c490c2ffb85`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53579::DEBUG::2014-05-16 17:17:30,401::task::974::TaskManager.Task::(_decref) Task=`55bd94b4-041b-4785-9e56-0c490c2ffb85`::ref 1 aborting False >Thread-53579::INFO::2014-05-16 17:17:30,402::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53579::DEBUG::2014-05-16 17:17:30,402::task::1168::TaskManager.Task::(prepare) Task=`55bd94b4-041b-4785-9e56-0c490c2ffb85`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53579::DEBUG::2014-05-16 17:17:30,402::task::579::TaskManager.Task::(_updateState) Task=`55bd94b4-041b-4785-9e56-0c490c2ffb85`::moving from state preparing -> state finished >Thread-53579::DEBUG::2014-05-16 17:17:30,403::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53579::DEBUG::2014-05-16 17:17:30,403::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53579::DEBUG::2014-05-16 17:17:30,403::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53579::DEBUG::2014-05-16 17:17:30,403::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53579::DEBUG::2014-05-16 17:17:30,403::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53579::DEBUG::2014-05-16 17:17:30,403::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53579::DEBUG::2014-05-16 17:17:30,404::task::974::TaskManager.Task::(_decref) Task=`55bd94b4-041b-4785-9e56-0c490c2ffb85`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:17:32,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:32,346::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310912 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:34,358::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:34,425::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315808 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:36,437::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:36,508::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348747 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:17:36,743::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:17:36,756::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664171 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:38,520::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:38,591::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035373 s, 28.9 MB/s\n'; <rc> = 0 >Thread-53583::DEBUG::2014-05-16 17:17:39,775::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317688.000000 / 8.008240 / 262500000.000000 = 0.205393 >Thread-53583::DEBUG::2014-05-16 17:17:39,775::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005384454022780618, 'statsAge': 1.6660261154174805, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20539263645827016, 'rxDropped': 0} >Thread-53583::DEBUG::2014-05-16 17:17:39,775::task::579::TaskManager.Task::(_updateState) Task=`29eb87d8-15bc-406f-a69e-49c6e95f2d5c`::moving from state init -> state preparing >Thread-53583::INFO::2014-05-16 17:17:39,776::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53583::INFO::2014-05-16 17:17:39,776::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664171', 'lastCheck': '3.0', 'valid': True}} >Thread-53583::DEBUG::2014-05-16 17:17:39,776::task::1168::TaskManager.Task::(prepare) Task=`29eb87d8-15bc-406f-a69e-49c6e95f2d5c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664171', 'lastCheck': '3.0', 'valid': True}} >Thread-53583::DEBUG::2014-05-16 17:17:39,776::task::579::TaskManager.Task::(_updateState) Task=`29eb87d8-15bc-406f-a69e-49c6e95f2d5c`::moving from state preparing -> state finished >Thread-53583::DEBUG::2014-05-16 17:17:39,776::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53583::DEBUG::2014-05-16 17:17:39,776::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53583::DEBUG::2014-05-16 17:17:39,776::task::974::TaskManager.Task::(_decref) Task=`29eb87d8-15bc-406f-a69e-49c6e95f2d5c`::ref 0 aborting False >Thread-53585::DEBUG::2014-05-16 17:17:40,461::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53585::DEBUG::2014-05-16 17:17:40,461::task::579::TaskManager.Task::(_updateState) Task=`98ab443c-97c1-4ca6-9002-7539d6288070`::moving from state init -> state preparing >Thread-53585::INFO::2014-05-16 17:17:40,462::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53585::INFO::2014-05-16 17:17:40,462::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53585::DEBUG::2014-05-16 17:17:40,462::task::1168::TaskManager.Task::(prepare) Task=`98ab443c-97c1-4ca6-9002-7539d6288070`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53585::DEBUG::2014-05-16 17:17:40,462::task::579::TaskManager.Task::(_updateState) Task=`98ab443c-97c1-4ca6-9002-7539d6288070`::moving from state preparing -> state finished >Thread-53585::DEBUG::2014-05-16 17:17:40,462::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53585::DEBUG::2014-05-16 17:17:40,462::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53585::DEBUG::2014-05-16 17:17:40,463::task::974::TaskManager.Task::(_decref) Task=`98ab443c-97c1-4ca6-9002-7539d6288070`::ref 0 aborting False >Thread-53586::DEBUG::2014-05-16 17:17:40,471::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53586::DEBUG::2014-05-16 17:17:40,471::task::579::TaskManager.Task::(_updateState) Task=`2d3ba565-4ac6-45c1-878a-4a6bf6b60eaa`::moving from state init -> state preparing >Thread-53586::INFO::2014-05-16 17:17:40,472::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53586::DEBUG::2014-05-16 17:17:40,472::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`407677c3-b997-4ff7-8ad7-4f5bbda68088`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53586::DEBUG::2014-05-16 17:17:40,472::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53586::DEBUG::2014-05-16 17:17:40,472::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53586::DEBUG::2014-05-16 17:17:40,472::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`407677c3-b997-4ff7-8ad7-4f5bbda68088`::Granted request >Thread-53586::DEBUG::2014-05-16 17:17:40,473::task::811::TaskManager.Task::(resourceAcquired) Task=`2d3ba565-4ac6-45c1-878a-4a6bf6b60eaa`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53586::DEBUG::2014-05-16 17:17:40,473::task::974::TaskManager.Task::(_decref) Task=`2d3ba565-4ac6-45c1-878a-4a6bf6b60eaa`::ref 1 aborting False >Thread-53586::INFO::2014-05-16 17:17:40,473::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53586::DEBUG::2014-05-16 17:17:40,473::task::1168::TaskManager.Task::(prepare) Task=`2d3ba565-4ac6-45c1-878a-4a6bf6b60eaa`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53586::DEBUG::2014-05-16 17:17:40,474::task::579::TaskManager.Task::(_updateState) Task=`2d3ba565-4ac6-45c1-878a-4a6bf6b60eaa`::moving from state preparing -> state finished >Thread-53586::DEBUG::2014-05-16 17:17:40,474::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53586::DEBUG::2014-05-16 17:17:40,474::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53586::DEBUG::2014-05-16 17:17:40,474::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53586::DEBUG::2014-05-16 17:17:40,474::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53586::DEBUG::2014-05-16 17:17:40,474::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53586::DEBUG::2014-05-16 17:17:40,475::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53586::DEBUG::2014-05-16 17:17:40,475::task::974::TaskManager.Task::(_decref) Task=`2d3ba565-4ac6-45c1-878a-4a6bf6b60eaa`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:17:40,603::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:40,675::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357884 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:42,687::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:42,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305782 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:44,765::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:44,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355482 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:17:46,791::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:17:46,802::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105138 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:46,849::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:46,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327065 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:48,932::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:49,000::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321692 s, 31.8 MB/s\n'; <rc> = 0 >Thread-53590::DEBUG::2014-05-16 17:17:50,525::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53590::DEBUG::2014-05-16 17:17:50,525::task::579::TaskManager.Task::(_updateState) Task=`e0188e28-0afc-4d37-adf8-d71982b85bf0`::moving from state init -> state preparing >Thread-53590::INFO::2014-05-16 17:17:50,526::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53590::INFO::2014-05-16 17:17:50,526::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53590::DEBUG::2014-05-16 17:17:50,526::task::1168::TaskManager.Task::(prepare) Task=`e0188e28-0afc-4d37-adf8-d71982b85bf0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53590::DEBUG::2014-05-16 17:17:50,526::task::579::TaskManager.Task::(_updateState) Task=`e0188e28-0afc-4d37-adf8-d71982b85bf0`::moving from state preparing -> state finished >Thread-53590::DEBUG::2014-05-16 17:17:50,526::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53590::DEBUG::2014-05-16 17:17:50,527::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53590::DEBUG::2014-05-16 17:17:50,527::task::974::TaskManager.Task::(_decref) Task=`e0188e28-0afc-4d37-adf8-d71982b85bf0`::ref 0 aborting False >Thread-53591::DEBUG::2014-05-16 17:17:50,535::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53591::DEBUG::2014-05-16 17:17:50,536::task::579::TaskManager.Task::(_updateState) Task=`23b16f0e-229b-419a-ba86-51ebb9c86e50`::moving from state init -> state preparing >Thread-53591::INFO::2014-05-16 17:17:50,536::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53591::DEBUG::2014-05-16 17:17:50,536::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f5b41697-6b4b-40e4-b19c-b54cffabe0bb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53591::DEBUG::2014-05-16 17:17:50,537::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53591::DEBUG::2014-05-16 17:17:50,537::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53591::DEBUG::2014-05-16 17:17:50,537::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f5b41697-6b4b-40e4-b19c-b54cffabe0bb`::Granted request >Thread-53591::DEBUG::2014-05-16 17:17:50,537::task::811::TaskManager.Task::(resourceAcquired) Task=`23b16f0e-229b-419a-ba86-51ebb9c86e50`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53591::DEBUG::2014-05-16 17:17:50,537::task::974::TaskManager.Task::(_decref) Task=`23b16f0e-229b-419a-ba86-51ebb9c86e50`::ref 1 aborting False >Thread-53591::INFO::2014-05-16 17:17:50,538::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53591::DEBUG::2014-05-16 17:17:50,538::task::1168::TaskManager.Task::(prepare) Task=`23b16f0e-229b-419a-ba86-51ebb9c86e50`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53591::DEBUG::2014-05-16 17:17:50,538::task::579::TaskManager.Task::(_updateState) Task=`23b16f0e-229b-419a-ba86-51ebb9c86e50`::moving from state preparing -> state finished >Thread-53591::DEBUG::2014-05-16 17:17:50,539::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53591::DEBUG::2014-05-16 17:17:50,539::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53591::DEBUG::2014-05-16 17:17:50,539::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53591::DEBUG::2014-05-16 17:17:50,539::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53591::DEBUG::2014-05-16 17:17:50,539::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53591::DEBUG::2014-05-16 17:17:50,539::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53591::DEBUG::2014-05-16 17:17:50,540::task::974::TaskManager.Task::(_decref) Task=`23b16f0e-229b-419a-ba86-51ebb9c86e50`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:17:51,011::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:51,083::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350635 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:53,094::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:53,163::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317531 s, 32.2 MB/s\n'; <rc> = 0 >Thread-53593::DEBUG::2014-05-16 17:17:54,986::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5419326.000000 / 8.008007 / 262500000.000000 = 0.257805 >Thread-53593::DEBUG::2014-05-16 17:17:54,986::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066438267072630626, 'statsAge': 0.86121106147766113, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25780511824548985, 'rxDropped': 0} >Thread-53593::DEBUG::2014-05-16 17:17:54,987::task::579::TaskManager.Task::(_updateState) Task=`70cc1e3f-4f0f-4370-acc1-68edbaf71263`::moving from state init -> state preparing >Thread-53593::INFO::2014-05-16 17:17:54,987::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53593::INFO::2014-05-16 17:17:54,987::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105138', 'lastCheck': '8.2', 'valid': True}} >Thread-53593::DEBUG::2014-05-16 17:17:54,987::task::1168::TaskManager.Task::(prepare) Task=`70cc1e3f-4f0f-4370-acc1-68edbaf71263`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105138', 'lastCheck': '8.2', 'valid': True}} >Thread-53593::DEBUG::2014-05-16 17:17:54,987::task::579::TaskManager.Task::(_updateState) Task=`70cc1e3f-4f0f-4370-acc1-68edbaf71263`::moving from state preparing -> state finished >Thread-53593::DEBUG::2014-05-16 17:17:54,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53593::DEBUG::2014-05-16 17:17:54,987::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53593::DEBUG::2014-05-16 17:17:54,988::task::974::TaskManager.Task::(_decref) Task=`70cc1e3f-4f0f-4370-acc1-68edbaf71263`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:17:55,174::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:55,241::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306087 s, 33.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:17:56,851::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:17:56,862::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111129 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:57,252::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:57,323::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349893 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:17:59,335::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:17:59,403::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320824 s, 31.9 MB/s\n'; <rc> = 0 >Thread-53596::DEBUG::2014-05-16 17:18:00,588::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53596::DEBUG::2014-05-16 17:18:00,588::task::579::TaskManager.Task::(_updateState) Task=`756704a9-743d-4188-8649-72a7e4d714f1`::moving from state init -> state preparing >Thread-53596::INFO::2014-05-16 17:18:00,589::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53596::INFO::2014-05-16 17:18:00,589::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53596::DEBUG::2014-05-16 17:18:00,589::task::1168::TaskManager.Task::(prepare) Task=`756704a9-743d-4188-8649-72a7e4d714f1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53596::DEBUG::2014-05-16 17:18:00,589::task::579::TaskManager.Task::(_updateState) Task=`756704a9-743d-4188-8649-72a7e4d714f1`::moving from state preparing -> state finished >Thread-53596::DEBUG::2014-05-16 17:18:00,589::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53596::DEBUG::2014-05-16 17:18:00,589::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53596::DEBUG::2014-05-16 17:18:00,590::task::974::TaskManager.Task::(_decref) Task=`756704a9-743d-4188-8649-72a7e4d714f1`::ref 0 aborting False >Thread-53597::DEBUG::2014-05-16 17:18:00,598::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53597::DEBUG::2014-05-16 17:18:00,599::task::579::TaskManager.Task::(_updateState) Task=`de783a26-86e6-4cb4-911e-05dbc8917034`::moving from state init -> state preparing >Thread-53597::INFO::2014-05-16 17:18:00,599::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53597::DEBUG::2014-05-16 17:18:00,600::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a806ac54-f638-4a3c-96e2-82dd2721924f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53597::DEBUG::2014-05-16 17:18:00,600::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53597::DEBUG::2014-05-16 17:18:00,600::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53597::DEBUG::2014-05-16 17:18:00,605::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a806ac54-f638-4a3c-96e2-82dd2721924f`::Granted request >Thread-53597::DEBUG::2014-05-16 17:18:00,606::task::811::TaskManager.Task::(resourceAcquired) Task=`de783a26-86e6-4cb4-911e-05dbc8917034`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53597::DEBUG::2014-05-16 17:18:00,607::task::974::TaskManager.Task::(_decref) Task=`de783a26-86e6-4cb4-911e-05dbc8917034`::ref 1 aborting False >Thread-53597::INFO::2014-05-16 17:18:00,607::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53597::DEBUG::2014-05-16 17:18:00,608::task::1168::TaskManager.Task::(prepare) Task=`de783a26-86e6-4cb4-911e-05dbc8917034`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53597::DEBUG::2014-05-16 17:18:00,608::task::579::TaskManager.Task::(_updateState) Task=`de783a26-86e6-4cb4-911e-05dbc8917034`::moving from state preparing -> state finished >Thread-53597::DEBUG::2014-05-16 17:18:00,608::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53597::DEBUG::2014-05-16 17:18:00,608::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53597::DEBUG::2014-05-16 17:18:00,608::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53597::DEBUG::2014-05-16 17:18:00,609::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53597::DEBUG::2014-05-16 17:18:00,609::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53597::DEBUG::2014-05-16 17:18:00,609::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53597::DEBUG::2014-05-16 17:18:00,609::task::974::TaskManager.Task::(_decref) Task=`de783a26-86e6-4cb4-911e-05dbc8917034`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:18:01,415::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:01,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351063 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:03,497::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:03,570::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356947 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:05,582::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:05,660::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308218 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:18:06,944::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:18:06,969::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111066 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:07,672::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:07,743::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345007 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:09,754::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:09,822::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315971 s, 32.4 MB/s\n'; <rc> = 0 >Thread-53601::DEBUG::2014-05-16 17:18:10,154::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4339136.000000 / 8.008451 / 262500000.000000 = 0.206407 >Thread-53601::DEBUG::2014-05-16 17:18:10,154::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053150519886179205, 'statsAge': 0.012091159820556641, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20640748049549473, 'rxDropped': 0} >Thread-53601::DEBUG::2014-05-16 17:18:10,154::task::579::TaskManager.Task::(_updateState) Task=`911271e3-0aa6-4f64-90a7-e2b676cebfce`::moving from state init -> state preparing >Thread-53601::INFO::2014-05-16 17:18:10,155::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53601::INFO::2014-05-16 17:18:10,155::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111066', 'lastCheck': '3.1', 'valid': True}} >Thread-53601::DEBUG::2014-05-16 17:18:10,155::task::1168::TaskManager.Task::(prepare) Task=`911271e3-0aa6-4f64-90a7-e2b676cebfce`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111066', 'lastCheck': '3.1', 'valid': True}} >Thread-53601::DEBUG::2014-05-16 17:18:10,155::task::579::TaskManager.Task::(_updateState) Task=`911271e3-0aa6-4f64-90a7-e2b676cebfce`::moving from state preparing -> state finished >Thread-53601::DEBUG::2014-05-16 17:18:10,155::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53601::DEBUG::2014-05-16 17:18:10,155::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53601::DEBUG::2014-05-16 17:18:10,156::task::974::TaskManager.Task::(_decref) Task=`911271e3-0aa6-4f64-90a7-e2b676cebfce`::ref 0 aborting False >Thread-53603::DEBUG::2014-05-16 17:18:10,644::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53603::DEBUG::2014-05-16 17:18:10,645::task::579::TaskManager.Task::(_updateState) Task=`3e394b72-6a42-44e8-9a41-b0f9ab89f880`::moving from state init -> state preparing >Thread-53603::INFO::2014-05-16 17:18:10,645::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53603::INFO::2014-05-16 17:18:10,645::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53603::DEBUG::2014-05-16 17:18:10,646::task::1168::TaskManager.Task::(prepare) Task=`3e394b72-6a42-44e8-9a41-b0f9ab89f880`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53603::DEBUG::2014-05-16 17:18:10,647::task::579::TaskManager.Task::(_updateState) Task=`3e394b72-6a42-44e8-9a41-b0f9ab89f880`::moving from state preparing -> state finished >Thread-53603::DEBUG::2014-05-16 17:18:10,652::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53603::DEBUG::2014-05-16 17:18:10,653::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53603::DEBUG::2014-05-16 17:18:10,653::task::974::TaskManager.Task::(_decref) Task=`3e394b72-6a42-44e8-9a41-b0f9ab89f880`::ref 0 aborting False >Thread-53604::DEBUG::2014-05-16 17:18:10,668::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53604::DEBUG::2014-05-16 17:18:10,668::task::579::TaskManager.Task::(_updateState) Task=`dbe95318-c006-4db3-b16d-fdd9f2178cb7`::moving from state init -> state preparing >Thread-53604::INFO::2014-05-16 17:18:10,669::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53604::DEBUG::2014-05-16 17:18:10,669::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8592df14-9a6a-470a-a03c-b8ed33145195`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53604::DEBUG::2014-05-16 17:18:10,669::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53604::DEBUG::2014-05-16 17:18:10,670::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53604::DEBUG::2014-05-16 17:18:10,670::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8592df14-9a6a-470a-a03c-b8ed33145195`::Granted request >Thread-53604::DEBUG::2014-05-16 17:18:10,670::task::811::TaskManager.Task::(resourceAcquired) Task=`dbe95318-c006-4db3-b16d-fdd9f2178cb7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53604::DEBUG::2014-05-16 17:18:10,670::task::974::TaskManager.Task::(_decref) Task=`dbe95318-c006-4db3-b16d-fdd9f2178cb7`::ref 1 aborting False >Thread-53604::INFO::2014-05-16 17:18:10,671::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53604::DEBUG::2014-05-16 17:18:10,671::task::1168::TaskManager.Task::(prepare) Task=`dbe95318-c006-4db3-b16d-fdd9f2178cb7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53604::DEBUG::2014-05-16 17:18:10,671::task::579::TaskManager.Task::(_updateState) Task=`dbe95318-c006-4db3-b16d-fdd9f2178cb7`::moving from state preparing -> state finished >Thread-53604::DEBUG::2014-05-16 17:18:10,672::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53604::DEBUG::2014-05-16 17:18:10,672::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53604::DEBUG::2014-05-16 17:18:10,672::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53604::DEBUG::2014-05-16 17:18:10,672::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53604::DEBUG::2014-05-16 17:18:10,672::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53604::DEBUG::2014-05-16 17:18:10,672::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53604::DEBUG::2014-05-16 17:18:10,673::task::974::TaskManager.Task::(_decref) Task=`dbe95318-c006-4db3-b16d-fdd9f2178cb7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:18:11,834::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:11,905::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355812 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:13,916::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:13,984::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315404 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:15,996::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:16,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352032 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:18:17,111::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:18:17,137::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756774 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:18,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:18,151::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351446 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:20,167::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:20,233::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301336 s, 34.0 MB/s\n'; <rc> = 0 >Thread-53608::DEBUG::2014-05-16 17:18:20,705::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53608::DEBUG::2014-05-16 17:18:20,706::task::579::TaskManager.Task::(_updateState) Task=`9c63b65e-88b9-45e8-9972-6b1dccdd60da`::moving from state init -> state preparing >Thread-53608::INFO::2014-05-16 17:18:20,707::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53608::INFO::2014-05-16 17:18:20,707::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53608::DEBUG::2014-05-16 17:18:20,707::task::1168::TaskManager.Task::(prepare) Task=`9c63b65e-88b9-45e8-9972-6b1dccdd60da`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53608::DEBUG::2014-05-16 17:18:20,707::task::579::TaskManager.Task::(_updateState) Task=`9c63b65e-88b9-45e8-9972-6b1dccdd60da`::moving from state preparing -> state finished >Thread-53608::DEBUG::2014-05-16 17:18:20,707::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53608::DEBUG::2014-05-16 17:18:20,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53608::DEBUG::2014-05-16 17:18:20,708::task::974::TaskManager.Task::(_decref) Task=`9c63b65e-88b9-45e8-9972-6b1dccdd60da`::ref 0 aborting False >Thread-53609::DEBUG::2014-05-16 17:18:20,716::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53609::DEBUG::2014-05-16 17:18:20,717::task::579::TaskManager.Task::(_updateState) Task=`bb5803a1-5911-41a0-9f3d-7d84301bc390`::moving from state init -> state preparing >Thread-53609::INFO::2014-05-16 17:18:20,717::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53609::DEBUG::2014-05-16 17:18:20,717::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7bc7d853-e09f-43f2-bf91-745b3ca10ab8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53609::DEBUG::2014-05-16 17:18:20,717::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53609::DEBUG::2014-05-16 17:18:20,718::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53609::DEBUG::2014-05-16 17:18:20,718::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7bc7d853-e09f-43f2-bf91-745b3ca10ab8`::Granted request >Thread-53609::DEBUG::2014-05-16 17:18:20,719::task::811::TaskManager.Task::(resourceAcquired) Task=`bb5803a1-5911-41a0-9f3d-7d84301bc390`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53609::DEBUG::2014-05-16 17:18:20,719::task::974::TaskManager.Task::(_decref) Task=`bb5803a1-5911-41a0-9f3d-7d84301bc390`::ref 1 aborting False >Thread-53609::INFO::2014-05-16 17:18:20,720::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53609::DEBUG::2014-05-16 17:18:20,720::task::1168::TaskManager.Task::(prepare) Task=`bb5803a1-5911-41a0-9f3d-7d84301bc390`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53609::DEBUG::2014-05-16 17:18:20,720::task::579::TaskManager.Task::(_updateState) Task=`bb5803a1-5911-41a0-9f3d-7d84301bc390`::moving from state preparing -> state finished >Thread-53609::DEBUG::2014-05-16 17:18:20,720::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53609::DEBUG::2014-05-16 17:18:20,720::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53609::DEBUG::2014-05-16 17:18:20,721::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53609::DEBUG::2014-05-16 17:18:20,721::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53609::DEBUG::2014-05-16 17:18:20,721::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53609::DEBUG::2014-05-16 17:18:20,721::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53609::DEBUG::2014-05-16 17:18:20,721::task::974::TaskManager.Task::(_decref) Task=`bb5803a1-5911-41a0-9f3d-7d84301bc390`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:18:22,245::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:22,316::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317895 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:24,328::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:24,399::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356015 s, 28.8 MB/s\n'; <rc> = 0 >Thread-53611::DEBUG::2014-05-16 17:18:25,299::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316621.000000 / 8.011543 / 262500000.000000 = 0.205257 >Thread-53611::DEBUG::2014-05-16 17:18:25,299::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053673032475520669, 'statsAge': 1.1396958827972412, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20525721953073683, 'rxDropped': 0} >Thread-53611::DEBUG::2014-05-16 17:18:25,300::task::579::TaskManager.Task::(_updateState) Task=`a77a4456-9520-49af-93c5-047ec409f423`::moving from state init -> state preparing >Thread-53611::INFO::2014-05-16 17:18:25,300::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53611::INFO::2014-05-16 17:18:25,300::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756774', 'lastCheck': '8.1', 'valid': True}} >Thread-53611::DEBUG::2014-05-16 17:18:25,300::task::1168::TaskManager.Task::(prepare) Task=`a77a4456-9520-49af-93c5-047ec409f423`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756774', 'lastCheck': '8.1', 'valid': True}} >Thread-53611::DEBUG::2014-05-16 17:18:25,301::task::579::TaskManager.Task::(_updateState) Task=`a77a4456-9520-49af-93c5-047ec409f423`::moving from state preparing -> state finished >Thread-53611::DEBUG::2014-05-16 17:18:25,301::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53611::DEBUG::2014-05-16 17:18:25,301::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53611::DEBUG::2014-05-16 17:18:25,301::task::974::TaskManager.Task::(_decref) Task=`a77a4456-9520-49af-93c5-047ec409f423`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:18:26,411::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:26,482::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349699 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:18:27,268::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:18:27,294::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681397 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:28,495::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:28,561::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302262 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:30,573::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:30,644::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353858 s, 28.9 MB/s\n'; <rc> = 0 >Thread-53614::DEBUG::2014-05-16 17:18:30,757::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53614::DEBUG::2014-05-16 17:18:30,758::task::579::TaskManager.Task::(_updateState) Task=`0a0f9ecf-98fa-4be3-8784-402efba3fa63`::moving from state init -> state preparing >Thread-53614::INFO::2014-05-16 17:18:30,758::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53614::INFO::2014-05-16 17:18:30,758::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53614::DEBUG::2014-05-16 17:18:30,758::task::1168::TaskManager.Task::(prepare) Task=`0a0f9ecf-98fa-4be3-8784-402efba3fa63`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53614::DEBUG::2014-05-16 17:18:30,759::task::579::TaskManager.Task::(_updateState) Task=`0a0f9ecf-98fa-4be3-8784-402efba3fa63`::moving from state preparing -> state finished >Thread-53614::DEBUG::2014-05-16 17:18:30,759::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53614::DEBUG::2014-05-16 17:18:30,759::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53614::DEBUG::2014-05-16 17:18:30,759::task::974::TaskManager.Task::(_decref) Task=`0a0f9ecf-98fa-4be3-8784-402efba3fa63`::ref 0 aborting False >Thread-53615::DEBUG::2014-05-16 17:18:30,781::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53615::DEBUG::2014-05-16 17:18:30,781::task::579::TaskManager.Task::(_updateState) Task=`87969ebd-77f8-49dc-a1ab-aaa938c4eb2d`::moving from state init -> state preparing >Thread-53615::INFO::2014-05-16 17:18:30,781::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53615::DEBUG::2014-05-16 17:18:30,781::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`483da060-1a08-45f5-ae3c-70c5aba9d95e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53615::DEBUG::2014-05-16 17:18:30,782::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53615::DEBUG::2014-05-16 17:18:30,782::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53615::DEBUG::2014-05-16 17:18:30,782::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`483da060-1a08-45f5-ae3c-70c5aba9d95e`::Granted request >Thread-53615::DEBUG::2014-05-16 17:18:30,782::task::811::TaskManager.Task::(resourceAcquired) Task=`87969ebd-77f8-49dc-a1ab-aaa938c4eb2d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53615::DEBUG::2014-05-16 17:18:30,783::task::974::TaskManager.Task::(_decref) Task=`87969ebd-77f8-49dc-a1ab-aaa938c4eb2d`::ref 1 aborting False >Thread-53615::INFO::2014-05-16 17:18:30,783::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53615::DEBUG::2014-05-16 17:18:30,783::task::1168::TaskManager.Task::(prepare) Task=`87969ebd-77f8-49dc-a1ab-aaa938c4eb2d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53615::DEBUG::2014-05-16 17:18:30,784::task::579::TaskManager.Task::(_updateState) Task=`87969ebd-77f8-49dc-a1ab-aaa938c4eb2d`::moving from state preparing -> state finished >Thread-53615::DEBUG::2014-05-16 17:18:30,784::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53615::DEBUG::2014-05-16 17:18:30,784::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53615::DEBUG::2014-05-16 17:18:30,784::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53615::DEBUG::2014-05-16 17:18:30,784::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53615::DEBUG::2014-05-16 17:18:30,784::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53615::DEBUG::2014-05-16 17:18:30,784::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53615::DEBUG::2014-05-16 17:18:30,785::task::974::TaskManager.Task::(_decref) Task=`87969ebd-77f8-49dc-a1ab-aaa938c4eb2d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:18:32,656::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:32,727::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354002 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:34,739::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:34,806::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031362 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:36,818::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:36,885::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304773 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:18:37,420::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:18:37,445::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000770293 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:38,897::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:38,969::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356676 s, 28.7 MB/s\n'; <rc> = 0 >Thread-53619::DEBUG::2014-05-16 17:18:40,505::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313065.000000 / 8.008626 / 262500000.000000 = 0.205163 >Thread-53619::DEBUG::2014-05-16 17:18:40,505::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005055501296668985, 'statsAge': 0.32815217971801758, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20516283120170883, 'rxDropped': 0} >Thread-53619::DEBUG::2014-05-16 17:18:40,506::task::579::TaskManager.Task::(_updateState) Task=`74787704-3193-4183-a1d5-70851a91643e`::moving from state init -> state preparing >Thread-53619::INFO::2014-05-16 17:18:40,506::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53619::INFO::2014-05-16 17:18:40,506::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770293', 'lastCheck': '3.0', 'valid': True}} >Thread-53619::DEBUG::2014-05-16 17:18:40,506::task::1168::TaskManager.Task::(prepare) Task=`74787704-3193-4183-a1d5-70851a91643e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770293', 'lastCheck': '3.0', 'valid': True}} >Thread-53619::DEBUG::2014-05-16 17:18:40,506::task::579::TaskManager.Task::(_updateState) Task=`74787704-3193-4183-a1d5-70851a91643e`::moving from state preparing -> state finished >Thread-53619::DEBUG::2014-05-16 17:18:40,506::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53619::DEBUG::2014-05-16 17:18:40,507::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53619::DEBUG::2014-05-16 17:18:40,507::task::974::TaskManager.Task::(_decref) Task=`74787704-3193-4183-a1d5-70851a91643e`::ref 0 aborting False >Thread-53621::DEBUG::2014-05-16 17:18:40,859::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53621::DEBUG::2014-05-16 17:18:40,860::task::579::TaskManager.Task::(_updateState) Task=`dbccbece-b23e-4d8f-b54d-2e345e07b21b`::moving from state init -> state preparing >Thread-53621::INFO::2014-05-16 17:18:40,860::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53621::INFO::2014-05-16 17:18:40,860::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53621::DEBUG::2014-05-16 17:18:40,860::task::1168::TaskManager.Task::(prepare) Task=`dbccbece-b23e-4d8f-b54d-2e345e07b21b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53621::DEBUG::2014-05-16 17:18:40,860::task::579::TaskManager.Task::(_updateState) Task=`dbccbece-b23e-4d8f-b54d-2e345e07b21b`::moving from state preparing -> state finished >Thread-53621::DEBUG::2014-05-16 17:18:40,861::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53621::DEBUG::2014-05-16 17:18:40,861::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53621::DEBUG::2014-05-16 17:18:40,861::task::974::TaskManager.Task::(_decref) Task=`dbccbece-b23e-4d8f-b54d-2e345e07b21b`::ref 0 aborting False >Thread-53622::DEBUG::2014-05-16 17:18:40,870::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53622::DEBUG::2014-05-16 17:18:40,871::task::579::TaskManager.Task::(_updateState) Task=`be034c6a-36c7-412c-8704-8f1208f1d4b6`::moving from state init -> state preparing >Thread-53622::INFO::2014-05-16 17:18:40,871::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53622::DEBUG::2014-05-16 17:18:40,871::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2d1f4c62-a1f5-4b4c-ad47-a2ad207999b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53622::DEBUG::2014-05-16 17:18:40,871::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53622::DEBUG::2014-05-16 17:18:40,872::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53622::DEBUG::2014-05-16 17:18:40,872::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2d1f4c62-a1f5-4b4c-ad47-a2ad207999b0`::Granted request >Thread-53622::DEBUG::2014-05-16 17:18:40,872::task::811::TaskManager.Task::(resourceAcquired) Task=`be034c6a-36c7-412c-8704-8f1208f1d4b6`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53622::DEBUG::2014-05-16 17:18:40,872::task::974::TaskManager.Task::(_decref) Task=`be034c6a-36c7-412c-8704-8f1208f1d4b6`::ref 1 aborting False >Thread-53622::INFO::2014-05-16 17:18:40,873::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53622::DEBUG::2014-05-16 17:18:40,873::task::1168::TaskManager.Task::(prepare) Task=`be034c6a-36c7-412c-8704-8f1208f1d4b6`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53622::DEBUG::2014-05-16 17:18:40,873::task::579::TaskManager.Task::(_updateState) Task=`be034c6a-36c7-412c-8704-8f1208f1d4b6`::moving from state preparing -> state finished >Thread-53622::DEBUG::2014-05-16 17:18:40,873::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53622::DEBUG::2014-05-16 17:18:40,874::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53622::DEBUG::2014-05-16 17:18:40,874::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53622::DEBUG::2014-05-16 17:18:40,874::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53622::DEBUG::2014-05-16 17:18:40,874::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53622::DEBUG::2014-05-16 17:18:40,874::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53622::DEBUG::2014-05-16 17:18:40,874::task::974::TaskManager.Task::(_decref) Task=`be034c6a-36c7-412c-8704-8f1208f1d4b6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:18:40,981::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:41,053::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354196 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:43,065::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:43,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318289 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:45,146::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:45,217::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348921 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:47,228::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:47,299::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348538 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:18:47,583::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:18:47,608::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663821 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:49,311::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:49,377::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301005 s, 34.0 MB/s\n'; <rc> = 0 >Thread-53626::DEBUG::2014-05-16 17:18:50,912::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53626::DEBUG::2014-05-16 17:18:50,913::task::579::TaskManager.Task::(_updateState) Task=`4bc31248-5953-493b-b2b7-e8bf4bd86329`::moving from state init -> state preparing >Thread-53626::INFO::2014-05-16 17:18:50,913::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53626::INFO::2014-05-16 17:18:50,913::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53626::DEBUG::2014-05-16 17:18:50,913::task::1168::TaskManager.Task::(prepare) Task=`4bc31248-5953-493b-b2b7-e8bf4bd86329`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53626::DEBUG::2014-05-16 17:18:50,914::task::579::TaskManager.Task::(_updateState) Task=`4bc31248-5953-493b-b2b7-e8bf4bd86329`::moving from state preparing -> state finished >Thread-53626::DEBUG::2014-05-16 17:18:50,914::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53626::DEBUG::2014-05-16 17:18:50,914::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53626::DEBUG::2014-05-16 17:18:50,914::task::974::TaskManager.Task::(_decref) Task=`4bc31248-5953-493b-b2b7-e8bf4bd86329`::ref 0 aborting False >Thread-53627::DEBUG::2014-05-16 17:18:50,923::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53627::DEBUG::2014-05-16 17:18:50,923::task::579::TaskManager.Task::(_updateState) Task=`7a8e46a2-4c78-402f-843d-5af8dc5e5961`::moving from state init -> state preparing >Thread-53627::INFO::2014-05-16 17:18:50,923::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53627::DEBUG::2014-05-16 17:18:50,923::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0e94c4fa-03a2-4bdc-b354-fb4da4990faf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53627::DEBUG::2014-05-16 17:18:50,924::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53627::DEBUG::2014-05-16 17:18:50,924::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53627::DEBUG::2014-05-16 17:18:50,924::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0e94c4fa-03a2-4bdc-b354-fb4da4990faf`::Granted request >Thread-53627::DEBUG::2014-05-16 17:18:50,924::task::811::TaskManager.Task::(resourceAcquired) Task=`7a8e46a2-4c78-402f-843d-5af8dc5e5961`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53627::DEBUG::2014-05-16 17:18:50,924::task::974::TaskManager.Task::(_decref) Task=`7a8e46a2-4c78-402f-843d-5af8dc5e5961`::ref 1 aborting False >Thread-53627::INFO::2014-05-16 17:18:50,925::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53627::DEBUG::2014-05-16 17:18:50,925::task::1168::TaskManager.Task::(prepare) Task=`7a8e46a2-4c78-402f-843d-5af8dc5e5961`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53627::DEBUG::2014-05-16 17:18:50,925::task::579::TaskManager.Task::(_updateState) Task=`7a8e46a2-4c78-402f-843d-5af8dc5e5961`::moving from state preparing -> state finished >Thread-53627::DEBUG::2014-05-16 17:18:50,926::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53627::DEBUG::2014-05-16 17:18:50,926::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53627::DEBUG::2014-05-16 17:18:50,926::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53627::DEBUG::2014-05-16 17:18:50,926::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53627::DEBUG::2014-05-16 17:18:50,926::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53627::DEBUG::2014-05-16 17:18:50,926::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53627::DEBUG::2014-05-16 17:18:50,927::task::974::TaskManager.Task::(_decref) Task=`7a8e46a2-4c78-402f-843d-5af8dc5e5961`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:18:51,388::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:51,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348779 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:53,470::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:53,538::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031736 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:55,549::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:55,617::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308032 s, 33.2 MB/s\n'; <rc> = 0 >Thread-53629::DEBUG::2014-05-16 17:18:55,687::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5419723.000000 / 8.008482 / 262500000.000000 = 0.257809 >Thread-53629::DEBUG::2014-05-16 17:18:55,687::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066642675608373381, 'statsAge': 1.4954020977020264, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25780870660269256, 'rxDropped': 0} >Thread-53629::DEBUG::2014-05-16 17:18:55,688::task::579::TaskManager.Task::(_updateState) Task=`6738343a-592a-4895-b0f1-38eda034c241`::moving from state init -> state preparing >Thread-53629::INFO::2014-05-16 17:18:55,688::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53629::INFO::2014-05-16 17:18:55,688::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663821', 'lastCheck': '8.0', 'valid': True}} >Thread-53629::DEBUG::2014-05-16 17:18:55,688::task::1168::TaskManager.Task::(prepare) Task=`6738343a-592a-4895-b0f1-38eda034c241`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663821', 'lastCheck': '8.0', 'valid': True}} >Thread-53629::DEBUG::2014-05-16 17:18:55,688::task::579::TaskManager.Task::(_updateState) Task=`6738343a-592a-4895-b0f1-38eda034c241`::moving from state preparing -> state finished >Thread-53629::DEBUG::2014-05-16 17:18:55,689::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53629::DEBUG::2014-05-16 17:18:55,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53629::DEBUG::2014-05-16 17:18:55,689::task::974::TaskManager.Task::(_decref) Task=`6738343a-592a-4895-b0f1-38eda034c241`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:18:57,629::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:57,696::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310611 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:18:57,740::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:18:57,766::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721392 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:18:59,707::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:18:59,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035564 s, 28.8 MB/s\n'; <rc> = 0 >Thread-53632::DEBUG::2014-05-16 17:19:00,973::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53632::DEBUG::2014-05-16 17:19:00,974::task::579::TaskManager.Task::(_updateState) Task=`25ad32fe-0e8a-41c4-848f-faf889edfbfd`::moving from state init -> state preparing >Thread-53632::INFO::2014-05-16 17:19:00,974::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53632::INFO::2014-05-16 17:19:00,974::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53632::DEBUG::2014-05-16 17:19:00,974::task::1168::TaskManager.Task::(prepare) Task=`25ad32fe-0e8a-41c4-848f-faf889edfbfd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53632::DEBUG::2014-05-16 17:19:00,975::task::579::TaskManager.Task::(_updateState) Task=`25ad32fe-0e8a-41c4-848f-faf889edfbfd`::moving from state preparing -> state finished >Thread-53632::DEBUG::2014-05-16 17:19:00,975::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53632::DEBUG::2014-05-16 17:19:00,975::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53632::DEBUG::2014-05-16 17:19:00,975::task::974::TaskManager.Task::(_decref) Task=`25ad32fe-0e8a-41c4-848f-faf889edfbfd`::ref 0 aborting False >Thread-53633::DEBUG::2014-05-16 17:19:00,984::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53633::DEBUG::2014-05-16 17:19:00,984::task::579::TaskManager.Task::(_updateState) Task=`7560e813-7ddc-43ce-978d-8290df40b3e2`::moving from state init -> state preparing >Thread-53633::INFO::2014-05-16 17:19:00,984::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53633::DEBUG::2014-05-16 17:19:00,985::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b05bd78a-9188-4712-b32b-594b107c9ba1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53633::DEBUG::2014-05-16 17:19:00,985::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53633::DEBUG::2014-05-16 17:19:00,985::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53633::DEBUG::2014-05-16 17:19:00,985::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b05bd78a-9188-4712-b32b-594b107c9ba1`::Granted request >Thread-53633::DEBUG::2014-05-16 17:19:00,986::task::811::TaskManager.Task::(resourceAcquired) Task=`7560e813-7ddc-43ce-978d-8290df40b3e2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53633::DEBUG::2014-05-16 17:19:00,986::task::974::TaskManager.Task::(_decref) Task=`7560e813-7ddc-43ce-978d-8290df40b3e2`::ref 1 aborting False >Thread-53633::INFO::2014-05-16 17:19:00,986::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53633::DEBUG::2014-05-16 17:19:00,987::task::1168::TaskManager.Task::(prepare) Task=`7560e813-7ddc-43ce-978d-8290df40b3e2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53633::DEBUG::2014-05-16 17:19:00,987::task::579::TaskManager.Task::(_updateState) Task=`7560e813-7ddc-43ce-978d-8290df40b3e2`::moving from state preparing -> state finished >Thread-53633::DEBUG::2014-05-16 17:19:00,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53633::DEBUG::2014-05-16 17:19:00,987::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53633::DEBUG::2014-05-16 17:19:00,987::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53633::DEBUG::2014-05-16 17:19:00,988::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53633::DEBUG::2014-05-16 17:19:00,988::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53633::DEBUG::2014-05-16 17:19:00,988::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53633::DEBUG::2014-05-16 17:19:00,988::task::974::TaskManager.Task::(_decref) Task=`7560e813-7ddc-43ce-978d-8290df40b3e2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:19:01,792::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:01,870::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357665 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:03,882::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:03,949::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030846 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:05,961::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:06,032::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346932 s, 29.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:19:07,875::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:19:07,906::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000554556 s, 7.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:08,044::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:08,117::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350583 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:10,129::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:10,196::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301693 s, 33.9 MB/s\n'; <rc> = 0 >Thread-53637::DEBUG::2014-05-16 17:19:10,938::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5417944.000000 / 8.008598 / 262500000.000000 = 0.257720 >Thread-53637::DEBUG::2014-05-16 17:19:10,938::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0064032133131765537, 'statsAge': 0.72936797142028809, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2577203455178218, 'rxDropped': 0} >Thread-53637::DEBUG::2014-05-16 17:19:10,939::task::579::TaskManager.Task::(_updateState) Task=`7d40a2a6-3ffb-4e88-b04a-abef96e0c419`::moving from state init -> state preparing >Thread-53637::INFO::2014-05-16 17:19:10,939::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53637::INFO::2014-05-16 17:19:10,939::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554556', 'lastCheck': '2.9', 'valid': True}} >Thread-53637::DEBUG::2014-05-16 17:19:10,940::task::1168::TaskManager.Task::(prepare) Task=`7d40a2a6-3ffb-4e88-b04a-abef96e0c419`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554556', 'lastCheck': '2.9', 'valid': True}} >Thread-53637::DEBUG::2014-05-16 17:19:10,940::task::579::TaskManager.Task::(_updateState) Task=`7d40a2a6-3ffb-4e88-b04a-abef96e0c419`::moving from state preparing -> state finished >Thread-53637::DEBUG::2014-05-16 17:19:10,940::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53637::DEBUG::2014-05-16 17:19:10,940::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53637::DEBUG::2014-05-16 17:19:10,940::task::974::TaskManager.Task::(_decref) Task=`7d40a2a6-3ffb-4e88-b04a-abef96e0c419`::ref 0 aborting False >Thread-53639::DEBUG::2014-05-16 17:19:11,022::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53639::DEBUG::2014-05-16 17:19:11,022::task::579::TaskManager.Task::(_updateState) Task=`545b17e6-1c40-4eb0-abad-f613c6d6a5a5`::moving from state init -> state preparing >Thread-53639::INFO::2014-05-16 17:19:11,022::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53639::INFO::2014-05-16 17:19:11,022::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53639::DEBUG::2014-05-16 17:19:11,023::task::1168::TaskManager.Task::(prepare) Task=`545b17e6-1c40-4eb0-abad-f613c6d6a5a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53639::DEBUG::2014-05-16 17:19:11,023::task::579::TaskManager.Task::(_updateState) Task=`545b17e6-1c40-4eb0-abad-f613c6d6a5a5`::moving from state preparing -> state finished >Thread-53639::DEBUG::2014-05-16 17:19:11,023::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53639::DEBUG::2014-05-16 17:19:11,023::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53639::DEBUG::2014-05-16 17:19:11,023::task::974::TaskManager.Task::(_decref) Task=`545b17e6-1c40-4eb0-abad-f613c6d6a5a5`::ref 0 aborting False >Thread-53640::DEBUG::2014-05-16 17:19:11,032::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53640::DEBUG::2014-05-16 17:19:11,033::task::579::TaskManager.Task::(_updateState) Task=`0d720371-a1e1-4bd4-ad73-96ac7efe8242`::moving from state init -> state preparing >Thread-53640::INFO::2014-05-16 17:19:11,033::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53640::DEBUG::2014-05-16 17:19:11,034::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`98a1175d-c919-4032-8569-800a01c3a4b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53640::DEBUG::2014-05-16 17:19:11,034::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53640::DEBUG::2014-05-16 17:19:11,035::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53640::DEBUG::2014-05-16 17:19:11,035::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`98a1175d-c919-4032-8569-800a01c3a4b8`::Granted request >Thread-53640::DEBUG::2014-05-16 17:19:11,035::task::811::TaskManager.Task::(resourceAcquired) Task=`0d720371-a1e1-4bd4-ad73-96ac7efe8242`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53640::DEBUG::2014-05-16 17:19:11,035::task::974::TaskManager.Task::(_decref) Task=`0d720371-a1e1-4bd4-ad73-96ac7efe8242`::ref 1 aborting False >Thread-53640::INFO::2014-05-16 17:19:11,036::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53640::DEBUG::2014-05-16 17:19:11,036::task::1168::TaskManager.Task::(prepare) Task=`0d720371-a1e1-4bd4-ad73-96ac7efe8242`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53640::DEBUG::2014-05-16 17:19:11,036::task::579::TaskManager.Task::(_updateState) Task=`0d720371-a1e1-4bd4-ad73-96ac7efe8242`::moving from state preparing -> state finished >Thread-53640::DEBUG::2014-05-16 17:19:11,036::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53640::DEBUG::2014-05-16 17:19:11,037::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53640::DEBUG::2014-05-16 17:19:11,037::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53640::DEBUG::2014-05-16 17:19:11,037::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53640::DEBUG::2014-05-16 17:19:11,037::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53640::DEBUG::2014-05-16 17:19:11,037::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53640::DEBUG::2014-05-16 17:19:11,037::task::974::TaskManager.Task::(_decref) Task=`0d720371-a1e1-4bd4-ad73-96ac7efe8242`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:19:12,207::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:12,278::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347452 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:14,290::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:14,357::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314052 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:16,369::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:16,440::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350876 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:19:18,027::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:19:18,053::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721787 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:18,451::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:18,524::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358636 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:20,535::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:20,602::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307635 s, 33.3 MB/s\n'; <rc> = 0 >Thread-53644::DEBUG::2014-05-16 17:19:21,070::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53644::DEBUG::2014-05-16 17:19:21,070::task::579::TaskManager.Task::(_updateState) Task=`048c7bed-1c2a-4a61-a31e-fcd15af2ab00`::moving from state init -> state preparing >Thread-53644::INFO::2014-05-16 17:19:21,071::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53644::INFO::2014-05-16 17:19:21,071::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53644::DEBUG::2014-05-16 17:19:21,071::task::1168::TaskManager.Task::(prepare) Task=`048c7bed-1c2a-4a61-a31e-fcd15af2ab00`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53644::DEBUG::2014-05-16 17:19:21,071::task::579::TaskManager.Task::(_updateState) Task=`048c7bed-1c2a-4a61-a31e-fcd15af2ab00`::moving from state preparing -> state finished >Thread-53644::DEBUG::2014-05-16 17:19:21,071::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53644::DEBUG::2014-05-16 17:19:21,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53644::DEBUG::2014-05-16 17:19:21,072::task::974::TaskManager.Task::(_decref) Task=`048c7bed-1c2a-4a61-a31e-fcd15af2ab00`::ref 0 aborting False >Thread-53645::DEBUG::2014-05-16 17:19:21,080::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53645::DEBUG::2014-05-16 17:19:21,081::task::579::TaskManager.Task::(_updateState) Task=`892a80fd-b3bc-4d0a-8609-443f47c0c2cb`::moving from state init -> state preparing >Thread-53645::INFO::2014-05-16 17:19:21,081::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53645::DEBUG::2014-05-16 17:19:21,081::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`892ca400-2de5-41cd-8f9b-f3b3877e95a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53645::DEBUG::2014-05-16 17:19:21,082::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53645::DEBUG::2014-05-16 17:19:21,082::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53645::DEBUG::2014-05-16 17:19:21,082::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`892ca400-2de5-41cd-8f9b-f3b3877e95a3`::Granted request >Thread-53645::DEBUG::2014-05-16 17:19:21,082::task::811::TaskManager.Task::(resourceAcquired) Task=`892a80fd-b3bc-4d0a-8609-443f47c0c2cb`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53645::DEBUG::2014-05-16 17:19:21,082::task::974::TaskManager.Task::(_decref) Task=`892a80fd-b3bc-4d0a-8609-443f47c0c2cb`::ref 1 aborting False >Thread-53645::INFO::2014-05-16 17:19:21,083::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53645::DEBUG::2014-05-16 17:19:21,083::task::1168::TaskManager.Task::(prepare) Task=`892a80fd-b3bc-4d0a-8609-443f47c0c2cb`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53645::DEBUG::2014-05-16 17:19:21,083::task::579::TaskManager.Task::(_updateState) Task=`892a80fd-b3bc-4d0a-8609-443f47c0c2cb`::moving from state preparing -> state finished >Thread-53645::DEBUG::2014-05-16 17:19:21,084::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53645::DEBUG::2014-05-16 17:19:21,084::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53645::DEBUG::2014-05-16 17:19:21,084::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53645::DEBUG::2014-05-16 17:19:21,084::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53645::DEBUG::2014-05-16 17:19:21,084::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53645::DEBUG::2014-05-16 17:19:21,084::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53645::DEBUG::2014-05-16 17:19:21,085::task::974::TaskManager.Task::(_decref) Task=`892a80fd-b3bc-4d0a-8609-443f47c0c2cb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:19:22,614::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:22,681::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305002 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:24,693::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:24,760::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314401 s, 32.6 MB/s\n'; <rc> = 0 >Thread-53647::DEBUG::2014-05-16 17:19:26,083::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318707.000000 / 8.007993 / 262500000.000000 = 0.205447 >Thread-53647::DEBUG::2014-05-16 17:19:26,084::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053660670512585829, 'statsAge': 1.8559608459472656, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20544744092854433, 'rxDropped': 0} >Thread-53647::DEBUG::2014-05-16 17:19:26,084::task::579::TaskManager.Task::(_updateState) Task=`5c971646-2135-4dba-a286-33eeaf37e4d7`::moving from state init -> state preparing >Thread-53647::INFO::2014-05-16 17:19:26,084::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53647::INFO::2014-05-16 17:19:26,085::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721787', 'lastCheck': '7.9', 'valid': True}} >Thread-53647::DEBUG::2014-05-16 17:19:26,085::task::1168::TaskManager.Task::(prepare) Task=`5c971646-2135-4dba-a286-33eeaf37e4d7`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721787', 'lastCheck': '7.9', 'valid': True}} >Thread-53647::DEBUG::2014-05-16 17:19:26,085::task::579::TaskManager.Task::(_updateState) Task=`5c971646-2135-4dba-a286-33eeaf37e4d7`::moving from state preparing -> state finished >Thread-53647::DEBUG::2014-05-16 17:19:26,085::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53647::DEBUG::2014-05-16 17:19:26,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53647::DEBUG::2014-05-16 17:19:26,085::task::974::TaskManager.Task::(_decref) Task=`5c971646-2135-4dba-a286-33eeaf37e4d7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:19:26,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:26,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348916 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:19:28,163::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:19:28,188::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100145 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:28,855::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:28,926::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360375 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:30,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:31,013::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304618 s, 33.6 MB/s\n'; <rc> = 0 >Thread-53650::DEBUG::2014-05-16 17:19:31,157::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53650::DEBUG::2014-05-16 17:19:31,158::task::579::TaskManager.Task::(_updateState) Task=`77b89a2f-46c1-4a8d-b92d-6bf48714d5e4`::moving from state init -> state preparing >Thread-53650::INFO::2014-05-16 17:19:31,158::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53650::INFO::2014-05-16 17:19:31,158::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53650::DEBUG::2014-05-16 17:19:31,158::task::1168::TaskManager.Task::(prepare) Task=`77b89a2f-46c1-4a8d-b92d-6bf48714d5e4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53650::DEBUG::2014-05-16 17:19:31,158::task::579::TaskManager.Task::(_updateState) Task=`77b89a2f-46c1-4a8d-b92d-6bf48714d5e4`::moving from state preparing -> state finished >Thread-53650::DEBUG::2014-05-16 17:19:31,159::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53650::DEBUG::2014-05-16 17:19:31,159::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53650::DEBUG::2014-05-16 17:19:31,159::task::974::TaskManager.Task::(_decref) Task=`77b89a2f-46c1-4a8d-b92d-6bf48714d5e4`::ref 0 aborting False >Thread-53651::DEBUG::2014-05-16 17:19:31,168::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53651::DEBUG::2014-05-16 17:19:31,168::task::579::TaskManager.Task::(_updateState) Task=`3c204a15-54b3-49e3-8678-8e4b95701809`::moving from state init -> state preparing >Thread-53651::INFO::2014-05-16 17:19:31,169::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53651::DEBUG::2014-05-16 17:19:31,169::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ed58128f-1869-459c-99a6-cdb8a86ba41a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53651::DEBUG::2014-05-16 17:19:31,169::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53651::DEBUG::2014-05-16 17:19:31,169::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53651::DEBUG::2014-05-16 17:19:31,170::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ed58128f-1869-459c-99a6-cdb8a86ba41a`::Granted request >Thread-53651::DEBUG::2014-05-16 17:19:31,170::task::811::TaskManager.Task::(resourceAcquired) Task=`3c204a15-54b3-49e3-8678-8e4b95701809`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53651::DEBUG::2014-05-16 17:19:31,170::task::974::TaskManager.Task::(_decref) Task=`3c204a15-54b3-49e3-8678-8e4b95701809`::ref 1 aborting False >Thread-53651::INFO::2014-05-16 17:19:31,171::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53651::DEBUG::2014-05-16 17:19:31,171::task::1168::TaskManager.Task::(prepare) Task=`3c204a15-54b3-49e3-8678-8e4b95701809`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53651::DEBUG::2014-05-16 17:19:31,171::task::579::TaskManager.Task::(_updateState) Task=`3c204a15-54b3-49e3-8678-8e4b95701809`::moving from state preparing -> state finished >Thread-53651::DEBUG::2014-05-16 17:19:31,171::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53651::DEBUG::2014-05-16 17:19:31,171::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53651::DEBUG::2014-05-16 17:19:31,172::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53651::DEBUG::2014-05-16 17:19:31,172::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53651::DEBUG::2014-05-16 17:19:31,172::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53651::DEBUG::2014-05-16 17:19:31,172::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53651::DEBUG::2014-05-16 17:19:31,172::task::974::TaskManager.Task::(_decref) Task=`3c204a15-54b3-49e3-8678-8e4b95701809`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:19:33,026::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:33,098::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350432 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:35,109::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:35,176::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309017 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:37,187::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:37,254::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031423 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:19:38,317::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:19:38,342::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780979 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:39,266::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:39,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356206 s, 28.7 MB/s\n'; <rc> = 0 >Thread-53655::DEBUG::2014-05-16 17:19:41,236::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53655::DEBUG::2014-05-16 17:19:41,236::task::579::TaskManager.Task::(_updateState) Task=`24b2cec4-ccd7-4ff3-bf3a-fd13a5023d26`::moving from state init -> state preparing >Thread-53655::INFO::2014-05-16 17:19:41,236::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53655::INFO::2014-05-16 17:19:41,237::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53655::DEBUG::2014-05-16 17:19:41,237::task::1168::TaskManager.Task::(prepare) Task=`24b2cec4-ccd7-4ff3-bf3a-fd13a5023d26`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53655::DEBUG::2014-05-16 17:19:41,237::task::579::TaskManager.Task::(_updateState) Task=`24b2cec4-ccd7-4ff3-bf3a-fd13a5023d26`::moving from state preparing -> state finished >Thread-53655::DEBUG::2014-05-16 17:19:41,237::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53655::DEBUG::2014-05-16 17:19:41,237::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53655::DEBUG::2014-05-16 17:19:41,237::task::974::TaskManager.Task::(_decref) Task=`24b2cec4-ccd7-4ff3-bf3a-fd13a5023d26`::ref 0 aborting False >Thread-53656::DEBUG::2014-05-16 17:19:41,246::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53656::DEBUG::2014-05-16 17:19:41,247::task::579::TaskManager.Task::(_updateState) Task=`43abaad1-62d3-47d3-8778-b10975064584`::moving from state init -> state preparing >Thread-53656::INFO::2014-05-16 17:19:41,247::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53656::DEBUG::2014-05-16 17:19:41,247::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a63765e1-d652-4c67-9a0d-16fa6b1def9a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53656::DEBUG::2014-05-16 17:19:41,248::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53656::DEBUG::2014-05-16 17:19:41,248::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53656::DEBUG::2014-05-16 17:19:41,248::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a63765e1-d652-4c67-9a0d-16fa6b1def9a`::Granted request >Thread-53656::DEBUG::2014-05-16 17:19:41,248::task::811::TaskManager.Task::(resourceAcquired) Task=`43abaad1-62d3-47d3-8778-b10975064584`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53656::DEBUG::2014-05-16 17:19:41,248::task::974::TaskManager.Task::(_decref) Task=`43abaad1-62d3-47d3-8778-b10975064584`::ref 1 aborting False >Thread-53656::INFO::2014-05-16 17:19:41,249::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53656::DEBUG::2014-05-16 17:19:41,249::task::1168::TaskManager.Task::(prepare) Task=`43abaad1-62d3-47d3-8778-b10975064584`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53656::DEBUG::2014-05-16 17:19:41,249::task::579::TaskManager.Task::(_updateState) Task=`43abaad1-62d3-47d3-8778-b10975064584`::moving from state preparing -> state finished >Thread-53656::DEBUG::2014-05-16 17:19:41,250::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53656::DEBUG::2014-05-16 17:19:41,250::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53656::DEBUG::2014-05-16 17:19:41,250::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53656::DEBUG::2014-05-16 17:19:41,250::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53656::DEBUG::2014-05-16 17:19:41,250::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53656::DEBUG::2014-05-16 17:19:41,250::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53656::DEBUG::2014-05-16 17:19:41,251::task::974::TaskManager.Task::(_decref) Task=`43abaad1-62d3-47d3-8778-b10975064584`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:19:41,349::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-53657::DEBUG::2014-05-16 17:19:41,422::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318492.000000 / 8.008361 / 262500000.000000 = 0.205428 >Thread-53657::DEBUG::2014-05-16 17:19:41,423::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052223516031979951, 'statsAge': 1.169154167175293, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20542778200464287, 'rxDropped': 0} >Thread-53657::DEBUG::2014-05-16 17:19:41,424::task::579::TaskManager.Task::(_updateState) Task=`43fd5210-2964-47e5-901b-5fb991459bda`::moving from state init -> state preparing >Thread-53657::INFO::2014-05-16 17:19:41,425::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53657::INFO::2014-05-16 17:19:41,426::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780979', 'lastCheck': '3.0', 'valid': True}} >Thread-53657::DEBUG::2014-05-16 17:19:41,427::task::1168::TaskManager.Task::(prepare) Task=`43fd5210-2964-47e5-901b-5fb991459bda`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780979', 'lastCheck': '3.0', 'valid': True}} >Thread-53657::DEBUG::2014-05-16 17:19:41,428::task::579::TaskManager.Task::(_updateState) Task=`43fd5210-2964-47e5-901b-5fb991459bda`::moving from state preparing -> state finished >Thread-53657::DEBUG::2014-05-16 17:19:41,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53657::DEBUG::2014-05-16 17:19:41,430::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53657::DEBUG::2014-05-16 17:19:41,430::task::974::TaskManager.Task::(_decref) Task=`43fd5210-2964-47e5-901b-5fb991459bda`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:19:41,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350964 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:43,458::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:43,526::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322171 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:45,538::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:45,608::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348305 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:47,620::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:47,694::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356183 s, 28.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:19:48,480::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:19:48,505::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000807488 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:49,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:49,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031362 s, 32.7 MB/s\n'; <rc> = 0 >Thread-53662::DEBUG::2014-05-16 17:19:51,287::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53662::DEBUG::2014-05-16 17:19:51,288::task::579::TaskManager.Task::(_updateState) Task=`6a30aa51-f585-4612-9bd4-74659d413a0b`::moving from state init -> state preparing >Thread-53662::INFO::2014-05-16 17:19:51,288::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53662::INFO::2014-05-16 17:19:51,288::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53662::DEBUG::2014-05-16 17:19:51,288::task::1168::TaskManager.Task::(prepare) Task=`6a30aa51-f585-4612-9bd4-74659d413a0b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53662::DEBUG::2014-05-16 17:19:51,288::task::579::TaskManager.Task::(_updateState) Task=`6a30aa51-f585-4612-9bd4-74659d413a0b`::moving from state preparing -> state finished >Thread-53662::DEBUG::2014-05-16 17:19:51,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53662::DEBUG::2014-05-16 17:19:51,289::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53662::DEBUG::2014-05-16 17:19:51,289::task::974::TaskManager.Task::(_decref) Task=`6a30aa51-f585-4612-9bd4-74659d413a0b`::ref 0 aborting False >Thread-53663::DEBUG::2014-05-16 17:19:51,324::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53663::DEBUG::2014-05-16 17:19:51,324::task::579::TaskManager.Task::(_updateState) Task=`a0766937-3e00-4951-9883-20f41f1f7fcb`::moving from state init -> state preparing >Thread-53663::INFO::2014-05-16 17:19:51,324::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53663::DEBUG::2014-05-16 17:19:51,325::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5d2a956f-1d62-4067-b128-365c4d766452`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53663::DEBUG::2014-05-16 17:19:51,325::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53663::DEBUG::2014-05-16 17:19:51,325::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53663::DEBUG::2014-05-16 17:19:51,325::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5d2a956f-1d62-4067-b128-365c4d766452`::Granted request >Thread-53663::DEBUG::2014-05-16 17:19:51,326::task::811::TaskManager.Task::(resourceAcquired) Task=`a0766937-3e00-4951-9883-20f41f1f7fcb`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53663::DEBUG::2014-05-16 17:19:51,326::task::974::TaskManager.Task::(_decref) Task=`a0766937-3e00-4951-9883-20f41f1f7fcb`::ref 1 aborting False >Thread-53663::INFO::2014-05-16 17:19:51,327::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53663::DEBUG::2014-05-16 17:19:51,327::task::1168::TaskManager.Task::(prepare) Task=`a0766937-3e00-4951-9883-20f41f1f7fcb`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53663::DEBUG::2014-05-16 17:19:51,327::task::579::TaskManager.Task::(_updateState) Task=`a0766937-3e00-4951-9883-20f41f1f7fcb`::moving from state preparing -> state finished >Thread-53663::DEBUG::2014-05-16 17:19:51,327::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53663::DEBUG::2014-05-16 17:19:51,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53663::DEBUG::2014-05-16 17:19:51,327::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53663::DEBUG::2014-05-16 17:19:51,328::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53663::DEBUG::2014-05-16 17:19:51,328::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53663::DEBUG::2014-05-16 17:19:51,328::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53663::DEBUG::2014-05-16 17:19:51,328::task::974::TaskManager.Task::(_decref) Task=`a0766937-3e00-4951-9883-20f41f1f7fcb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:19:51,785::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:51,850::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303897 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:53,862::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:53,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369991 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:19:55,946::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:56,013::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313462 s, 32.7 MB/s\n'; <rc> = 0 >Thread-53665::DEBUG::2014-05-16 17:19:56,679::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4340641.000000 / 8.008558 / 262500000.000000 = 0.206476 >Thread-53665::DEBUG::2014-05-16 17:19:56,679::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0055350312571206817, 'statsAge': 0.41061305999755859, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2064763115412476, 'rxDropped': 0} >Thread-53665::DEBUG::2014-05-16 17:19:56,680::task::579::TaskManager.Task::(_updateState) Task=`c50b92cf-dfcb-431a-a951-4a0375690b7c`::moving from state init -> state preparing >Thread-53665::INFO::2014-05-16 17:19:56,680::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53665::INFO::2014-05-16 17:19:56,680::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807488', 'lastCheck': '8.1', 'valid': True}} >Thread-53665::DEBUG::2014-05-16 17:19:56,680::task::1168::TaskManager.Task::(prepare) Task=`c50b92cf-dfcb-431a-a951-4a0375690b7c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807488', 'lastCheck': '8.1', 'valid': True}} >Thread-53665::DEBUG::2014-05-16 17:19:56,681::task::579::TaskManager.Task::(_updateState) Task=`c50b92cf-dfcb-431a-a951-4a0375690b7c`::moving from state preparing -> state finished >Thread-53665::DEBUG::2014-05-16 17:19:56,681::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53665::DEBUG::2014-05-16 17:19:56,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53665::DEBUG::2014-05-16 17:19:56,681::task::974::TaskManager.Task::(_decref) Task=`c50b92cf-dfcb-431a-a951-4a0375690b7c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:19:58,025::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:19:58,091::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310646 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:19:58,628::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:19:58,653::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000724473 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:00,103::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:00,174::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348696 s, 29.4 MB/s\n'; <rc> = 0 >Thread-53668::DEBUG::2014-05-16 17:20:01,366::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53668::DEBUG::2014-05-16 17:20:01,368::task::579::TaskManager.Task::(_updateState) Task=`f479afff-8e05-4283-aaef-1066c1c90264`::moving from state init -> state preparing >Thread-53668::INFO::2014-05-16 17:20:01,368::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53668::INFO::2014-05-16 17:20:01,368::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53668::DEBUG::2014-05-16 17:20:01,368::task::1168::TaskManager.Task::(prepare) Task=`f479afff-8e05-4283-aaef-1066c1c90264`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53668::DEBUG::2014-05-16 17:20:01,369::task::579::TaskManager.Task::(_updateState) Task=`f479afff-8e05-4283-aaef-1066c1c90264`::moving from state preparing -> state finished >Thread-53668::DEBUG::2014-05-16 17:20:01,369::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53668::DEBUG::2014-05-16 17:20:01,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53668::DEBUG::2014-05-16 17:20:01,369::task::974::TaskManager.Task::(_decref) Task=`f479afff-8e05-4283-aaef-1066c1c90264`::ref 0 aborting False >Thread-53669::DEBUG::2014-05-16 17:20:01,379::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53669::DEBUG::2014-05-16 17:20:01,379::task::579::TaskManager.Task::(_updateState) Task=`39803df2-e9cb-493b-9aaf-3da3ab99d5ac`::moving from state init -> state preparing >Thread-53669::INFO::2014-05-16 17:20:01,379::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53669::DEBUG::2014-05-16 17:20:01,380::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7f2d751e-60d4-448c-931f-7d761590da7b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53669::DEBUG::2014-05-16 17:20:01,380::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53669::DEBUG::2014-05-16 17:20:01,380::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53669::DEBUG::2014-05-16 17:20:01,380::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7f2d751e-60d4-448c-931f-7d761590da7b`::Granted request >Thread-53669::DEBUG::2014-05-16 17:20:01,381::task::811::TaskManager.Task::(resourceAcquired) Task=`39803df2-e9cb-493b-9aaf-3da3ab99d5ac`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53669::DEBUG::2014-05-16 17:20:01,381::task::974::TaskManager.Task::(_decref) Task=`39803df2-e9cb-493b-9aaf-3da3ab99d5ac`::ref 1 aborting False >Thread-53669::INFO::2014-05-16 17:20:01,382::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53669::DEBUG::2014-05-16 17:20:01,382::task::1168::TaskManager.Task::(prepare) Task=`39803df2-e9cb-493b-9aaf-3da3ab99d5ac`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53669::DEBUG::2014-05-16 17:20:01,382::task::579::TaskManager.Task::(_updateState) Task=`39803df2-e9cb-493b-9aaf-3da3ab99d5ac`::moving from state preparing -> state finished >Thread-53669::DEBUG::2014-05-16 17:20:01,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53669::DEBUG::2014-05-16 17:20:01,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53669::DEBUG::2014-05-16 17:20:01,382::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53669::DEBUG::2014-05-16 17:20:01,383::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53669::DEBUG::2014-05-16 17:20:01,383::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53669::DEBUG::2014-05-16 17:20:01,383::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53669::DEBUG::2014-05-16 17:20:01,383::task::974::TaskManager.Task::(_decref) Task=`39803df2-e9cb-493b-9aaf-3da3ab99d5ac`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:20:02,185::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:02,258::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355315 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:04,269::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:04,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315073 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:06,349::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:06,419::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348689 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:08,431::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:08,499::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311103 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:20:08,783::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:20:08,807::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703412 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:10,510::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:10,576::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298829 s, 34.3 MB/s\n'; <rc> = 0 >Thread-53673::DEBUG::2014-05-16 17:20:11,431::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53673::DEBUG::2014-05-16 17:20:11,432::task::579::TaskManager.Task::(_updateState) Task=`283f3f25-a94a-415a-9c3e-bca5c1386922`::moving from state init -> state preparing >Thread-53673::INFO::2014-05-16 17:20:11,432::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53673::INFO::2014-05-16 17:20:11,433::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53673::DEBUG::2014-05-16 17:20:11,433::task::1168::TaskManager.Task::(prepare) Task=`283f3f25-a94a-415a-9c3e-bca5c1386922`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53673::DEBUG::2014-05-16 17:20:11,433::task::579::TaskManager.Task::(_updateState) Task=`283f3f25-a94a-415a-9c3e-bca5c1386922`::moving from state preparing -> state finished >Thread-53673::DEBUG::2014-05-16 17:20:11,433::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53673::DEBUG::2014-05-16 17:20:11,433::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53673::DEBUG::2014-05-16 17:20:11,433::task::974::TaskManager.Task::(_decref) Task=`283f3f25-a94a-415a-9c3e-bca5c1386922`::ref 0 aborting False >Thread-53674::DEBUG::2014-05-16 17:20:11,442::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53674::DEBUG::2014-05-16 17:20:11,442::task::579::TaskManager.Task::(_updateState) Task=`4cef3f27-6a90-441e-a63c-145e2e8e38aa`::moving from state init -> state preparing >Thread-53674::INFO::2014-05-16 17:20:11,442::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53674::DEBUG::2014-05-16 17:20:11,443::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d8a4d04b-3225-497a-886f-3d5903d02e91`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53674::DEBUG::2014-05-16 17:20:11,443::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53674::DEBUG::2014-05-16 17:20:11,443::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53674::DEBUG::2014-05-16 17:20:11,443::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d8a4d04b-3225-497a-886f-3d5903d02e91`::Granted request >Thread-53674::DEBUG::2014-05-16 17:20:11,443::task::811::TaskManager.Task::(resourceAcquired) Task=`4cef3f27-6a90-441e-a63c-145e2e8e38aa`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53674::DEBUG::2014-05-16 17:20:11,444::task::974::TaskManager.Task::(_decref) Task=`4cef3f27-6a90-441e-a63c-145e2e8e38aa`::ref 1 aborting False >Thread-53674::INFO::2014-05-16 17:20:11,444::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53674::DEBUG::2014-05-16 17:20:11,444::task::1168::TaskManager.Task::(prepare) Task=`4cef3f27-6a90-441e-a63c-145e2e8e38aa`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53674::DEBUG::2014-05-16 17:20:11,445::task::579::TaskManager.Task::(_updateState) Task=`4cef3f27-6a90-441e-a63c-145e2e8e38aa`::moving from state preparing -> state finished >Thread-53674::DEBUG::2014-05-16 17:20:11,445::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53674::DEBUG::2014-05-16 17:20:11,445::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53674::DEBUG::2014-05-16 17:20:11,445::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53674::DEBUG::2014-05-16 17:20:11,445::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53674::DEBUG::2014-05-16 17:20:11,445::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53674::DEBUG::2014-05-16 17:20:11,446::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53674::DEBUG::2014-05-16 17:20:11,446::task::974::TaskManager.Task::(_decref) Task=`4cef3f27-6a90-441e-a63c-145e2e8e38aa`::ref 0 aborting False >Thread-53675::DEBUG::2014-05-16 17:20:11,921::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4308130.000000 / 8.008471 / 262500000.000000 = 0.204932 >Thread-53675::DEBUG::2014-05-16 17:20:11,921::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051178189569394631, 'statsAge': 1.6378190517425537, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20493204988437008, 'rxDropped': 0} >Thread-53675::DEBUG::2014-05-16 17:20:11,922::task::579::TaskManager.Task::(_updateState) Task=`4a303a15-bbc1-48db-ab0d-2288a198faff`::moving from state init -> state preparing >Thread-53675::INFO::2014-05-16 17:20:11,922::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53675::INFO::2014-05-16 17:20:11,922::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703412', 'lastCheck': '3.0', 'valid': True}} >Thread-53675::DEBUG::2014-05-16 17:20:11,922::task::1168::TaskManager.Task::(prepare) Task=`4a303a15-bbc1-48db-ab0d-2288a198faff`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703412', 'lastCheck': '3.0', 'valid': True}} >Thread-53675::DEBUG::2014-05-16 17:20:11,922::task::579::TaskManager.Task::(_updateState) Task=`4a303a15-bbc1-48db-ab0d-2288a198faff`::moving from state preparing -> state finished >Thread-53675::DEBUG::2014-05-16 17:20:11,922::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53675::DEBUG::2014-05-16 17:20:11,923::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53675::DEBUG::2014-05-16 17:20:11,923::task::974::TaskManager.Task::(_decref) Task=`4a303a15-bbc1-48db-ab0d-2288a198faff`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:20:12,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:12,659::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353499 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:14,671::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:14,738::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310935 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:16,749::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:16,822::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347668 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:18,834::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:18,905::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316338 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:20:19,082::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:20:19,115::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694839 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:21,151::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:21,232::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349812 s, 29.3 MB/s\n'; <rc> = 0 >Thread-53680::DEBUG::2014-05-16 17:20:21,481::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53680::DEBUG::2014-05-16 17:20:21,481::task::579::TaskManager.Task::(_updateState) Task=`9f93fe82-034a-47a7-a441-47d15bcbfcd6`::moving from state init -> state preparing >Thread-53680::INFO::2014-05-16 17:20:21,482::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53680::INFO::2014-05-16 17:20:21,482::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53680::DEBUG::2014-05-16 17:20:21,482::task::1168::TaskManager.Task::(prepare) Task=`9f93fe82-034a-47a7-a441-47d15bcbfcd6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53680::DEBUG::2014-05-16 17:20:21,482::task::579::TaskManager.Task::(_updateState) Task=`9f93fe82-034a-47a7-a441-47d15bcbfcd6`::moving from state preparing -> state finished >Thread-53680::DEBUG::2014-05-16 17:20:21,482::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53680::DEBUG::2014-05-16 17:20:21,483::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53680::DEBUG::2014-05-16 17:20:21,483::task::974::TaskManager.Task::(_decref) Task=`9f93fe82-034a-47a7-a441-47d15bcbfcd6`::ref 0 aborting False >Thread-53681::DEBUG::2014-05-16 17:20:21,492::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53681::DEBUG::2014-05-16 17:20:21,492::task::579::TaskManager.Task::(_updateState) Task=`650ea478-905b-4747-abb0-1442f899ed62`::moving from state init -> state preparing >Thread-53681::INFO::2014-05-16 17:20:21,492::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53681::DEBUG::2014-05-16 17:20:21,493::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`901974cf-1689-4b97-a508-54dba4cd7c10`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53681::DEBUG::2014-05-16 17:20:21,493::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53681::DEBUG::2014-05-16 17:20:21,493::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53681::DEBUG::2014-05-16 17:20:21,493::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`901974cf-1689-4b97-a508-54dba4cd7c10`::Granted request >Thread-53681::DEBUG::2014-05-16 17:20:21,494::task::811::TaskManager.Task::(resourceAcquired) Task=`650ea478-905b-4747-abb0-1442f899ed62`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53681::DEBUG::2014-05-16 17:20:21,494::task::974::TaskManager.Task::(_decref) Task=`650ea478-905b-4747-abb0-1442f899ed62`::ref 1 aborting False >Thread-53681::INFO::2014-05-16 17:20:21,495::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53681::DEBUG::2014-05-16 17:20:21,495::task::1168::TaskManager.Task::(prepare) Task=`650ea478-905b-4747-abb0-1442f899ed62`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53681::DEBUG::2014-05-16 17:20:21,495::task::579::TaskManager.Task::(_updateState) Task=`650ea478-905b-4747-abb0-1442f899ed62`::moving from state preparing -> state finished >Thread-53681::DEBUG::2014-05-16 17:20:21,495::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53681::DEBUG::2014-05-16 17:20:21,495::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53681::DEBUG::2014-05-16 17:20:21,495::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53681::DEBUG::2014-05-16 17:20:21,496::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53681::DEBUG::2014-05-16 17:20:21,496::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53681::DEBUG::2014-05-16 17:20:21,496::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53681::DEBUG::2014-05-16 17:20:21,496::task::974::TaskManager.Task::(_decref) Task=`650ea478-905b-4747-abb0-1442f899ed62`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:20:23,245::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:23,312::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313119 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:25,324::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:25,391::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030743 s, 33.3 MB/s\n'; <rc> = 0 >Thread-53683::DEBUG::2014-05-16 17:20:27,104::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313526.000000 / 8.008323 / 262500000.000000 = 0.205193 >Thread-53683::DEBUG::2014-05-16 17:20:27,104::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053653704144390555, 'statsAge': 0.80448102951049805, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2051925240031354, 'rxDropped': 0} >Thread-53683::DEBUG::2014-05-16 17:20:27,105::task::579::TaskManager.Task::(_updateState) Task=`62a58cef-fb9f-4ba0-b643-5194d209c906`::moving from state init -> state preparing >Thread-53683::INFO::2014-05-16 17:20:27,105::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53683::INFO::2014-05-16 17:20:27,105::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694839', 'lastCheck': '7.9', 'valid': True}} >Thread-53683::DEBUG::2014-05-16 17:20:27,106::task::1168::TaskManager.Task::(prepare) Task=`62a58cef-fb9f-4ba0-b643-5194d209c906`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694839', 'lastCheck': '7.9', 'valid': True}} >Thread-53683::DEBUG::2014-05-16 17:20:27,106::task::579::TaskManager.Task::(_updateState) Task=`62a58cef-fb9f-4ba0-b643-5194d209c906`::moving from state preparing -> state finished >Thread-53683::DEBUG::2014-05-16 17:20:27,106::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53683::DEBUG::2014-05-16 17:20:27,106::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53683::DEBUG::2014-05-16 17:20:27,106::task::974::TaskManager.Task::(_decref) Task=`62a58cef-fb9f-4ba0-b643-5194d209c906`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:20:27,402::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:27,473::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352856 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:20:29,232::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:20:29,243::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109666 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:29,485::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:29,557::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036138 s, 28.3 MB/s\n'; <rc> = 0 >Thread-53686::DEBUG::2014-05-16 17:20:31,543::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [db6c4f8] >Thread-53686::DEBUG::2014-05-16 17:20:31,543::task::579::TaskManager.Task::(_updateState) Task=`7ebcc78f-11fa-4c6d-9e76-61f6221a0d8f`::moving from state init -> state preparing >Thread-53686::INFO::2014-05-16 17:20:31,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53686::INFO::2014-05-16 17:20:31,544::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53686::DEBUG::2014-05-16 17:20:31,544::task::1168::TaskManager.Task::(prepare) Task=`7ebcc78f-11fa-4c6d-9e76-61f6221a0d8f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53686::DEBUG::2014-05-16 17:20:31,544::task::579::TaskManager.Task::(_updateState) Task=`7ebcc78f-11fa-4c6d-9e76-61f6221a0d8f`::moving from state preparing -> state finished >Thread-53686::DEBUG::2014-05-16 17:20:31,544::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53686::DEBUG::2014-05-16 17:20:31,544::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53686::DEBUG::2014-05-16 17:20:31,544::task::974::TaskManager.Task::(_decref) Task=`7ebcc78f-11fa-4c6d-9e76-61f6221a0d8f`::ref 0 aborting False >Thread-53687::DEBUG::2014-05-16 17:20:31,553::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [db6c4f8] >Thread-53687::DEBUG::2014-05-16 17:20:31,553::task::579::TaskManager.Task::(_updateState) Task=`cd15b97a-a34f-4a47-91e5-d0613af2f574`::moving from state init -> state preparing >Thread-53687::INFO::2014-05-16 17:20:31,553::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53687::DEBUG::2014-05-16 17:20:31,554::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9bcc6c1f-b916-4a74-b96a-a7d6d38e0948`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53687::DEBUG::2014-05-16 17:20:31,554::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53687::DEBUG::2014-05-16 17:20:31,554::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53687::DEBUG::2014-05-16 17:20:31,554::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9bcc6c1f-b916-4a74-b96a-a7d6d38e0948`::Granted request >Thread-53687::DEBUG::2014-05-16 17:20:31,555::task::811::TaskManager.Task::(resourceAcquired) Task=`cd15b97a-a34f-4a47-91e5-d0613af2f574`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53687::DEBUG::2014-05-16 17:20:31,555::task::974::TaskManager.Task::(_decref) Task=`cd15b97a-a34f-4a47-91e5-d0613af2f574`::ref 1 aborting False >Thread-53687::INFO::2014-05-16 17:20:31,555::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53687::DEBUG::2014-05-16 17:20:31,556::task::1168::TaskManager.Task::(prepare) Task=`cd15b97a-a34f-4a47-91e5-d0613af2f574`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53687::DEBUG::2014-05-16 17:20:31,556::task::579::TaskManager.Task::(_updateState) Task=`cd15b97a-a34f-4a47-91e5-d0613af2f574`::moving from state preparing -> state finished >Thread-53687::DEBUG::2014-05-16 17:20:31,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53687::DEBUG::2014-05-16 17:20:31,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53687::DEBUG::2014-05-16 17:20:31,556::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53687::DEBUG::2014-05-16 17:20:31,556::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53687::DEBUG::2014-05-16 17:20:31,557::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53687::DEBUG::2014-05-16 17:20:31,557::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53687::DEBUG::2014-05-16 17:20:31,557::task::974::TaskManager.Task::(_decref) Task=`cd15b97a-a34f-4a47-91e5-d0613af2f574`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:20:31,569::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:31,638::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336018 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:33,650::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:33,721::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355535 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:35,733::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:35,800::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306002 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:37,813::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:37,879::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309353 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:20:39,280::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:20:39,291::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105591 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:39,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:39,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313644 s, 32.6 MB/s\n'; <rc> = 0 >Thread-53691::DEBUG::2014-05-16 17:20:41,610::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53691::DEBUG::2014-05-16 17:20:41,611::task::579::TaskManager.Task::(_updateState) Task=`6eb4193f-65d3-46e7-b138-324fd2984615`::moving from state init -> state preparing >Thread-53691::INFO::2014-05-16 17:20:41,611::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53691::INFO::2014-05-16 17:20:41,611::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53691::DEBUG::2014-05-16 17:20:41,611::task::1168::TaskManager.Task::(prepare) Task=`6eb4193f-65d3-46e7-b138-324fd2984615`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53691::DEBUG::2014-05-16 17:20:41,611::task::579::TaskManager.Task::(_updateState) Task=`6eb4193f-65d3-46e7-b138-324fd2984615`::moving from state preparing -> state finished >Thread-53691::DEBUG::2014-05-16 17:20:41,612::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53691::DEBUG::2014-05-16 17:20:41,612::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53691::DEBUG::2014-05-16 17:20:41,612::task::974::TaskManager.Task::(_decref) Task=`6eb4193f-65d3-46e7-b138-324fd2984615`::ref 0 aborting False >Thread-53692::DEBUG::2014-05-16 17:20:41,622::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53692::DEBUG::2014-05-16 17:20:41,623::task::579::TaskManager.Task::(_updateState) Task=`55dacee7-07c7-42d9-a668-6949a482bcd8`::moving from state init -> state preparing >Thread-53692::INFO::2014-05-16 17:20:41,623::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53692::DEBUG::2014-05-16 17:20:41,623::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ecc636ed-4d10-4422-b6f6-722f2a5301a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53692::DEBUG::2014-05-16 17:20:41,623::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53692::DEBUG::2014-05-16 17:20:41,624::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53692::DEBUG::2014-05-16 17:20:41,624::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ecc636ed-4d10-4422-b6f6-722f2a5301a6`::Granted request >Thread-53692::DEBUG::2014-05-16 17:20:41,624::task::811::TaskManager.Task::(resourceAcquired) Task=`55dacee7-07c7-42d9-a668-6949a482bcd8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53692::DEBUG::2014-05-16 17:20:41,624::task::974::TaskManager.Task::(_decref) Task=`55dacee7-07c7-42d9-a668-6949a482bcd8`::ref 1 aborting False >Thread-53692::INFO::2014-05-16 17:20:41,625::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53692::DEBUG::2014-05-16 17:20:41,625::task::1168::TaskManager.Task::(prepare) Task=`55dacee7-07c7-42d9-a668-6949a482bcd8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53692::DEBUG::2014-05-16 17:20:41,625::task::579::TaskManager.Task::(_updateState) Task=`55dacee7-07c7-42d9-a668-6949a482bcd8`::moving from state preparing -> state finished >Thread-53692::DEBUG::2014-05-16 17:20:41,625::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53692::DEBUG::2014-05-16 17:20:41,626::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53692::DEBUG::2014-05-16 17:20:41,626::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53692::DEBUG::2014-05-16 17:20:41,626::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53692::DEBUG::2014-05-16 17:20:41,626::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53692::DEBUG::2014-05-16 17:20:41,626::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53692::DEBUG::2014-05-16 17:20:41,626::task::974::TaskManager.Task::(_decref) Task=`55dacee7-07c7-42d9-a668-6949a482bcd8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:20:41,969::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:42,041::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349565 s, 29.3 MB/s\n'; <rc> = 0 >Thread-53693::DEBUG::2014-05-16 17:20:42,254::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3237734.000000 / 8.008498 / 262500000.000000 = 0.154014 >Thread-53693::DEBUG::2014-05-16 17:20:42,254::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0039331553619533942, 'statsAge': 1.939486026763916, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15401420882732827, 'rxDropped': 0} >Thread-53693::DEBUG::2014-05-16 17:20:42,255::task::579::TaskManager.Task::(_updateState) Task=`ce0e2ad6-322c-4ed0-9bf1-22c48d8242ec`::moving from state init -> state preparing >Thread-53693::INFO::2014-05-16 17:20:42,255::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53693::INFO::2014-05-16 17:20:42,255::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105591', 'lastCheck': '2.9', 'valid': True}} >Thread-53693::DEBUG::2014-05-16 17:20:42,255::task::1168::TaskManager.Task::(prepare) Task=`ce0e2ad6-322c-4ed0-9bf1-22c48d8242ec`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105591', 'lastCheck': '2.9', 'valid': True}} >Thread-53693::DEBUG::2014-05-16 17:20:42,255::task::579::TaskManager.Task::(_updateState) Task=`ce0e2ad6-322c-4ed0-9bf1-22c48d8242ec`::moving from state preparing -> state finished >Thread-53693::DEBUG::2014-05-16 17:20:42,256::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53693::DEBUG::2014-05-16 17:20:42,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53693::DEBUG::2014-05-16 17:20:42,256::task::974::TaskManager.Task::(_decref) Task=`ce0e2ad6-322c-4ed0-9bf1-22c48d8242ec`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:20:44,053::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:44,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324253 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:46,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:46,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309844 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:48,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:48,284::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353758 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:20:49,324::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:20:49,334::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000852944 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:50,296::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:50,372::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396197 s, 25.8 MB/s\n'; <rc> = 0 >Thread-53698::DEBUG::2014-05-16 17:20:51,669::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53698::DEBUG::2014-05-16 17:20:51,670::task::579::TaskManager.Task::(_updateState) Task=`f108c7ed-a6e1-47b9-bdff-f295cf6a4e92`::moving from state init -> state preparing >Thread-53698::INFO::2014-05-16 17:20:51,670::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53698::INFO::2014-05-16 17:20:51,670::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53698::DEBUG::2014-05-16 17:20:51,670::task::1168::TaskManager.Task::(prepare) Task=`f108c7ed-a6e1-47b9-bdff-f295cf6a4e92`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53698::DEBUG::2014-05-16 17:20:51,670::task::579::TaskManager.Task::(_updateState) Task=`f108c7ed-a6e1-47b9-bdff-f295cf6a4e92`::moving from state preparing -> state finished >Thread-53698::DEBUG::2014-05-16 17:20:51,671::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53698::DEBUG::2014-05-16 17:20:51,671::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53698::DEBUG::2014-05-16 17:20:51,671::task::974::TaskManager.Task::(_decref) Task=`f108c7ed-a6e1-47b9-bdff-f295cf6a4e92`::ref 0 aborting False >Thread-53699::DEBUG::2014-05-16 17:20:51,680::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53699::DEBUG::2014-05-16 17:20:51,680::task::579::TaskManager.Task::(_updateState) Task=`e671a32f-c335-4ef3-bb4d-b823f725b503`::moving from state init -> state preparing >Thread-53699::INFO::2014-05-16 17:20:51,681::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53699::DEBUG::2014-05-16 17:20:51,681::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`94a6bc17-4012-4824-aa61-58c617377dba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53699::DEBUG::2014-05-16 17:20:51,681::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53699::DEBUG::2014-05-16 17:20:51,681::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53699::DEBUG::2014-05-16 17:20:51,681::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`94a6bc17-4012-4824-aa61-58c617377dba`::Granted request >Thread-53699::DEBUG::2014-05-16 17:20:51,682::task::811::TaskManager.Task::(resourceAcquired) Task=`e671a32f-c335-4ef3-bb4d-b823f725b503`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53699::DEBUG::2014-05-16 17:20:51,682::task::974::TaskManager.Task::(_decref) Task=`e671a32f-c335-4ef3-bb4d-b823f725b503`::ref 1 aborting False >Thread-53699::INFO::2014-05-16 17:20:51,683::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53699::DEBUG::2014-05-16 17:20:51,683::task::1168::TaskManager.Task::(prepare) Task=`e671a32f-c335-4ef3-bb4d-b823f725b503`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53699::DEBUG::2014-05-16 17:20:51,683::task::579::TaskManager.Task::(_updateState) Task=`e671a32f-c335-4ef3-bb4d-b823f725b503`::moving from state preparing -> state finished >Thread-53699::DEBUG::2014-05-16 17:20:51,683::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53699::DEBUG::2014-05-16 17:20:51,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53699::DEBUG::2014-05-16 17:20:51,684::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53699::DEBUG::2014-05-16 17:20:51,684::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53699::DEBUG::2014-05-16 17:20:51,684::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53699::DEBUG::2014-05-16 17:20:51,684::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53699::DEBUG::2014-05-16 17:20:51,684::task::974::TaskManager.Task::(_decref) Task=`e671a32f-c335-4ef3-bb4d-b823f725b503`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:20:52,383::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:52,450::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305447 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:54,462::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:54,534::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357488 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:20:56,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:56,616::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346754 s, 29.5 MB/s\n'; <rc> = 0 >Thread-53701::DEBUG::2014-05-16 17:20:57,490::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5417157.000000 / 8.011178 / 262500000.000000 = 0.257600 >Thread-53701::DEBUG::2014-05-16 17:20:57,490::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066585059125547057, 'statsAge': 1.1548280715942383, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25759992511096036, 'rxDropped': 0} >Thread-53701::DEBUG::2014-05-16 17:20:57,491::task::579::TaskManager.Task::(_updateState) Task=`9e0a5285-4211-439a-bd51-1bd9ad2a3bee`::moving from state init -> state preparing >Thread-53701::INFO::2014-05-16 17:20:57,491::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53701::INFO::2014-05-16 17:20:57,491::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000852944', 'lastCheck': '8.1', 'valid': True}} >Thread-53701::DEBUG::2014-05-16 17:20:57,491::task::1168::TaskManager.Task::(prepare) Task=`9e0a5285-4211-439a-bd51-1bd9ad2a3bee`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000852944', 'lastCheck': '8.1', 'valid': True}} >Thread-53701::DEBUG::2014-05-16 17:20:57,491::task::579::TaskManager.Task::(_updateState) Task=`9e0a5285-4211-439a-bd51-1bd9ad2a3bee`::moving from state preparing -> state finished >Thread-53701::DEBUG::2014-05-16 17:20:57,491::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53701::DEBUG::2014-05-16 17:20:57,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53701::DEBUG::2014-05-16 17:20:57,492::task::974::TaskManager.Task::(_decref) Task=`9e0a5285-4211-439a-bd51-1bd9ad2a3bee`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:20:58,628::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:20:58,696::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311099 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:20:59,371::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:20:59,382::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765655 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:00,708::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:00,778::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348973 s, 29.3 MB/s\n'; <rc> = 0 >Thread-53704::DEBUG::2014-05-16 17:21:01,724::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53704::DEBUG::2014-05-16 17:21:01,725::task::579::TaskManager.Task::(_updateState) Task=`522b0cdd-72b6-45f0-a45b-9c838c8ac621`::moving from state init -> state preparing >Thread-53704::INFO::2014-05-16 17:21:01,725::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53704::INFO::2014-05-16 17:21:01,725::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53704::DEBUG::2014-05-16 17:21:01,725::task::1168::TaskManager.Task::(prepare) Task=`522b0cdd-72b6-45f0-a45b-9c838c8ac621`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53704::DEBUG::2014-05-16 17:21:01,726::task::579::TaskManager.Task::(_updateState) Task=`522b0cdd-72b6-45f0-a45b-9c838c8ac621`::moving from state preparing -> state finished >Thread-53704::DEBUG::2014-05-16 17:21:01,726::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53704::DEBUG::2014-05-16 17:21:01,726::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53704::DEBUG::2014-05-16 17:21:01,726::task::974::TaskManager.Task::(_decref) Task=`522b0cdd-72b6-45f0-a45b-9c838c8ac621`::ref 0 aborting False >Thread-53705::DEBUG::2014-05-16 17:21:01,734::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53705::DEBUG::2014-05-16 17:21:01,735::task::579::TaskManager.Task::(_updateState) Task=`66479d5b-ad78-4a23-84e7-fa5b2afe1512`::moving from state init -> state preparing >Thread-53705::INFO::2014-05-16 17:21:01,735::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53705::DEBUG::2014-05-16 17:21:01,735::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a6b6593a-f901-4baa-a655-d1b2a3e47026`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53705::DEBUG::2014-05-16 17:21:01,736::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53705::DEBUG::2014-05-16 17:21:01,736::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53705::DEBUG::2014-05-16 17:21:01,736::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a6b6593a-f901-4baa-a655-d1b2a3e47026`::Granted request >Thread-53705::DEBUG::2014-05-16 17:21:01,736::task::811::TaskManager.Task::(resourceAcquired) Task=`66479d5b-ad78-4a23-84e7-fa5b2afe1512`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53705::DEBUG::2014-05-16 17:21:01,736::task::974::TaskManager.Task::(_decref) Task=`66479d5b-ad78-4a23-84e7-fa5b2afe1512`::ref 1 aborting False >Thread-53705::INFO::2014-05-16 17:21:01,737::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53705::DEBUG::2014-05-16 17:21:01,737::task::1168::TaskManager.Task::(prepare) Task=`66479d5b-ad78-4a23-84e7-fa5b2afe1512`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53705::DEBUG::2014-05-16 17:21:01,737::task::579::TaskManager.Task::(_updateState) Task=`66479d5b-ad78-4a23-84e7-fa5b2afe1512`::moving from state preparing -> state finished >Thread-53705::DEBUG::2014-05-16 17:21:01,738::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53705::DEBUG::2014-05-16 17:21:01,738::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53705::DEBUG::2014-05-16 17:21:01,738::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53705::DEBUG::2014-05-16 17:21:01,738::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53705::DEBUG::2014-05-16 17:21:01,738::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53705::DEBUG::2014-05-16 17:21:01,738::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53705::DEBUG::2014-05-16 17:21:01,739::task::974::TaskManager.Task::(_decref) Task=`66479d5b-ad78-4a23-84e7-fa5b2afe1512`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:21:02,785::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:02,856::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349691 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:04,868::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:04,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317937 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:06,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:07,013::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307673 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:09,025::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:09,097::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351232 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:21:09,418::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:21:09,428::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000806462 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:11,108::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:11,176::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310841 s, 32.9 MB/s\n'; <rc> = 0 >Thread-53709::DEBUG::2014-05-16 17:21:11,776::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53709::DEBUG::2014-05-16 17:21:11,776::task::579::TaskManager.Task::(_updateState) Task=`bc64c6f3-d2e1-44ad-9637-d99157a48874`::moving from state init -> state preparing >Thread-53709::INFO::2014-05-16 17:21:11,777::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53709::INFO::2014-05-16 17:21:11,777::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53709::DEBUG::2014-05-16 17:21:11,777::task::1168::TaskManager.Task::(prepare) Task=`bc64c6f3-d2e1-44ad-9637-d99157a48874`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53709::DEBUG::2014-05-16 17:21:11,777::task::579::TaskManager.Task::(_updateState) Task=`bc64c6f3-d2e1-44ad-9637-d99157a48874`::moving from state preparing -> state finished >Thread-53709::DEBUG::2014-05-16 17:21:11,777::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53709::DEBUG::2014-05-16 17:21:11,778::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53709::DEBUG::2014-05-16 17:21:11,778::task::974::TaskManager.Task::(_decref) Task=`bc64c6f3-d2e1-44ad-9637-d99157a48874`::ref 0 aborting False >Thread-53710::DEBUG::2014-05-16 17:21:11,787::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53710::DEBUG::2014-05-16 17:21:11,787::task::579::TaskManager.Task::(_updateState) Task=`974c826e-dfe6-4075-9482-77d2ab94ab9d`::moving from state init -> state preparing >Thread-53710::INFO::2014-05-16 17:21:11,787::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53710::DEBUG::2014-05-16 17:21:11,788::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`47f79322-da2e-47c3-ad06-bf017605f83f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53710::DEBUG::2014-05-16 17:21:11,788::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53710::DEBUG::2014-05-16 17:21:11,788::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53710::DEBUG::2014-05-16 17:21:11,788::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`47f79322-da2e-47c3-ad06-bf017605f83f`::Granted request >Thread-53710::DEBUG::2014-05-16 17:21:11,789::task::811::TaskManager.Task::(resourceAcquired) Task=`974c826e-dfe6-4075-9482-77d2ab94ab9d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53710::DEBUG::2014-05-16 17:21:11,789::task::974::TaskManager.Task::(_decref) Task=`974c826e-dfe6-4075-9482-77d2ab94ab9d`::ref 1 aborting False >Thread-53710::INFO::2014-05-16 17:21:11,790::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53710::DEBUG::2014-05-16 17:21:11,790::task::1168::TaskManager.Task::(prepare) Task=`974c826e-dfe6-4075-9482-77d2ab94ab9d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53710::DEBUG::2014-05-16 17:21:11,790::task::579::TaskManager.Task::(_updateState) Task=`974c826e-dfe6-4075-9482-77d2ab94ab9d`::moving from state preparing -> state finished >Thread-53710::DEBUG::2014-05-16 17:21:11,790::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53710::DEBUG::2014-05-16 17:21:11,790::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53710::DEBUG::2014-05-16 17:21:11,790::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53710::DEBUG::2014-05-16 17:21:11,791::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53710::DEBUG::2014-05-16 17:21:11,791::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53710::DEBUG::2014-05-16 17:21:11,791::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53710::DEBUG::2014-05-16 17:21:11,791::task::974::TaskManager.Task::(_decref) Task=`974c826e-dfe6-4075-9482-77d2ab94ab9d`::ref 0 aborting False >Thread-53711::DEBUG::2014-05-16 17:21:12,677::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4312245.000000 / 8.008295 / 262500000.000000 = 0.205132 >Thread-53711::DEBUG::2014-05-16 17:21:12,677::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0050359211990811618, 'statsAge': 0.32574701309204102, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2051323019263559, 'rxDropped': 0} >Thread-53711::DEBUG::2014-05-16 17:21:12,678::task::579::TaskManager.Task::(_updateState) Task=`d8dc09c9-9e80-4b16-a0ed-4fa333bef80d`::moving from state init -> state preparing >Thread-53711::INFO::2014-05-16 17:21:12,678::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53711::INFO::2014-05-16 17:21:12,678::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806462', 'lastCheck': '3.2', 'valid': True}} >Thread-53711::DEBUG::2014-05-16 17:21:12,678::task::1168::TaskManager.Task::(prepare) Task=`d8dc09c9-9e80-4b16-a0ed-4fa333bef80d`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806462', 'lastCheck': '3.2', 'valid': True}} >Thread-53711::DEBUG::2014-05-16 17:21:12,678::task::579::TaskManager.Task::(_updateState) Task=`d8dc09c9-9e80-4b16-a0ed-4fa333bef80d`::moving from state preparing -> state finished >Thread-53711::DEBUG::2014-05-16 17:21:12,679::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53711::DEBUG::2014-05-16 17:21:12,679::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53711::DEBUG::2014-05-16 17:21:12,679::task::974::TaskManager.Task::(_decref) Task=`d8dc09c9-9e80-4b16-a0ed-4fa333bef80d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:21:13,187::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:13,254::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309786 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:15,266::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:15,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360157 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:17,350::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:17,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345262 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:19,432::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 17:21:19,448::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 17:21:19,449::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:21:19,470::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:21:19,482::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000617626 s, 3.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:21:19,483::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000617626 s, 3.3 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 17:21:19,483::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 17:21:19,484::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 17:21:19,485::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:21:19,486::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:21:19,487::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:21:19,489::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:21:19,490::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:21:19,491::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:21:19,496::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:19,554::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.084602 s, 12.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:21:19,655::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:21:19,656::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:21:19,657::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 17:21:19,658::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 17:21:19,658::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 17:21:19,658::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 17:21:19,658::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:21:19,805::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:21:19,823::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:21:19,833::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000508735 s, 8.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:21,566::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:21,637::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351839 s, 29.1 MB/s\n'; <rc> = 0 >Thread-53716::DEBUG::2014-05-16 17:21:21,835::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53716::DEBUG::2014-05-16 17:21:21,836::task::579::TaskManager.Task::(_updateState) Task=`8fef8695-23f9-4365-b8a5-0a70a97df35d`::moving from state init -> state preparing >Thread-53716::INFO::2014-05-16 17:21:21,836::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53716::INFO::2014-05-16 17:21:21,836::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53716::DEBUG::2014-05-16 17:21:21,836::task::1168::TaskManager.Task::(prepare) Task=`8fef8695-23f9-4365-b8a5-0a70a97df35d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53716::DEBUG::2014-05-16 17:21:21,837::task::579::TaskManager.Task::(_updateState) Task=`8fef8695-23f9-4365-b8a5-0a70a97df35d`::moving from state preparing -> state finished >Thread-53716::DEBUG::2014-05-16 17:21:21,837::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53716::DEBUG::2014-05-16 17:21:21,837::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53716::DEBUG::2014-05-16 17:21:21,837::task::974::TaskManager.Task::(_decref) Task=`8fef8695-23f9-4365-b8a5-0a70a97df35d`::ref 0 aborting False >Thread-53717::DEBUG::2014-05-16 17:21:21,845::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53717::DEBUG::2014-05-16 17:21:21,845::task::579::TaskManager.Task::(_updateState) Task=`3919e15f-9d61-4656-9901-5a99f54851b7`::moving from state init -> state preparing >Thread-53717::INFO::2014-05-16 17:21:21,846::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53717::DEBUG::2014-05-16 17:21:21,846::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`201c2439-8913-4f4f-93c5-08bed359664a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53717::DEBUG::2014-05-16 17:21:21,846::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53717::DEBUG::2014-05-16 17:21:21,846::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53717::DEBUG::2014-05-16 17:21:21,846::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`201c2439-8913-4f4f-93c5-08bed359664a`::Granted request >Thread-53717::DEBUG::2014-05-16 17:21:21,847::task::811::TaskManager.Task::(resourceAcquired) Task=`3919e15f-9d61-4656-9901-5a99f54851b7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53717::DEBUG::2014-05-16 17:21:21,847::task::974::TaskManager.Task::(_decref) Task=`3919e15f-9d61-4656-9901-5a99f54851b7`::ref 1 aborting False >Thread-53717::INFO::2014-05-16 17:21:21,847::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53717::DEBUG::2014-05-16 17:21:21,847::task::1168::TaskManager.Task::(prepare) Task=`3919e15f-9d61-4656-9901-5a99f54851b7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53717::DEBUG::2014-05-16 17:21:21,848::task::579::TaskManager.Task::(_updateState) Task=`3919e15f-9d61-4656-9901-5a99f54851b7`::moving from state preparing -> state finished >Thread-53717::DEBUG::2014-05-16 17:21:21,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53717::DEBUG::2014-05-16 17:21:21,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53717::DEBUG::2014-05-16 17:21:21,848::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53717::DEBUG::2014-05-16 17:21:21,848::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53717::DEBUG::2014-05-16 17:21:21,848::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53717::DEBUG::2014-05-16 17:21:21,848::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53717::DEBUG::2014-05-16 17:21:21,849::task::974::TaskManager.Task::(_decref) Task=`3919e15f-9d61-4656-9901-5a99f54851b7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:21:23,648::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:23,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311378 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:25,727::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:25,794::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310037 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:27,806::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-53719::DEBUG::2014-05-16 17:21:27,840::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4434613.000000 / 8.008253 / 262500000.000000 = 0.210954 >Thread-53719::DEBUG::2014-05-16 17:21:27,841::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0058591937077129988, 'statsAge': 1.474370002746582, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.21095442547489052, 'rxDropped': 0} >Thread-53719::DEBUG::2014-05-16 17:21:27,841::task::579::TaskManager.Task::(_updateState) Task=`b77c1a1f-6419-429e-b0b3-ed4aa8f2fb38`::moving from state init -> state preparing >Thread-53719::INFO::2014-05-16 17:21:27,842::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53719::INFO::2014-05-16 17:21:27,842::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508735', 'lastCheck': '8.0', 'valid': True}} >Thread-53719::DEBUG::2014-05-16 17:21:27,842::task::1168::TaskManager.Task::(prepare) Task=`b77c1a1f-6419-429e-b0b3-ed4aa8f2fb38`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508735', 'lastCheck': '8.0', 'valid': True}} >Thread-53719::DEBUG::2014-05-16 17:21:27,842::task::579::TaskManager.Task::(_updateState) Task=`b77c1a1f-6419-429e-b0b3-ed4aa8f2fb38`::moving from state preparing -> state finished >Thread-53719::DEBUG::2014-05-16 17:21:27,843::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53719::DEBUG::2014-05-16 17:21:27,843::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53719::DEBUG::2014-05-16 17:21:27,843::task::974::TaskManager.Task::(_decref) Task=`b77c1a1f-6419-429e-b0b3-ed4aa8f2fb38`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:21:27,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375794 s, 27.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:21:29,871::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:21:29,882::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00115921 s, 3.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:29,900::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:29,970::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346179 s, 29.6 MB/s\n'; <rc> = 0 >Thread-53722::DEBUG::2014-05-16 17:21:31,904::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53722::DEBUG::2014-05-16 17:21:31,905::task::579::TaskManager.Task::(_updateState) Task=`6d1d4915-6021-4017-863b-9cb9cb353b9c`::moving from state init -> state preparing >Thread-53722::INFO::2014-05-16 17:21:31,905::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53722::INFO::2014-05-16 17:21:31,905::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53722::DEBUG::2014-05-16 17:21:31,905::task::1168::TaskManager.Task::(prepare) Task=`6d1d4915-6021-4017-863b-9cb9cb353b9c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53722::DEBUG::2014-05-16 17:21:31,905::task::579::TaskManager.Task::(_updateState) Task=`6d1d4915-6021-4017-863b-9cb9cb353b9c`::moving from state preparing -> state finished >Thread-53722::DEBUG::2014-05-16 17:21:31,906::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53722::DEBUG::2014-05-16 17:21:31,906::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53722::DEBUG::2014-05-16 17:21:31,906::task::974::TaskManager.Task::(_decref) Task=`6d1d4915-6021-4017-863b-9cb9cb353b9c`::ref 0 aborting False >Thread-53723::DEBUG::2014-05-16 17:21:31,915::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53723::DEBUG::2014-05-16 17:21:31,916::task::579::TaskManager.Task::(_updateState) Task=`1505d631-8db3-482f-9b34-fdde5f3d58f5`::moving from state init -> state preparing >Thread-53723::INFO::2014-05-16 17:21:31,916::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53723::DEBUG::2014-05-16 17:21:31,916::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`608165ea-ebe3-40ac-9ba7-e5db12b9176a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53723::DEBUG::2014-05-16 17:21:31,916::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53723::DEBUG::2014-05-16 17:21:31,917::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53723::DEBUG::2014-05-16 17:21:31,917::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`608165ea-ebe3-40ac-9ba7-e5db12b9176a`::Granted request >Thread-53723::DEBUG::2014-05-16 17:21:31,917::task::811::TaskManager.Task::(resourceAcquired) Task=`1505d631-8db3-482f-9b34-fdde5f3d58f5`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53723::DEBUG::2014-05-16 17:21:31,917::task::974::TaskManager.Task::(_decref) Task=`1505d631-8db3-482f-9b34-fdde5f3d58f5`::ref 1 aborting False >Thread-53723::INFO::2014-05-16 17:21:31,918::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53723::DEBUG::2014-05-16 17:21:31,918::task::1168::TaskManager.Task::(prepare) Task=`1505d631-8db3-482f-9b34-fdde5f3d58f5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53723::DEBUG::2014-05-16 17:21:31,918::task::579::TaskManager.Task::(_updateState) Task=`1505d631-8db3-482f-9b34-fdde5f3d58f5`::moving from state preparing -> state finished >Thread-53723::DEBUG::2014-05-16 17:21:31,918::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53723::DEBUG::2014-05-16 17:21:31,919::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53723::DEBUG::2014-05-16 17:21:31,919::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53723::DEBUG::2014-05-16 17:21:31,919::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53723::DEBUG::2014-05-16 17:21:31,919::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53723::DEBUG::2014-05-16 17:21:31,919::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53723::DEBUG::2014-05-16 17:21:31,920::task::974::TaskManager.Task::(_decref) Task=`1505d631-8db3-482f-9b34-fdde5f3d58f5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:21:31,982::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:32,055::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355301 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:34,067::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:34,135::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313906 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:36,146::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:36,218::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355288 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:38,229::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:38,297::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314495 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:21:39,928::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:21:39,939::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000900173 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:40,309::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:40,380::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347789 s, 29.4 MB/s\n'; <rc> = 0 >Thread-53727::DEBUG::2014-05-16 17:21:41,953::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53727::DEBUG::2014-05-16 17:21:41,954::task::579::TaskManager.Task::(_updateState) Task=`e32c7e88-8c93-4425-8fa6-3e1d7d637d36`::moving from state init -> state preparing >Thread-53727::INFO::2014-05-16 17:21:41,954::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53727::INFO::2014-05-16 17:21:41,954::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53727::DEBUG::2014-05-16 17:21:41,955::task::1168::TaskManager.Task::(prepare) Task=`e32c7e88-8c93-4425-8fa6-3e1d7d637d36`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53727::DEBUG::2014-05-16 17:21:41,955::task::579::TaskManager.Task::(_updateState) Task=`e32c7e88-8c93-4425-8fa6-3e1d7d637d36`::moving from state preparing -> state finished >Thread-53727::DEBUG::2014-05-16 17:21:41,955::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53727::DEBUG::2014-05-16 17:21:41,955::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53727::DEBUG::2014-05-16 17:21:41,955::task::974::TaskManager.Task::(_decref) Task=`e32c7e88-8c93-4425-8fa6-3e1d7d637d36`::ref 0 aborting False >Thread-53728::DEBUG::2014-05-16 17:21:41,965::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53728::DEBUG::2014-05-16 17:21:41,965::task::579::TaskManager.Task::(_updateState) Task=`2f11fda2-acb9-46ea-9a75-a5fe9947f38b`::moving from state init -> state preparing >Thread-53728::INFO::2014-05-16 17:21:41,965::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53728::DEBUG::2014-05-16 17:21:41,965::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a7a6662f-c974-4ee1-bb7a-1e24980ef7ef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53728::DEBUG::2014-05-16 17:21:41,966::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53728::DEBUG::2014-05-16 17:21:41,966::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53728::DEBUG::2014-05-16 17:21:41,966::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a7a6662f-c974-4ee1-bb7a-1e24980ef7ef`::Granted request >Thread-53728::DEBUG::2014-05-16 17:21:41,966::task::811::TaskManager.Task::(resourceAcquired) Task=`2f11fda2-acb9-46ea-9a75-a5fe9947f38b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53728::DEBUG::2014-05-16 17:21:41,967::task::974::TaskManager.Task::(_decref) Task=`2f11fda2-acb9-46ea-9a75-a5fe9947f38b`::ref 1 aborting False >Thread-53728::INFO::2014-05-16 17:21:41,967::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53728::DEBUG::2014-05-16 17:21:41,967::task::1168::TaskManager.Task::(prepare) Task=`2f11fda2-acb9-46ea-9a75-a5fe9947f38b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53728::DEBUG::2014-05-16 17:21:41,968::task::579::TaskManager.Task::(_updateState) Task=`2f11fda2-acb9-46ea-9a75-a5fe9947f38b`::moving from state preparing -> state finished >Thread-53728::DEBUG::2014-05-16 17:21:41,968::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53728::DEBUG::2014-05-16 17:21:41,968::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53728::DEBUG::2014-05-16 17:21:41,968::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53728::DEBUG::2014-05-16 17:21:41,968::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53728::DEBUG::2014-05-16 17:21:41,968::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53728::DEBUG::2014-05-16 17:21:41,969::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53728::DEBUG::2014-05-16 17:21:41,969::task::974::TaskManager.Task::(_decref) Task=`2f11fda2-acb9-46ea-9a75-a5fe9947f38b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:21:42,396::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:42,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346091 s, 29.6 MB/s\n'; <rc> = 0 >Thread-53729::DEBUG::2014-05-16 17:21:42,992::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4331179.000000 / 8.011000 / 262500000.000000 = 0.205963 >Thread-53729::DEBUG::2014-05-16 17:21:42,992::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0050865297316994209, 'statsAge': 0.60625505447387695, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20596341532489593, 'rxDropped': 0} >Thread-53729::DEBUG::2014-05-16 17:21:42,992::task::579::TaskManager.Task::(_updateState) Task=`bb5da33e-a06b-4d46-ad9b-8e6e2f6dbe8b`::moving from state init -> state preparing >Thread-53729::INFO::2014-05-16 17:21:42,992::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53729::INFO::2014-05-16 17:21:42,993::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000900173', 'lastCheck': '3.0', 'valid': True}} >Thread-53729::DEBUG::2014-05-16 17:21:42,993::task::1168::TaskManager.Task::(prepare) Task=`bb5da33e-a06b-4d46-ad9b-8e6e2f6dbe8b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000900173', 'lastCheck': '3.0', 'valid': True}} >Thread-53729::DEBUG::2014-05-16 17:21:42,993::task::579::TaskManager.Task::(_updateState) Task=`bb5da33e-a06b-4d46-ad9b-8e6e2f6dbe8b`::moving from state preparing -> state finished >Thread-53729::DEBUG::2014-05-16 17:21:42,993::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53729::DEBUG::2014-05-16 17:21:42,993::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53729::DEBUG::2014-05-16 17:21:42,993::task::974::TaskManager.Task::(_decref) Task=`bb5da33e-a06b-4d46-ad9b-8e6e2f6dbe8b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:21:44,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:44,546::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318419 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:46,557::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:46,630::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368278 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:48,642::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:48,713::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354375 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:21:49,973::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:21:49,983::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103943 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:50,725::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:50,795::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346494 s, 29.6 MB/s\n'; <rc> = 0 >Thread-53733::DEBUG::2014-05-16 17:21:52,011::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53733::DEBUG::2014-05-16 17:21:52,012::task::579::TaskManager.Task::(_updateState) Task=`359496cb-c3e7-4c55-9964-8055775a007c`::moving from state init -> state preparing >Thread-53733::INFO::2014-05-16 17:21:52,012::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53733::INFO::2014-05-16 17:21:52,012::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53733::DEBUG::2014-05-16 17:21:52,012::task::1168::TaskManager.Task::(prepare) Task=`359496cb-c3e7-4c55-9964-8055775a007c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53733::DEBUG::2014-05-16 17:21:52,012::task::579::TaskManager.Task::(_updateState) Task=`359496cb-c3e7-4c55-9964-8055775a007c`::moving from state preparing -> state finished >Thread-53733::DEBUG::2014-05-16 17:21:52,013::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53733::DEBUG::2014-05-16 17:21:52,013::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53733::DEBUG::2014-05-16 17:21:52,013::task::974::TaskManager.Task::(_decref) Task=`359496cb-c3e7-4c55-9964-8055775a007c`::ref 0 aborting False >Thread-53734::DEBUG::2014-05-16 17:21:52,023::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53734::DEBUG::2014-05-16 17:21:52,023::task::579::TaskManager.Task::(_updateState) Task=`e3fb289b-e65f-4e7a-b463-ec46d48563bf`::moving from state init -> state preparing >Thread-53734::INFO::2014-05-16 17:21:52,023::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53734::DEBUG::2014-05-16 17:21:52,023::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0c67f5bb-2437-4c3a-b8ff-465b274210e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53734::DEBUG::2014-05-16 17:21:52,023::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53734::DEBUG::2014-05-16 17:21:52,024::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53734::DEBUG::2014-05-16 17:21:52,024::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0c67f5bb-2437-4c3a-b8ff-465b274210e5`::Granted request >Thread-53734::DEBUG::2014-05-16 17:21:52,024::task::811::TaskManager.Task::(resourceAcquired) Task=`e3fb289b-e65f-4e7a-b463-ec46d48563bf`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53734::DEBUG::2014-05-16 17:21:52,024::task::974::TaskManager.Task::(_decref) Task=`e3fb289b-e65f-4e7a-b463-ec46d48563bf`::ref 1 aborting False >Thread-53734::INFO::2014-05-16 17:21:52,025::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53734::DEBUG::2014-05-16 17:21:52,025::task::1168::TaskManager.Task::(prepare) Task=`e3fb289b-e65f-4e7a-b463-ec46d48563bf`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53734::DEBUG::2014-05-16 17:21:52,025::task::579::TaskManager.Task::(_updateState) Task=`e3fb289b-e65f-4e7a-b463-ec46d48563bf`::moving from state preparing -> state finished >Thread-53734::DEBUG::2014-05-16 17:21:52,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53734::DEBUG::2014-05-16 17:21:52,025::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53734::DEBUG::2014-05-16 17:21:52,026::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53734::DEBUG::2014-05-16 17:21:52,026::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53734::DEBUG::2014-05-16 17:21:52,026::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53734::DEBUG::2014-05-16 17:21:52,026::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53734::DEBUG::2014-05-16 17:21:52,026::task::974::TaskManager.Task::(_decref) Task=`e3fb289b-e65f-4e7a-b463-ec46d48563bf`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:21:52,807::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:52,875::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308507 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:54,887::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:54,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310341 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:21:56,966::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:57,036::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344075 s, 29.8 MB/s\n'; <rc> = 0 >Thread-53737::DEBUG::2014-05-16 17:21:58,135::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5417435.000000 / 8.008274 / 262500000.000000 = 0.257707 >Thread-53737::DEBUG::2014-05-16 17:21:58,136::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0069037169060172992, 'statsAge': 1.7356460094451904, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25770655970419099, 'rxDropped': 0} >Thread-53737::DEBUG::2014-05-16 17:21:58,136::task::579::TaskManager.Task::(_updateState) Task=`1120ab5f-d785-4987-9ddd-8a8f9eee8979`::moving from state init -> state preparing >Thread-53737::INFO::2014-05-16 17:21:58,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53737::INFO::2014-05-16 17:21:58,136::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103943', 'lastCheck': '8.1', 'valid': True}} >Thread-53737::DEBUG::2014-05-16 17:21:58,137::task::1168::TaskManager.Task::(prepare) Task=`1120ab5f-d785-4987-9ddd-8a8f9eee8979`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103943', 'lastCheck': '8.1', 'valid': True}} >Thread-53737::DEBUG::2014-05-16 17:21:58,137::task::579::TaskManager.Task::(_updateState) Task=`1120ab5f-d785-4987-9ddd-8a8f9eee8979`::moving from state preparing -> state finished >Thread-53737::DEBUG::2014-05-16 17:21:58,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53737::DEBUG::2014-05-16 17:21:58,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53737::DEBUG::2014-05-16 17:21:58,137::task::974::TaskManager.Task::(_decref) Task=`1120ab5f-d785-4987-9ddd-8a8f9eee8979`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:21:59,049::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:21:59,115::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307673 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:22:00,020::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:22:00,030::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741574 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:01,127::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:01,193::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303361 s, 33.8 MB/s\n'; <rc> = 0 >Thread-53740::DEBUG::2014-05-16 17:22:02,065::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53740::DEBUG::2014-05-16 17:22:02,066::task::579::TaskManager.Task::(_updateState) Task=`85eedec9-06dd-403b-b337-4a8f3cbec365`::moving from state init -> state preparing >Thread-53740::INFO::2014-05-16 17:22:02,066::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53740::INFO::2014-05-16 17:22:02,066::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53740::DEBUG::2014-05-16 17:22:02,067::task::1168::TaskManager.Task::(prepare) Task=`85eedec9-06dd-403b-b337-4a8f3cbec365`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53740::DEBUG::2014-05-16 17:22:02,067::task::579::TaskManager.Task::(_updateState) Task=`85eedec9-06dd-403b-b337-4a8f3cbec365`::moving from state preparing -> state finished >Thread-53740::DEBUG::2014-05-16 17:22:02,067::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53740::DEBUG::2014-05-16 17:22:02,067::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53740::DEBUG::2014-05-16 17:22:02,067::task::974::TaskManager.Task::(_decref) Task=`85eedec9-06dd-403b-b337-4a8f3cbec365`::ref 0 aborting False >Thread-53741::DEBUG::2014-05-16 17:22:02,076::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53741::DEBUG::2014-05-16 17:22:02,076::task::579::TaskManager.Task::(_updateState) Task=`c948899b-a1ab-47f6-ae56-713bbfe5ce35`::moving from state init -> state preparing >Thread-53741::INFO::2014-05-16 17:22:02,076::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53741::DEBUG::2014-05-16 17:22:02,077::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3dafc979-3e5b-422a-914c-13966f1151da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53741::DEBUG::2014-05-16 17:22:02,077::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53741::DEBUG::2014-05-16 17:22:02,077::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53741::DEBUG::2014-05-16 17:22:02,077::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3dafc979-3e5b-422a-914c-13966f1151da`::Granted request >Thread-53741::DEBUG::2014-05-16 17:22:02,078::task::811::TaskManager.Task::(resourceAcquired) Task=`c948899b-a1ab-47f6-ae56-713bbfe5ce35`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53741::DEBUG::2014-05-16 17:22:02,078::task::974::TaskManager.Task::(_decref) Task=`c948899b-a1ab-47f6-ae56-713bbfe5ce35`::ref 1 aborting False >Thread-53741::INFO::2014-05-16 17:22:02,079::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53741::DEBUG::2014-05-16 17:22:02,079::task::1168::TaskManager.Task::(prepare) Task=`c948899b-a1ab-47f6-ae56-713bbfe5ce35`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53741::DEBUG::2014-05-16 17:22:02,079::task::579::TaskManager.Task::(_updateState) Task=`c948899b-a1ab-47f6-ae56-713bbfe5ce35`::moving from state preparing -> state finished >Thread-53741::DEBUG::2014-05-16 17:22:02,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53741::DEBUG::2014-05-16 17:22:02,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53741::DEBUG::2014-05-16 17:22:02,079::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53741::DEBUG::2014-05-16 17:22:02,080::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53741::DEBUG::2014-05-16 17:22:02,080::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53741::DEBUG::2014-05-16 17:22:02,080::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53741::DEBUG::2014-05-16 17:22:02,080::task::974::TaskManager.Task::(_decref) Task=`c948899b-a1ab-47f6-ae56-713bbfe5ce35`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:22:03,205::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:03,276::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035123 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:05,288::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:05,354::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303008 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:07,366::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:07,433::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310041 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:09,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:09,650::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.13276 s, 7.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:22:10,064::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:22:10,074::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746612 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:11,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:11,736::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370967 s, 27.6 MB/s\n'; <rc> = 0 >Thread-53745::DEBUG::2014-05-16 17:22:12,108::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [62fee17b] >Thread-53745::DEBUG::2014-05-16 17:22:12,108::task::579::TaskManager.Task::(_updateState) Task=`a46e7394-c748-4d59-a896-c9585aa4433d`::moving from state init -> state preparing >Thread-53745::INFO::2014-05-16 17:22:12,109::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53745::INFO::2014-05-16 17:22:12,109::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53745::DEBUG::2014-05-16 17:22:12,109::task::1168::TaskManager.Task::(prepare) Task=`a46e7394-c748-4d59-a896-c9585aa4433d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53745::DEBUG::2014-05-16 17:22:12,109::task::579::TaskManager.Task::(_updateState) Task=`a46e7394-c748-4d59-a896-c9585aa4433d`::moving from state preparing -> state finished >Thread-53745::DEBUG::2014-05-16 17:22:12,109::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53745::DEBUG::2014-05-16 17:22:12,109::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53745::DEBUG::2014-05-16 17:22:12,110::task::974::TaskManager.Task::(_decref) Task=`a46e7394-c748-4d59-a896-c9585aa4433d`::ref 0 aborting False >Thread-53746::DEBUG::2014-05-16 17:22:12,118::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [62fee17b] >Thread-53746::DEBUG::2014-05-16 17:22:12,118::task::579::TaskManager.Task::(_updateState) Task=`49d597f1-902a-47da-959e-fa452e30e718`::moving from state init -> state preparing >Thread-53746::INFO::2014-05-16 17:22:12,119::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53746::DEBUG::2014-05-16 17:22:12,119::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b63794dd-71d0-4b8b-bfb9-baf56e39932c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53746::DEBUG::2014-05-16 17:22:12,119::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53746::DEBUG::2014-05-16 17:22:12,119::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53746::DEBUG::2014-05-16 17:22:12,119::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b63794dd-71d0-4b8b-bfb9-baf56e39932c`::Granted request >Thread-53746::DEBUG::2014-05-16 17:22:12,120::task::811::TaskManager.Task::(resourceAcquired) Task=`49d597f1-902a-47da-959e-fa452e30e718`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53746::DEBUG::2014-05-16 17:22:12,120::task::974::TaskManager.Task::(_decref) Task=`49d597f1-902a-47da-959e-fa452e30e718`::ref 1 aborting False >Thread-53746::INFO::2014-05-16 17:22:12,121::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53746::DEBUG::2014-05-16 17:22:12,121::task::1168::TaskManager.Task::(prepare) Task=`49d597f1-902a-47da-959e-fa452e30e718`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53746::DEBUG::2014-05-16 17:22:12,121::task::579::TaskManager.Task::(_updateState) Task=`49d597f1-902a-47da-959e-fa452e30e718`::moving from state preparing -> state finished >Thread-53746::DEBUG::2014-05-16 17:22:12,121::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53746::DEBUG::2014-05-16 17:22:12,121::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53746::DEBUG::2014-05-16 17:22:12,122::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53746::DEBUG::2014-05-16 17:22:12,122::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53746::DEBUG::2014-05-16 17:22:12,122::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53746::DEBUG::2014-05-16 17:22:12,122::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53746::DEBUG::2014-05-16 17:22:12,122::task::974::TaskManager.Task::(_decref) Task=`49d597f1-902a-47da-959e-fa452e30e718`::ref 0 aborting False >Thread-53747::DEBUG::2014-05-16 17:22:13,335::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4307917.000000 / 8.008265 / 262500000.000000 = 0.204927 >Thread-53747::DEBUG::2014-05-16 17:22:13,336::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051240395481494221, 'statsAge': 0.91927599906921387, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20492718888693617, 'rxDropped': 0} >Thread-53747::DEBUG::2014-05-16 17:22:13,336::task::579::TaskManager.Task::(_updateState) Task=`9f02e97a-21a8-4af1-aaca-514c5d83c5ae`::moving from state init -> state preparing >Thread-53747::INFO::2014-05-16 17:22:13,336::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53747::INFO::2014-05-16 17:22:13,336::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746612', 'lastCheck': '3.2', 'valid': True}} >Thread-53747::DEBUG::2014-05-16 17:22:13,336::task::1168::TaskManager.Task::(prepare) Task=`9f02e97a-21a8-4af1-aaca-514c5d83c5ae`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746612', 'lastCheck': '3.2', 'valid': True}} >Thread-53747::DEBUG::2014-05-16 17:22:13,336::task::579::TaskManager.Task::(_updateState) Task=`9f02e97a-21a8-4af1-aaca-514c5d83c5ae`::moving from state preparing -> state finished >Thread-53747::DEBUG::2014-05-16 17:22:13,337::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53747::DEBUG::2014-05-16 17:22:13,337::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53747::DEBUG::2014-05-16 17:22:13,337::task::974::TaskManager.Task::(_decref) Task=`9f02e97a-21a8-4af1-aaca-514c5d83c5ae`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:22:13,747::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:13,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302145 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:15,826::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:15,895::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326557 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:17,907::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:17,978::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350877 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:19,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:20,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307569 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:22:20,111::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:22:20,143::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0223713 s, 183 kB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:22,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:22,136::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308022 s, 33.2 MB/s\n'; <rc> = 0 >Thread-53751::DEBUG::2014-05-16 17:22:22,166::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53751::DEBUG::2014-05-16 17:22:22,166::task::579::TaskManager.Task::(_updateState) Task=`0860aaf1-e30d-490f-bc90-e3c5b1740e12`::moving from state init -> state preparing >Thread-53751::INFO::2014-05-16 17:22:22,166::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53751::INFO::2014-05-16 17:22:22,167::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53751::DEBUG::2014-05-16 17:22:22,167::task::1168::TaskManager.Task::(prepare) Task=`0860aaf1-e30d-490f-bc90-e3c5b1740e12`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53751::DEBUG::2014-05-16 17:22:22,167::task::579::TaskManager.Task::(_updateState) Task=`0860aaf1-e30d-490f-bc90-e3c5b1740e12`::moving from state preparing -> state finished >Thread-53751::DEBUG::2014-05-16 17:22:22,167::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53751::DEBUG::2014-05-16 17:22:22,167::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53751::DEBUG::2014-05-16 17:22:22,167::task::974::TaskManager.Task::(_decref) Task=`0860aaf1-e30d-490f-bc90-e3c5b1740e12`::ref 0 aborting False >Thread-53752::DEBUG::2014-05-16 17:22:22,177::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53752::DEBUG::2014-05-16 17:22:22,177::task::579::TaskManager.Task::(_updateState) Task=`cfb4fe8b-dff6-4717-ab10-074e462ba651`::moving from state init -> state preparing >Thread-53752::INFO::2014-05-16 17:22:22,177::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53752::DEBUG::2014-05-16 17:22:22,178::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`46a56562-5d90-4153-ab53-d8df959aead0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53752::DEBUG::2014-05-16 17:22:22,178::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53752::DEBUG::2014-05-16 17:22:22,178::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53752::DEBUG::2014-05-16 17:22:22,178::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`46a56562-5d90-4153-ab53-d8df959aead0`::Granted request >Thread-53752::DEBUG::2014-05-16 17:22:22,179::task::811::TaskManager.Task::(resourceAcquired) Task=`cfb4fe8b-dff6-4717-ab10-074e462ba651`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53752::DEBUG::2014-05-16 17:22:22,179::task::974::TaskManager.Task::(_decref) Task=`cfb4fe8b-dff6-4717-ab10-074e462ba651`::ref 1 aborting False >Thread-53752::INFO::2014-05-16 17:22:22,180::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53752::DEBUG::2014-05-16 17:22:22,180::task::1168::TaskManager.Task::(prepare) Task=`cfb4fe8b-dff6-4717-ab10-074e462ba651`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53752::DEBUG::2014-05-16 17:22:22,180::task::579::TaskManager.Task::(_updateState) Task=`cfb4fe8b-dff6-4717-ab10-074e462ba651`::moving from state preparing -> state finished >Thread-53752::DEBUG::2014-05-16 17:22:22,180::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53752::DEBUG::2014-05-16 17:22:22,180::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53752::DEBUG::2014-05-16 17:22:22,180::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53752::DEBUG::2014-05-16 17:22:22,181::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53752::DEBUG::2014-05-16 17:22:22,181::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53752::DEBUG::2014-05-16 17:22:22,181::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53752::DEBUG::2014-05-16 17:22:22,181::task::974::TaskManager.Task::(_decref) Task=`cfb4fe8b-dff6-4717-ab10-074e462ba651`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:22:24,147::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:24,219::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359928 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:26,231::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:26,298::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306921 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:28,309::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:28,377::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307488 s, 33.3 MB/s\n'; <rc> = 0 >Thread-53755::DEBUG::2014-05-16 17:22:28,478::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313617.000000 / 8.008722 / 262500000.000000 = 0.205187 >Thread-53755::DEBUG::2014-05-16 17:22:28,478::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052763428184749196, 'statsAge': 0.044576168060302734, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2051866330063947, 'rxDropped': 0} >Thread-53755::DEBUG::2014-05-16 17:22:28,479::task::579::TaskManager.Task::(_updateState) Task=`73beb3e6-6547-4429-b5e7-aefde1c8f541`::moving from state init -> state preparing >Thread-53755::INFO::2014-05-16 17:22:28,479::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53755::INFO::2014-05-16 17:22:28,479::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0223713', 'lastCheck': '8.3', 'valid': True}} >Thread-53755::DEBUG::2014-05-16 17:22:28,479::task::1168::TaskManager.Task::(prepare) Task=`73beb3e6-6547-4429-b5e7-aefde1c8f541`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0223713', 'lastCheck': '8.3', 'valid': True}} >Thread-53755::DEBUG::2014-05-16 17:22:28,480::task::579::TaskManager.Task::(_updateState) Task=`73beb3e6-6547-4429-b5e7-aefde1c8f541`::moving from state preparing -> state finished >Thread-53755::DEBUG::2014-05-16 17:22:28,480::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53755::DEBUG::2014-05-16 17:22:28,480::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53755::DEBUG::2014-05-16 17:22:28,480::task::974::TaskManager.Task::(_decref) Task=`73beb3e6-6547-4429-b5e7-aefde1c8f541`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:22:30,178::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:22:30,189::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105496 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:30,388::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:30,464::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343576 s, 29.8 MB/s\n'; <rc> = 0 >Thread-53758::DEBUG::2014-05-16 17:22:32,222::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53758::DEBUG::2014-05-16 17:22:32,222::task::579::TaskManager.Task::(_updateState) Task=`81f39c85-1ed1-4179-a32f-0959a8cab0e1`::moving from state init -> state preparing >Thread-53758::INFO::2014-05-16 17:22:32,222::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53758::INFO::2014-05-16 17:22:32,223::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53758::DEBUG::2014-05-16 17:22:32,223::task::1168::TaskManager.Task::(prepare) Task=`81f39c85-1ed1-4179-a32f-0959a8cab0e1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53758::DEBUG::2014-05-16 17:22:32,223::task::579::TaskManager.Task::(_updateState) Task=`81f39c85-1ed1-4179-a32f-0959a8cab0e1`::moving from state preparing -> state finished >Thread-53758::DEBUG::2014-05-16 17:22:32,223::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53758::DEBUG::2014-05-16 17:22:32,223::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53758::DEBUG::2014-05-16 17:22:32,224::task::974::TaskManager.Task::(_decref) Task=`81f39c85-1ed1-4179-a32f-0959a8cab0e1`::ref 0 aborting False >Thread-53759::DEBUG::2014-05-16 17:22:32,233::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53759::DEBUG::2014-05-16 17:22:32,233::task::579::TaskManager.Task::(_updateState) Task=`b8c64bb3-4d3d-4058-9da1-8415b22fe316`::moving from state init -> state preparing >Thread-53759::INFO::2014-05-16 17:22:32,233::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53759::DEBUG::2014-05-16 17:22:32,234::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9e6c8190-10b7-4a75-adf6-f7e31ab178ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53759::DEBUG::2014-05-16 17:22:32,234::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53759::DEBUG::2014-05-16 17:22:32,234::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53759::DEBUG::2014-05-16 17:22:32,234::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9e6c8190-10b7-4a75-adf6-f7e31ab178ca`::Granted request >Thread-53759::DEBUG::2014-05-16 17:22:32,234::task::811::TaskManager.Task::(resourceAcquired) Task=`b8c64bb3-4d3d-4058-9da1-8415b22fe316`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53759::DEBUG::2014-05-16 17:22:32,235::task::974::TaskManager.Task::(_decref) Task=`b8c64bb3-4d3d-4058-9da1-8415b22fe316`::ref 1 aborting False >Thread-53759::INFO::2014-05-16 17:22:32,235::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53759::DEBUG::2014-05-16 17:22:32,235::task::1168::TaskManager.Task::(prepare) Task=`b8c64bb3-4d3d-4058-9da1-8415b22fe316`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53759::DEBUG::2014-05-16 17:22:32,236::task::579::TaskManager.Task::(_updateState) Task=`b8c64bb3-4d3d-4058-9da1-8415b22fe316`::moving from state preparing -> state finished >Thread-53759::DEBUG::2014-05-16 17:22:32,236::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53759::DEBUG::2014-05-16 17:22:32,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53759::DEBUG::2014-05-16 17:22:32,236::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53759::DEBUG::2014-05-16 17:22:32,236::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53759::DEBUG::2014-05-16 17:22:32,237::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53759::DEBUG::2014-05-16 17:22:32,237::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53759::DEBUG::2014-05-16 17:22:32,237::task::974::TaskManager.Task::(_decref) Task=`b8c64bb3-4d3d-4058-9da1-8415b22fe316`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:22:32,475::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:32,547::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358544 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:34,559::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:34,627::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328118 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:36,639::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:36,709::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345527 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:38,721::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:38,789::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316293 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:22:40,222::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:22:40,233::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107221 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:40,801::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:40,872::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034043 s, 30.1 MB/s\n'; <rc> = 0 >Thread-53763::DEBUG::2014-05-16 17:22:42,278::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53763::DEBUG::2014-05-16 17:22:42,279::task::579::TaskManager.Task::(_updateState) Task=`22c0648e-fc1b-4d67-a848-c94ef1b74303`::moving from state init -> state preparing >Thread-53763::INFO::2014-05-16 17:22:42,279::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53763::INFO::2014-05-16 17:22:42,279::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53763::DEBUG::2014-05-16 17:22:42,279::task::1168::TaskManager.Task::(prepare) Task=`22c0648e-fc1b-4d67-a848-c94ef1b74303`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53763::DEBUG::2014-05-16 17:22:42,280::task::579::TaskManager.Task::(_updateState) Task=`22c0648e-fc1b-4d67-a848-c94ef1b74303`::moving from state preparing -> state finished >Thread-53763::DEBUG::2014-05-16 17:22:42,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53763::DEBUG::2014-05-16 17:22:42,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53763::DEBUG::2014-05-16 17:22:42,280::task::974::TaskManager.Task::(_decref) Task=`22c0648e-fc1b-4d67-a848-c94ef1b74303`::ref 0 aborting False >Thread-53764::DEBUG::2014-05-16 17:22:42,289::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53764::DEBUG::2014-05-16 17:22:42,289::task::579::TaskManager.Task::(_updateState) Task=`f7b96e5b-83d4-4a7a-bcbd-17b5bf947cd3`::moving from state init -> state preparing >Thread-53764::INFO::2014-05-16 17:22:42,289::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53764::DEBUG::2014-05-16 17:22:42,290::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d1454f8c-425a-47d6-a12a-8669aa59b0d0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53764::DEBUG::2014-05-16 17:22:42,290::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53764::DEBUG::2014-05-16 17:22:42,290::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53764::DEBUG::2014-05-16 17:22:42,290::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d1454f8c-425a-47d6-a12a-8669aa59b0d0`::Granted request >Thread-53764::DEBUG::2014-05-16 17:22:42,291::task::811::TaskManager.Task::(resourceAcquired) Task=`f7b96e5b-83d4-4a7a-bcbd-17b5bf947cd3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53764::DEBUG::2014-05-16 17:22:42,291::task::974::TaskManager.Task::(_decref) Task=`f7b96e5b-83d4-4a7a-bcbd-17b5bf947cd3`::ref 1 aborting False >Thread-53764::INFO::2014-05-16 17:22:42,291::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53764::DEBUG::2014-05-16 17:22:42,292::task::1168::TaskManager.Task::(prepare) Task=`f7b96e5b-83d4-4a7a-bcbd-17b5bf947cd3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53764::DEBUG::2014-05-16 17:22:42,292::task::579::TaskManager.Task::(_updateState) Task=`f7b96e5b-83d4-4a7a-bcbd-17b5bf947cd3`::moving from state preparing -> state finished >Thread-53764::DEBUG::2014-05-16 17:22:42,292::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53764::DEBUG::2014-05-16 17:22:42,292::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53764::DEBUG::2014-05-16 17:22:42,292::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53764::DEBUG::2014-05-16 17:22:42,293::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53764::DEBUG::2014-05-16 17:22:42,293::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53764::DEBUG::2014-05-16 17:22:42,293::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53764::DEBUG::2014-05-16 17:22:42,293::task::974::TaskManager.Task::(_decref) Task=`f7b96e5b-83d4-4a7a-bcbd-17b5bf947cd3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:22:42,883::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:42,949::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299927 s, 34.1 MB/s\n'; <rc> = 0 >Thread-53765::DEBUG::2014-05-16 17:22:43,661::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5409487.000000 / 8.008216 / 262500000.000000 = 0.257330 >Thread-53765::DEBUG::2014-05-16 17:22:43,661::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0064062779720663095, 'statsAge': 1.2096478939056396, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25733034386484788, 'rxDropped': 0} >Thread-53765::DEBUG::2014-05-16 17:22:43,662::task::579::TaskManager.Task::(_updateState) Task=`2e14799e-7f89-4318-8232-0c61e0a10f83`::moving from state init -> state preparing >Thread-53765::INFO::2014-05-16 17:22:43,662::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53765::INFO::2014-05-16 17:22:43,662::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107221', 'lastCheck': '3.4', 'valid': True}} >Thread-53765::DEBUG::2014-05-16 17:22:43,663::task::1168::TaskManager.Task::(prepare) Task=`2e14799e-7f89-4318-8232-0c61e0a10f83`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107221', 'lastCheck': '3.4', 'valid': True}} >Thread-53765::DEBUG::2014-05-16 17:22:43,663::task::579::TaskManager.Task::(_updateState) Task=`2e14799e-7f89-4318-8232-0c61e0a10f83`::moving from state preparing -> state finished >Thread-53765::DEBUG::2014-05-16 17:22:43,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53765::DEBUG::2014-05-16 17:22:43,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53765::DEBUG::2014-05-16 17:22:43,663::task::974::TaskManager.Task::(_decref) Task=`2e14799e-7f89-4318-8232-0c61e0a10f83`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:22:44,961::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:45,032::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034834 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:47,044::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:47,114::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345582 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:49,126::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:49,193::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311069 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:22:50,270::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:22:50,280::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000802007 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:51,204::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:51,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342324 s, 29.9 MB/s\n'; <rc> = 0 >Thread-53769::DEBUG::2014-05-16 17:22:52,351::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53769::DEBUG::2014-05-16 17:22:52,352::task::579::TaskManager.Task::(_updateState) Task=`558ee85e-e1dd-4b95-aa00-557c586af1fb`::moving from state init -> state preparing >Thread-53769::INFO::2014-05-16 17:22:52,352::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53769::INFO::2014-05-16 17:22:52,352::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53769::DEBUG::2014-05-16 17:22:52,352::task::1168::TaskManager.Task::(prepare) Task=`558ee85e-e1dd-4b95-aa00-557c586af1fb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53769::DEBUG::2014-05-16 17:22:52,352::task::579::TaskManager.Task::(_updateState) Task=`558ee85e-e1dd-4b95-aa00-557c586af1fb`::moving from state preparing -> state finished >Thread-53769::DEBUG::2014-05-16 17:22:52,353::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53769::DEBUG::2014-05-16 17:22:52,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53769::DEBUG::2014-05-16 17:22:52,353::task::974::TaskManager.Task::(_decref) Task=`558ee85e-e1dd-4b95-aa00-557c586af1fb`::ref 0 aborting False >Thread-53770::DEBUG::2014-05-16 17:22:52,361::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53770::DEBUG::2014-05-16 17:22:52,361::task::579::TaskManager.Task::(_updateState) Task=`962b3551-7983-473e-9208-73ee3d9373fd`::moving from state init -> state preparing >Thread-53770::INFO::2014-05-16 17:22:52,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53770::DEBUG::2014-05-16 17:22:52,362::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7e4cd9eb-f998-4ad5-afe5-7835bdd2316a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53770::DEBUG::2014-05-16 17:22:52,362::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53770::DEBUG::2014-05-16 17:22:52,362::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53770::DEBUG::2014-05-16 17:22:52,362::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7e4cd9eb-f998-4ad5-afe5-7835bdd2316a`::Granted request >Thread-53770::DEBUG::2014-05-16 17:22:52,362::task::811::TaskManager.Task::(resourceAcquired) Task=`962b3551-7983-473e-9208-73ee3d9373fd`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53770::DEBUG::2014-05-16 17:22:52,362::task::974::TaskManager.Task::(_decref) Task=`962b3551-7983-473e-9208-73ee3d9373fd`::ref 1 aborting False >Thread-53770::INFO::2014-05-16 17:22:52,363::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53770::DEBUG::2014-05-16 17:22:52,363::task::1168::TaskManager.Task::(prepare) Task=`962b3551-7983-473e-9208-73ee3d9373fd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53770::DEBUG::2014-05-16 17:22:52,363::task::579::TaskManager.Task::(_updateState) Task=`962b3551-7983-473e-9208-73ee3d9373fd`::moving from state preparing -> state finished >Thread-53770::DEBUG::2014-05-16 17:22:52,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53770::DEBUG::2014-05-16 17:22:52,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53770::DEBUG::2014-05-16 17:22:52,364::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53770::DEBUG::2014-05-16 17:22:52,364::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53770::DEBUG::2014-05-16 17:22:52,364::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53770::DEBUG::2014-05-16 17:22:52,364::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53770::DEBUG::2014-05-16 17:22:52,364::task::974::TaskManager.Task::(_decref) Task=`962b3551-7983-473e-9208-73ee3d9373fd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:22:53,286::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:53,353::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314045 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:55,365::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:55,431::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296624 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:22:57,442::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:57,513::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350173 s, 29.2 MB/s\n'; <rc> = 0 >Thread-53773::DEBUG::2014-05-16 17:22:58,799::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413612.000000 / 8.008272 / 262500000.000000 = 0.257525 >Thread-53773::DEBUG::2014-05-16 17:22:58,799::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065931827046293882, 'statsAge': 0.33065414428710938, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25752476917730238, 'rxDropped': 0} >Thread-53773::DEBUG::2014-05-16 17:22:58,799::task::579::TaskManager.Task::(_updateState) Task=`e450d177-c55f-4cbc-ace6-fc383a455c40`::moving from state init -> state preparing >Thread-53773::INFO::2014-05-16 17:22:58,800::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53773::INFO::2014-05-16 17:22:58,800::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000802007', 'lastCheck': '8.5', 'valid': True}} >Thread-53773::DEBUG::2014-05-16 17:22:58,800::task::1168::TaskManager.Task::(prepare) Task=`e450d177-c55f-4cbc-ace6-fc383a455c40`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000802007', 'lastCheck': '8.5', 'valid': True}} >Thread-53773::DEBUG::2014-05-16 17:22:58,800::task::579::TaskManager.Task::(_updateState) Task=`e450d177-c55f-4cbc-ace6-fc383a455c40`::moving from state preparing -> state finished >Thread-53773::DEBUG::2014-05-16 17:22:58,800::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53773::DEBUG::2014-05-16 17:22:58,800::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53773::DEBUG::2014-05-16 17:22:58,801::task::974::TaskManager.Task::(_decref) Task=`e450d177-c55f-4cbc-ace6-fc383a455c40`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:22:59,525::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:22:59,592::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315993 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:23:00,317::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:23:00,327::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000798789 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:01,604::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:01,670::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304229 s, 33.7 MB/s\n'; <rc> = 0 >Thread-53776::DEBUG::2014-05-16 17:23:02,398::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53776::DEBUG::2014-05-16 17:23:02,399::task::579::TaskManager.Task::(_updateState) Task=`e6a12585-603c-4412-9edf-19c9f06bee40`::moving from state init -> state preparing >Thread-53776::INFO::2014-05-16 17:23:02,399::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53776::INFO::2014-05-16 17:23:02,399::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53776::DEBUG::2014-05-16 17:23:02,400::task::1168::TaskManager.Task::(prepare) Task=`e6a12585-603c-4412-9edf-19c9f06bee40`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53776::DEBUG::2014-05-16 17:23:02,400::task::579::TaskManager.Task::(_updateState) Task=`e6a12585-603c-4412-9edf-19c9f06bee40`::moving from state preparing -> state finished >Thread-53776::DEBUG::2014-05-16 17:23:02,400::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53776::DEBUG::2014-05-16 17:23:02,400::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53776::DEBUG::2014-05-16 17:23:02,400::task::974::TaskManager.Task::(_decref) Task=`e6a12585-603c-4412-9edf-19c9f06bee40`::ref 0 aborting False >Thread-53777::DEBUG::2014-05-16 17:23:02,409::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53777::DEBUG::2014-05-16 17:23:02,409::task::579::TaskManager.Task::(_updateState) Task=`107696c3-32e8-458d-898b-8b1cb02b7285`::moving from state init -> state preparing >Thread-53777::INFO::2014-05-16 17:23:02,409::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53777::DEBUG::2014-05-16 17:23:02,410::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2974d640-860f-4195-a646-945cc58be64a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53777::DEBUG::2014-05-16 17:23:02,410::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53777::DEBUG::2014-05-16 17:23:02,410::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53777::DEBUG::2014-05-16 17:23:02,410::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2974d640-860f-4195-a646-945cc58be64a`::Granted request >Thread-53777::DEBUG::2014-05-16 17:23:02,410::task::811::TaskManager.Task::(resourceAcquired) Task=`107696c3-32e8-458d-898b-8b1cb02b7285`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53777::DEBUG::2014-05-16 17:23:02,411::task::974::TaskManager.Task::(_decref) Task=`107696c3-32e8-458d-898b-8b1cb02b7285`::ref 1 aborting False >Thread-53777::INFO::2014-05-16 17:23:02,411::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53777::DEBUG::2014-05-16 17:23:02,411::task::1168::TaskManager.Task::(prepare) Task=`107696c3-32e8-458d-898b-8b1cb02b7285`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53777::DEBUG::2014-05-16 17:23:02,412::task::579::TaskManager.Task::(_updateState) Task=`107696c3-32e8-458d-898b-8b1cb02b7285`::moving from state preparing -> state finished >Thread-53777::DEBUG::2014-05-16 17:23:02,412::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53777::DEBUG::2014-05-16 17:23:02,412::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53777::DEBUG::2014-05-16 17:23:02,412::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53777::DEBUG::2014-05-16 17:23:02,412::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53777::DEBUG::2014-05-16 17:23:02,413::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53777::DEBUG::2014-05-16 17:23:02,413::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53777::DEBUG::2014-05-16 17:23:02,413::task::974::TaskManager.Task::(_decref) Task=`107696c3-32e8-458d-898b-8b1cb02b7285`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:23:03,682::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:03,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354501 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:05,765::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:05,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031065 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:07,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:07,916::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345527 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:09,927::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:09,994::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309872 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:23:10,365::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:23:10,375::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000772651 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:12,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:12,078::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357332 s, 28.7 MB/s\n'; <rc> = 0 >Thread-53781::DEBUG::2014-05-16 17:23:12,459::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53781::DEBUG::2014-05-16 17:23:12,459::task::579::TaskManager.Task::(_updateState) Task=`bb46ace8-ccab-4ad0-9185-2fc170c93937`::moving from state init -> state preparing >Thread-53781::INFO::2014-05-16 17:23:12,460::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53781::INFO::2014-05-16 17:23:12,460::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53781::DEBUG::2014-05-16 17:23:12,460::task::1168::TaskManager.Task::(prepare) Task=`bb46ace8-ccab-4ad0-9185-2fc170c93937`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53781::DEBUG::2014-05-16 17:23:12,460::task::579::TaskManager.Task::(_updateState) Task=`bb46ace8-ccab-4ad0-9185-2fc170c93937`::moving from state preparing -> state finished >Thread-53781::DEBUG::2014-05-16 17:23:12,460::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53781::DEBUG::2014-05-16 17:23:12,461::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53781::DEBUG::2014-05-16 17:23:12,461::task::974::TaskManager.Task::(_decref) Task=`bb46ace8-ccab-4ad0-9185-2fc170c93937`::ref 0 aborting False >Thread-53782::DEBUG::2014-05-16 17:23:12,469::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53782::DEBUG::2014-05-16 17:23:12,469::task::579::TaskManager.Task::(_updateState) Task=`f986da0c-15f3-4072-a142-e535b6ce9f52`::moving from state init -> state preparing >Thread-53782::INFO::2014-05-16 17:23:12,469::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53782::DEBUG::2014-05-16 17:23:12,470::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4cb8fcd9-861c-431c-b374-2a185bbf0e83`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53782::DEBUG::2014-05-16 17:23:12,470::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53782::DEBUG::2014-05-16 17:23:12,470::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53782::DEBUG::2014-05-16 17:23:12,470::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4cb8fcd9-861c-431c-b374-2a185bbf0e83`::Granted request >Thread-53782::DEBUG::2014-05-16 17:23:12,471::task::811::TaskManager.Task::(resourceAcquired) Task=`f986da0c-15f3-4072-a142-e535b6ce9f52`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53782::DEBUG::2014-05-16 17:23:12,471::task::974::TaskManager.Task::(_decref) Task=`f986da0c-15f3-4072-a142-e535b6ce9f52`::ref 1 aborting False >Thread-53782::INFO::2014-05-16 17:23:12,472::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53782::DEBUG::2014-05-16 17:23:12,472::task::1168::TaskManager.Task::(prepare) Task=`f986da0c-15f3-4072-a142-e535b6ce9f52`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53782::DEBUG::2014-05-16 17:23:12,472::task::579::TaskManager.Task::(_updateState) Task=`f986da0c-15f3-4072-a142-e535b6ce9f52`::moving from state preparing -> state finished >Thread-53782::DEBUG::2014-05-16 17:23:12,472::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53782::DEBUG::2014-05-16 17:23:12,472::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53782::DEBUG::2014-05-16 17:23:12,472::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53782::DEBUG::2014-05-16 17:23:12,473::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53782::DEBUG::2014-05-16 17:23:12,473::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53782::DEBUG::2014-05-16 17:23:12,473::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53782::DEBUG::2014-05-16 17:23:12,473::task::974::TaskManager.Task::(_decref) Task=`f986da0c-15f3-4072-a142-e535b6ce9f52`::ref 0 aborting False >Thread-53783::DEBUG::2014-05-16 17:23:14,024::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3238422.000000 / 8.008260 / 262500000.000000 = 0.154052 >Thread-53783::DEBUG::2014-05-16 17:23:14,024::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0039156713493326582, 'statsAge': 1.5409770011901855, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15405151301660189, 'rxDropped': 0} >Thread-53783::DEBUG::2014-05-16 17:23:14,024::task::579::TaskManager.Task::(_updateState) Task=`051a5446-aeec-4c1b-a875-aea32b60cb18`::moving from state init -> state preparing >Thread-53783::INFO::2014-05-16 17:23:14,024::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53783::INFO::2014-05-16 17:23:14,024::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000772651', 'lastCheck': '3.6', 'valid': True}} >Thread-53783::DEBUG::2014-05-16 17:23:14,024::task::1168::TaskManager.Task::(prepare) Task=`051a5446-aeec-4c1b-a875-aea32b60cb18`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000772651', 'lastCheck': '3.6', 'valid': True}} >Thread-53783::DEBUG::2014-05-16 17:23:14,025::task::579::TaskManager.Task::(_updateState) Task=`051a5446-aeec-4c1b-a875-aea32b60cb18`::moving from state preparing -> state finished >Thread-53783::DEBUG::2014-05-16 17:23:14,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53783::DEBUG::2014-05-16 17:23:14,025::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53783::DEBUG::2014-05-16 17:23:14,025::task::974::TaskManager.Task::(_decref) Task=`051a5446-aeec-4c1b-a875-aea32b60cb18`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:23:14,089::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:14,157::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030769 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:16,169::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:16,236::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302474 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:18,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:18,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353623 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:20,331::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:20,418::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305076 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:23:20,500::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:23:20,533::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000753579 s, 5.4 MB/s\n'; <rc> = 0 >Thread-53787::DEBUG::2014-05-16 17:23:22,517::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53787::DEBUG::2014-05-16 17:23:22,518::task::579::TaskManager.Task::(_updateState) Task=`484b1bdd-d19e-4e34-a3c4-90bcaa1c337d`::moving from state init -> state preparing >Thread-53787::INFO::2014-05-16 17:23:22,518::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53787::INFO::2014-05-16 17:23:22,518::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53787::DEBUG::2014-05-16 17:23:22,518::task::1168::TaskManager.Task::(prepare) Task=`484b1bdd-d19e-4e34-a3c4-90bcaa1c337d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53787::DEBUG::2014-05-16 17:23:22,518::task::579::TaskManager.Task::(_updateState) Task=`484b1bdd-d19e-4e34-a3c4-90bcaa1c337d`::moving from state preparing -> state finished >Thread-53787::DEBUG::2014-05-16 17:23:22,519::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53787::DEBUG::2014-05-16 17:23:22,519::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53787::DEBUG::2014-05-16 17:23:22,519::task::974::TaskManager.Task::(_decref) Task=`484b1bdd-d19e-4e34-a3c4-90bcaa1c337d`::ref 0 aborting False >Thread-53788::DEBUG::2014-05-16 17:23:22,528::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53788::DEBUG::2014-05-16 17:23:22,528::task::579::TaskManager.Task::(_updateState) Task=`f17fe16c-ab78-4845-acf7-fdefb23c4c56`::moving from state init -> state preparing >Thread-53788::INFO::2014-05-16 17:23:22,529::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53788::DEBUG::2014-05-16 17:23:22,530::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bacc767c-bf09-4373-ab38-993a18da7920`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53788::DEBUG::2014-05-16 17:23:22,530::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53788::DEBUG::2014-05-16 17:23:22,530::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53788::DEBUG::2014-05-16 17:23:22,530::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bacc767c-bf09-4373-ab38-993a18da7920`::Granted request >Thread-53788::DEBUG::2014-05-16 17:23:22,531::task::811::TaskManager.Task::(resourceAcquired) Task=`f17fe16c-ab78-4845-acf7-fdefb23c4c56`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53788::DEBUG::2014-05-16 17:23:22,531::task::974::TaskManager.Task::(_decref) Task=`f17fe16c-ab78-4845-acf7-fdefb23c4c56`::ref 1 aborting False >Thread-53788::INFO::2014-05-16 17:23:22,531::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53788::DEBUG::2014-05-16 17:23:22,532::task::1168::TaskManager.Task::(prepare) Task=`f17fe16c-ab78-4845-acf7-fdefb23c4c56`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53788::DEBUG::2014-05-16 17:23:22,532::task::579::TaskManager.Task::(_updateState) Task=`f17fe16c-ab78-4845-acf7-fdefb23c4c56`::moving from state preparing -> state finished >Thread-53788::DEBUG::2014-05-16 17:23:22,532::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53788::DEBUG::2014-05-16 17:23:22,532::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53788::DEBUG::2014-05-16 17:23:22,532::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53788::DEBUG::2014-05-16 17:23:22,532::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53788::DEBUG::2014-05-16 17:23:22,533::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53788::DEBUG::2014-05-16 17:23:22,533::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53788::DEBUG::2014-05-16 17:23:22,533::task::974::TaskManager.Task::(_decref) Task=`f17fe16c-ab78-4845-acf7-fdefb23c4c56`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:23:22,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:22,704::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345231 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:24,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:24,786::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353656 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:26,798::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:26,864::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307439 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:28,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:28,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030758 s, 33.3 MB/s\n'; <rc> = 0 >Thread-53791::DEBUG::2014-05-16 17:23:29,165::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318212.000000 / 8.015216 / 262500000.000000 = 0.205239 >Thread-53791::DEBUG::2014-05-16 17:23:29,165::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053764407612071361, 'statsAge': 0.65844202041625977, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20523878193364384, 'rxDropped': 0} >Thread-53791::DEBUG::2014-05-16 17:23:29,166::task::579::TaskManager.Task::(_updateState) Task=`6bd015d8-cc68-4446-bb3f-902f7651115e`::moving from state init -> state preparing >Thread-53791::INFO::2014-05-16 17:23:29,166::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53791::INFO::2014-05-16 17:23:29,166::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753579', 'lastCheck': '8.5', 'valid': True}} >Thread-53791::DEBUG::2014-05-16 17:23:29,166::task::1168::TaskManager.Task::(prepare) Task=`6bd015d8-cc68-4446-bb3f-902f7651115e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753579', 'lastCheck': '8.5', 'valid': True}} >Thread-53791::DEBUG::2014-05-16 17:23:29,166::task::579::TaskManager.Task::(_updateState) Task=`6bd015d8-cc68-4446-bb3f-902f7651115e`::moving from state preparing -> state finished >Thread-53791::DEBUG::2014-05-16 17:23:29,167::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53791::DEBUG::2014-05-16 17:23:29,167::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53791::DEBUG::2014-05-16 17:23:29,167::task::974::TaskManager.Task::(_decref) Task=`6bd015d8-cc68-4446-bb3f-902f7651115e`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:23:30,653::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:23:30,664::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101146 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:30,955::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:31,020::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302939 s, 33.8 MB/s\n'; <rc> = 0 >Thread-53794::DEBUG::2014-05-16 17:23:32,590::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53794::DEBUG::2014-05-16 17:23:32,591::task::579::TaskManager.Task::(_updateState) Task=`1369894a-9bf3-454e-9aae-6cecac876f9c`::moving from state init -> state preparing >Thread-53794::INFO::2014-05-16 17:23:32,591::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53794::INFO::2014-05-16 17:23:32,591::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53794::DEBUG::2014-05-16 17:23:32,592::task::1168::TaskManager.Task::(prepare) Task=`1369894a-9bf3-454e-9aae-6cecac876f9c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53794::DEBUG::2014-05-16 17:23:32,592::task::579::TaskManager.Task::(_updateState) Task=`1369894a-9bf3-454e-9aae-6cecac876f9c`::moving from state preparing -> state finished >Thread-53794::DEBUG::2014-05-16 17:23:32,592::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53794::DEBUG::2014-05-16 17:23:32,592::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53794::DEBUG::2014-05-16 17:23:32,592::task::974::TaskManager.Task::(_decref) Task=`1369894a-9bf3-454e-9aae-6cecac876f9c`::ref 0 aborting False >Thread-53795::DEBUG::2014-05-16 17:23:32,601::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53795::DEBUG::2014-05-16 17:23:32,601::task::579::TaskManager.Task::(_updateState) Task=`dedf19c4-51c1-4fe7-9337-0d6cb46cde81`::moving from state init -> state preparing >Thread-53795::INFO::2014-05-16 17:23:32,601::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53795::DEBUG::2014-05-16 17:23:32,602::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7ad003eb-0633-4940-b555-5e7f20ce70e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53795::DEBUG::2014-05-16 17:23:32,602::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53795::DEBUG::2014-05-16 17:23:32,602::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53795::DEBUG::2014-05-16 17:23:32,602::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7ad003eb-0633-4940-b555-5e7f20ce70e5`::Granted request >Thread-53795::DEBUG::2014-05-16 17:23:32,602::task::811::TaskManager.Task::(resourceAcquired) Task=`dedf19c4-51c1-4fe7-9337-0d6cb46cde81`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53795::DEBUG::2014-05-16 17:23:32,603::task::974::TaskManager.Task::(_decref) Task=`dedf19c4-51c1-4fe7-9337-0d6cb46cde81`::ref 1 aborting False >Thread-53795::INFO::2014-05-16 17:23:32,603::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53795::DEBUG::2014-05-16 17:23:32,603::task::1168::TaskManager.Task::(prepare) Task=`dedf19c4-51c1-4fe7-9337-0d6cb46cde81`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53795::DEBUG::2014-05-16 17:23:32,604::task::579::TaskManager.Task::(_updateState) Task=`dedf19c4-51c1-4fe7-9337-0d6cb46cde81`::moving from state preparing -> state finished >Thread-53795::DEBUG::2014-05-16 17:23:32,604::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53795::DEBUG::2014-05-16 17:23:32,604::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53795::DEBUG::2014-05-16 17:23:32,604::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53795::DEBUG::2014-05-16 17:23:32,604::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53795::DEBUG::2014-05-16 17:23:32,604::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53795::DEBUG::2014-05-16 17:23:32,605::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53795::DEBUG::2014-05-16 17:23:32,605::task::974::TaskManager.Task::(_decref) Task=`dedf19c4-51c1-4fe7-9337-0d6cb46cde81`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:23:33,032::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:33,102::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347571 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:35,115::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:35,182::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308454 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:37,194::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:37,266::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359371 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:39,278::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:39,350::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356713 s, 28.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:23:40,697::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:23:40,707::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106005 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:41,362::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:41,432::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346917 s, 29.5 MB/s\n'; <rc> = 0 >Thread-53799::DEBUG::2014-05-16 17:23:42,642::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53799::DEBUG::2014-05-16 17:23:42,642::task::579::TaskManager.Task::(_updateState) Task=`03ea55bd-b1e1-411e-9351-b4357a137d8b`::moving from state init -> state preparing >Thread-53799::INFO::2014-05-16 17:23:42,642::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53799::INFO::2014-05-16 17:23:42,643::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53799::DEBUG::2014-05-16 17:23:42,643::task::1168::TaskManager.Task::(prepare) Task=`03ea55bd-b1e1-411e-9351-b4357a137d8b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53799::DEBUG::2014-05-16 17:23:42,643::task::579::TaskManager.Task::(_updateState) Task=`03ea55bd-b1e1-411e-9351-b4357a137d8b`::moving from state preparing -> state finished >Thread-53799::DEBUG::2014-05-16 17:23:42,643::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53799::DEBUG::2014-05-16 17:23:42,643::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53799::DEBUG::2014-05-16 17:23:42,643::task::974::TaskManager.Task::(_decref) Task=`03ea55bd-b1e1-411e-9351-b4357a137d8b`::ref 0 aborting False >Thread-53800::DEBUG::2014-05-16 17:23:42,652::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53800::DEBUG::2014-05-16 17:23:42,652::task::579::TaskManager.Task::(_updateState) Task=`67c1f1b9-8c52-44d6-a6e9-0b059efa39a0`::moving from state init -> state preparing >Thread-53800::INFO::2014-05-16 17:23:42,652::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53800::DEBUG::2014-05-16 17:23:42,652::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c1c48699-34f7-425c-89b6-466d2923289d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53800::DEBUG::2014-05-16 17:23:42,653::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53800::DEBUG::2014-05-16 17:23:42,653::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53800::DEBUG::2014-05-16 17:23:42,653::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c1c48699-34f7-425c-89b6-466d2923289d`::Granted request >Thread-53800::DEBUG::2014-05-16 17:23:42,653::task::811::TaskManager.Task::(resourceAcquired) Task=`67c1f1b9-8c52-44d6-a6e9-0b059efa39a0`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53800::DEBUG::2014-05-16 17:23:42,654::task::974::TaskManager.Task::(_decref) Task=`67c1f1b9-8c52-44d6-a6e9-0b059efa39a0`::ref 1 aborting False >Thread-53800::INFO::2014-05-16 17:23:42,654::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53800::DEBUG::2014-05-16 17:23:42,654::task::1168::TaskManager.Task::(prepare) Task=`67c1f1b9-8c52-44d6-a6e9-0b059efa39a0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53800::DEBUG::2014-05-16 17:23:42,655::task::579::TaskManager.Task::(_updateState) Task=`67c1f1b9-8c52-44d6-a6e9-0b059efa39a0`::moving from state preparing -> state finished >Thread-53800::DEBUG::2014-05-16 17:23:42,655::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53800::DEBUG::2014-05-16 17:23:42,655::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53800::DEBUG::2014-05-16 17:23:42,655::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53800::DEBUG::2014-05-16 17:23:42,655::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53800::DEBUG::2014-05-16 17:23:42,655::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53800::DEBUG::2014-05-16 17:23:42,656::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53800::DEBUG::2014-05-16 17:23:42,656::task::974::TaskManager.Task::(_decref) Task=`67c1f1b9-8c52-44d6-a6e9-0b059efa39a0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:23:43,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:43,510::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309343 s, 33.1 MB/s\n'; <rc> = 0 >Thread-53801::DEBUG::2014-05-16 17:23:44,330::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5410151.000000 / 8.008268 / 262500000.000000 = 0.257360 >Thread-53801::DEBUG::2014-05-16 17:23:44,330::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0064218391250948073, 'statsAge': 1.8091959953308105, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2573602524813019, 'rxDropped': 0} >Thread-53801::DEBUG::2014-05-16 17:23:44,331::task::579::TaskManager.Task::(_updateState) Task=`9530bef0-b5ed-4170-beb6-6cc7790ff28b`::moving from state init -> state preparing >Thread-53801::INFO::2014-05-16 17:23:44,331::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53801::INFO::2014-05-16 17:23:44,332::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106005', 'lastCheck': '3.6', 'valid': True}} >Thread-53801::DEBUG::2014-05-16 17:23:44,332::task::1168::TaskManager.Task::(prepare) Task=`9530bef0-b5ed-4170-beb6-6cc7790ff28b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106005', 'lastCheck': '3.6', 'valid': True}} >Thread-53801::DEBUG::2014-05-16 17:23:44,332::task::579::TaskManager.Task::(_updateState) Task=`9530bef0-b5ed-4170-beb6-6cc7790ff28b`::moving from state preparing -> state finished >Thread-53801::DEBUG::2014-05-16 17:23:44,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53801::DEBUG::2014-05-16 17:23:44,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53801::DEBUG::2014-05-16 17:23:44,332::task::974::TaskManager.Task::(_decref) Task=`9530bef0-b5ed-4170-beb6-6cc7790ff28b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:23:45,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:45,591::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339504 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:47,603::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:47,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03561 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:49,686::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:49,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309607 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:23:50,744::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:23:50,754::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000801664 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:51,764::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:51,834::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345599 s, 29.6 MB/s\n'; <rc> = 0 >Thread-53805::DEBUG::2014-05-16 17:23:52,693::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53805::DEBUG::2014-05-16 17:23:52,694::task::579::TaskManager.Task::(_updateState) Task=`1c6f2c2e-4c5f-4cb9-92ea-fc15ba75d5d1`::moving from state init -> state preparing >Thread-53805::INFO::2014-05-16 17:23:52,694::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53805::INFO::2014-05-16 17:23:52,694::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53805::DEBUG::2014-05-16 17:23:52,694::task::1168::TaskManager.Task::(prepare) Task=`1c6f2c2e-4c5f-4cb9-92ea-fc15ba75d5d1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53805::DEBUG::2014-05-16 17:23:52,694::task::579::TaskManager.Task::(_updateState) Task=`1c6f2c2e-4c5f-4cb9-92ea-fc15ba75d5d1`::moving from state preparing -> state finished >Thread-53805::DEBUG::2014-05-16 17:23:52,695::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53805::DEBUG::2014-05-16 17:23:52,695::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53805::DEBUG::2014-05-16 17:23:52,695::task::974::TaskManager.Task::(_decref) Task=`1c6f2c2e-4c5f-4cb9-92ea-fc15ba75d5d1`::ref 0 aborting False >Thread-53806::DEBUG::2014-05-16 17:23:52,703::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53806::DEBUG::2014-05-16 17:23:52,704::task::579::TaskManager.Task::(_updateState) Task=`4f6258d4-5671-441a-a1b7-0786560dfbc8`::moving from state init -> state preparing >Thread-53806::INFO::2014-05-16 17:23:52,704::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53806::DEBUG::2014-05-16 17:23:52,704::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fa88e65c-b9ea-4505-a3e7-316528b31715`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53806::DEBUG::2014-05-16 17:23:52,704::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53806::DEBUG::2014-05-16 17:23:52,705::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53806::DEBUG::2014-05-16 17:23:52,705::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fa88e65c-b9ea-4505-a3e7-316528b31715`::Granted request >Thread-53806::DEBUG::2014-05-16 17:23:52,705::task::811::TaskManager.Task::(resourceAcquired) Task=`4f6258d4-5671-441a-a1b7-0786560dfbc8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53806::DEBUG::2014-05-16 17:23:52,706::task::974::TaskManager.Task::(_decref) Task=`4f6258d4-5671-441a-a1b7-0786560dfbc8`::ref 1 aborting False >Thread-53806::INFO::2014-05-16 17:23:52,706::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53806::DEBUG::2014-05-16 17:23:52,706::task::1168::TaskManager.Task::(prepare) Task=`4f6258d4-5671-441a-a1b7-0786560dfbc8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53806::DEBUG::2014-05-16 17:23:52,707::task::579::TaskManager.Task::(_updateState) Task=`4f6258d4-5671-441a-a1b7-0786560dfbc8`::moving from state preparing -> state finished >Thread-53806::DEBUG::2014-05-16 17:23:52,707::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53806::DEBUG::2014-05-16 17:23:52,707::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53806::DEBUG::2014-05-16 17:23:52,707::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53806::DEBUG::2014-05-16 17:23:52,707::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53806::DEBUG::2014-05-16 17:23:52,707::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53806::DEBUG::2014-05-16 17:23:52,708::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53806::DEBUG::2014-05-16 17:23:52,708::task::974::TaskManager.Task::(_decref) Task=`4f6258d4-5671-441a-a1b7-0786560dfbc8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:23:53,846::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:53,917::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352543 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:55,929::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:55,996::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304609 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:23:58,008::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:23:58,074::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306688 s, 33.4 MB/s\n'; <rc> = 0 >Thread-53809::DEBUG::2014-05-16 17:23:59,495::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4341240.000000 / 8.008536 / 262500000.000000 = 0.206505 >Thread-53809::DEBUG::2014-05-16 17:23:59,496::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0057005842416380107, 'statsAge': 0.95769715309143066, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2065053766118875, 'rxDropped': 0} >Thread-53809::DEBUG::2014-05-16 17:23:59,496::task::579::TaskManager.Task::(_updateState) Task=`75bf1763-bac3-4672-8ad5-0988f881b113`::moving from state init -> state preparing >Thread-53809::INFO::2014-05-16 17:23:59,496::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53809::INFO::2014-05-16 17:23:59,497::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000801664', 'lastCheck': '8.7', 'valid': True}} >Thread-53809::DEBUG::2014-05-16 17:23:59,497::task::1168::TaskManager.Task::(prepare) Task=`75bf1763-bac3-4672-8ad5-0988f881b113`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000801664', 'lastCheck': '8.7', 'valid': True}} >Thread-53809::DEBUG::2014-05-16 17:23:59,497::task::579::TaskManager.Task::(_updateState) Task=`75bf1763-bac3-4672-8ad5-0988f881b113`::moving from state preparing -> state finished >Thread-53809::DEBUG::2014-05-16 17:23:59,497::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53809::DEBUG::2014-05-16 17:23:59,497::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53809::DEBUG::2014-05-16 17:23:59,497::task::974::TaskManager.Task::(_decref) Task=`75bf1763-bac3-4672-8ad5-0988f881b113`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:24:00,086::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:00,158::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358934 s, 28.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:24:00,792::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:24:00,802::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000863968 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:02,169::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:02,241::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349164 s, 29.3 MB/s\n'; <rc> = 0 >Thread-53812::DEBUG::2014-05-16 17:24:02,741::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53812::DEBUG::2014-05-16 17:24:02,741::task::579::TaskManager.Task::(_updateState) Task=`090a3f4e-523c-4004-b5b2-d4e4362442aa`::moving from state init -> state preparing >Thread-53812::INFO::2014-05-16 17:24:02,742::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53812::INFO::2014-05-16 17:24:02,742::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53812::DEBUG::2014-05-16 17:24:02,742::task::1168::TaskManager.Task::(prepare) Task=`090a3f4e-523c-4004-b5b2-d4e4362442aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53812::DEBUG::2014-05-16 17:24:02,742::task::579::TaskManager.Task::(_updateState) Task=`090a3f4e-523c-4004-b5b2-d4e4362442aa`::moving from state preparing -> state finished >Thread-53812::DEBUG::2014-05-16 17:24:02,742::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53812::DEBUG::2014-05-16 17:24:02,743::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53812::DEBUG::2014-05-16 17:24:02,743::task::974::TaskManager.Task::(_decref) Task=`090a3f4e-523c-4004-b5b2-d4e4362442aa`::ref 0 aborting False >Thread-53813::DEBUG::2014-05-16 17:24:02,751::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53813::DEBUG::2014-05-16 17:24:02,752::task::579::TaskManager.Task::(_updateState) Task=`cb5bda54-fba8-495a-a36a-03418b99abde`::moving from state init -> state preparing >Thread-53813::INFO::2014-05-16 17:24:02,752::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53813::DEBUG::2014-05-16 17:24:02,752::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`780b8331-ab71-410b-af0f-4ce1a8bbd2d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53813::DEBUG::2014-05-16 17:24:02,752::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53813::DEBUG::2014-05-16 17:24:02,753::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53813::DEBUG::2014-05-16 17:24:02,753::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`780b8331-ab71-410b-af0f-4ce1a8bbd2d1`::Granted request >Thread-53813::DEBUG::2014-05-16 17:24:02,753::task::811::TaskManager.Task::(resourceAcquired) Task=`cb5bda54-fba8-495a-a36a-03418b99abde`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53813::DEBUG::2014-05-16 17:24:02,753::task::974::TaskManager.Task::(_decref) Task=`cb5bda54-fba8-495a-a36a-03418b99abde`::ref 1 aborting False >Thread-53813::INFO::2014-05-16 17:24:02,754::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53813::DEBUG::2014-05-16 17:24:02,754::task::1168::TaskManager.Task::(prepare) Task=`cb5bda54-fba8-495a-a36a-03418b99abde`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53813::DEBUG::2014-05-16 17:24:02,754::task::579::TaskManager.Task::(_updateState) Task=`cb5bda54-fba8-495a-a36a-03418b99abde`::moving from state preparing -> state finished >Thread-53813::DEBUG::2014-05-16 17:24:02,755::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53813::DEBUG::2014-05-16 17:24:02,755::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53813::DEBUG::2014-05-16 17:24:02,755::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53813::DEBUG::2014-05-16 17:24:02,755::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53813::DEBUG::2014-05-16 17:24:02,755::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53813::DEBUG::2014-05-16 17:24:02,755::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53813::DEBUG::2014-05-16 17:24:02,756::task::974::TaskManager.Task::(_decref) Task=`cb5bda54-fba8-495a-a36a-03418b99abde`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:24:04,253::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:04,321::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315231 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:06,334::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:06,405::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348583 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:08,417::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:08,489::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354647 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:10,500::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:10,572::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307523 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:24:10,839::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:24:10,849::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000839165 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:12,584::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:12,655::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350833 s, 29.2 MB/s\n'; <rc> = 0 >Thread-53817::DEBUG::2014-05-16 17:24:12,786::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53817::DEBUG::2014-05-16 17:24:12,786::task::579::TaskManager.Task::(_updateState) Task=`8c5421a1-16e7-4dbd-85fd-0f6703ed60fb`::moving from state init -> state preparing >Thread-53817::INFO::2014-05-16 17:24:12,787::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53817::INFO::2014-05-16 17:24:12,787::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53817::DEBUG::2014-05-16 17:24:12,787::task::1168::TaskManager.Task::(prepare) Task=`8c5421a1-16e7-4dbd-85fd-0f6703ed60fb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53817::DEBUG::2014-05-16 17:24:12,787::task::579::TaskManager.Task::(_updateState) Task=`8c5421a1-16e7-4dbd-85fd-0f6703ed60fb`::moving from state preparing -> state finished >Thread-53817::DEBUG::2014-05-16 17:24:12,787::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53817::DEBUG::2014-05-16 17:24:12,788::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53817::DEBUG::2014-05-16 17:24:12,788::task::974::TaskManager.Task::(_decref) Task=`8c5421a1-16e7-4dbd-85fd-0f6703ed60fb`::ref 0 aborting False >Thread-53818::DEBUG::2014-05-16 17:24:12,797::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53818::DEBUG::2014-05-16 17:24:12,797::task::579::TaskManager.Task::(_updateState) Task=`b13d8059-771e-4198-9125-372803f1f3d1`::moving from state init -> state preparing >Thread-53818::INFO::2014-05-16 17:24:12,797::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53818::DEBUG::2014-05-16 17:24:12,798::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d93e3259-e136-41f5-a427-02ba74de23b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53818::DEBUG::2014-05-16 17:24:12,798::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53818::DEBUG::2014-05-16 17:24:12,799::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53818::DEBUG::2014-05-16 17:24:12,799::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d93e3259-e136-41f5-a427-02ba74de23b7`::Granted request >Thread-53818::DEBUG::2014-05-16 17:24:12,800::task::811::TaskManager.Task::(resourceAcquired) Task=`b13d8059-771e-4198-9125-372803f1f3d1`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53818::DEBUG::2014-05-16 17:24:12,800::task::974::TaskManager.Task::(_decref) Task=`b13d8059-771e-4198-9125-372803f1f3d1`::ref 1 aborting False >Thread-53818::INFO::2014-05-16 17:24:12,800::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53818::DEBUG::2014-05-16 17:24:12,801::task::1168::TaskManager.Task::(prepare) Task=`b13d8059-771e-4198-9125-372803f1f3d1`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53818::DEBUG::2014-05-16 17:24:12,801::task::579::TaskManager.Task::(_updateState) Task=`b13d8059-771e-4198-9125-372803f1f3d1`::moving from state preparing -> state finished >Thread-53818::DEBUG::2014-05-16 17:24:12,801::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53818::DEBUG::2014-05-16 17:24:12,801::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53818::DEBUG::2014-05-16 17:24:12,801::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53818::DEBUG::2014-05-16 17:24:12,801::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53818::DEBUG::2014-05-16 17:24:12,802::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53818::DEBUG::2014-05-16 17:24:12,802::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53818::DEBUG::2014-05-16 17:24:12,802::task::974::TaskManager.Task::(_decref) Task=`b13d8059-771e-4198-9125-372803f1f3d1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:24:14,667::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-53819::DEBUG::2014-05-16 17:24:14,684::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4310209.000000 / 8.011294 / 262500000.000000 = 0.204959 >Thread-53819::DEBUG::2014-05-16 17:24:14,684::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052930038663090862, 'statsAge': 0.12591695785522461, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20495870004132799, 'rxDropped': 0} >Thread-53819::DEBUG::2014-05-16 17:24:14,684::task::579::TaskManager.Task::(_updateState) Task=`99933ad5-fbdb-4860-ba89-1a68152c041d`::moving from state init -> state preparing >Thread-53819::INFO::2014-05-16 17:24:14,685::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53819::INFO::2014-05-16 17:24:14,685::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000839165', 'lastCheck': '3.8', 'valid': True}} >Thread-53819::DEBUG::2014-05-16 17:24:14,685::task::1168::TaskManager.Task::(prepare) Task=`99933ad5-fbdb-4860-ba89-1a68152c041d`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000839165', 'lastCheck': '3.8', 'valid': True}} >Thread-53819::DEBUG::2014-05-16 17:24:14,685::task::579::TaskManager.Task::(_updateState) Task=`99933ad5-fbdb-4860-ba89-1a68152c041d`::moving from state preparing -> state finished >Thread-53819::DEBUG::2014-05-16 17:24:14,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53819::DEBUG::2014-05-16 17:24:14,685::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53819::DEBUG::2014-05-16 17:24:14,686::task::974::TaskManager.Task::(_decref) Task=`99933ad5-fbdb-4860-ba89-1a68152c041d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:24:14,738::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350299 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:16,750::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:16,816::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300594 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:18,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:18,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349482 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:24:20,882::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:24:20,893::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010582 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:20,912::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:20,983::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345938 s, 29.6 MB/s\n'; <rc> = 0 >Thread-53823::DEBUG::2014-05-16 17:24:22,834::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53823::DEBUG::2014-05-16 17:24:22,835::task::579::TaskManager.Task::(_updateState) Task=`1e567de4-9ef7-4e25-9aca-c0d4b6c7e483`::moving from state init -> state preparing >Thread-53823::INFO::2014-05-16 17:24:22,835::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53823::INFO::2014-05-16 17:24:22,835::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53823::DEBUG::2014-05-16 17:24:22,835::task::1168::TaskManager.Task::(prepare) Task=`1e567de4-9ef7-4e25-9aca-c0d4b6c7e483`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53823::DEBUG::2014-05-16 17:24:22,835::task::579::TaskManager.Task::(_updateState) Task=`1e567de4-9ef7-4e25-9aca-c0d4b6c7e483`::moving from state preparing -> state finished >Thread-53823::DEBUG::2014-05-16 17:24:22,836::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53823::DEBUG::2014-05-16 17:24:22,836::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53823::DEBUG::2014-05-16 17:24:22,836::task::974::TaskManager.Task::(_decref) Task=`1e567de4-9ef7-4e25-9aca-c0d4b6c7e483`::ref 0 aborting False >Thread-53824::DEBUG::2014-05-16 17:24:22,844::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53824::DEBUG::2014-05-16 17:24:22,844::task::579::TaskManager.Task::(_updateState) Task=`ac4209cf-273e-4b5d-8acd-e64170e33d20`::moving from state init -> state preparing >Thread-53824::INFO::2014-05-16 17:24:22,845::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53824::DEBUG::2014-05-16 17:24:22,845::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cf1fb3e8-5737-4165-a3e9-173154d6b2ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53824::DEBUG::2014-05-16 17:24:22,845::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53824::DEBUG::2014-05-16 17:24:22,845::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53824::DEBUG::2014-05-16 17:24:22,846::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cf1fb3e8-5737-4165-a3e9-173154d6b2ee`::Granted request >Thread-53824::DEBUG::2014-05-16 17:24:22,846::task::811::TaskManager.Task::(resourceAcquired) Task=`ac4209cf-273e-4b5d-8acd-e64170e33d20`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53824::DEBUG::2014-05-16 17:24:22,846::task::974::TaskManager.Task::(_decref) Task=`ac4209cf-273e-4b5d-8acd-e64170e33d20`::ref 1 aborting False >Thread-53824::INFO::2014-05-16 17:24:22,847::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53824::DEBUG::2014-05-16 17:24:22,847::task::1168::TaskManager.Task::(prepare) Task=`ac4209cf-273e-4b5d-8acd-e64170e33d20`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53824::DEBUG::2014-05-16 17:24:22,847::task::579::TaskManager.Task::(_updateState) Task=`ac4209cf-273e-4b5d-8acd-e64170e33d20`::moving from state preparing -> state finished >Thread-53824::DEBUG::2014-05-16 17:24:22,847::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53824::DEBUG::2014-05-16 17:24:22,847::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53824::DEBUG::2014-05-16 17:24:22,848::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53824::DEBUG::2014-05-16 17:24:22,848::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53824::DEBUG::2014-05-16 17:24:22,848::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53824::DEBUG::2014-05-16 17:24:22,848::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53824::DEBUG::2014-05-16 17:24:22,848::task::974::TaskManager.Task::(_decref) Task=`ac4209cf-273e-4b5d-8acd-e64170e33d20`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:24:22,994::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:23,066::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357543 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:25,078::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:25,145::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031075 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:27,157::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:27,227::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348763 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:29,239::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:29,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313095 s, 32.7 MB/s\n'; <rc> = 0 >Thread-53827::DEBUG::2014-05-16 17:24:29,828::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315366.000000 / 8.008352 / 262500000.000000 = 0.205279 >Thread-53827::DEBUG::2014-05-16 17:24:29,828::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053330039039369802, 'statsAge': 1.2560281753540039, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20527931250483375, 'rxDropped': 0} >Thread-53827::DEBUG::2014-05-16 17:24:29,829::task::579::TaskManager.Task::(_updateState) Task=`e114a273-410e-4f31-9d7b-623f11d02efd`::moving from state init -> state preparing >Thread-53827::INFO::2014-05-16 17:24:29,829::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53827::INFO::2014-05-16 17:24:29,829::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010582', 'lastCheck': '8.9', 'valid': True}} >Thread-53827::DEBUG::2014-05-16 17:24:29,829::task::1168::TaskManager.Task::(prepare) Task=`e114a273-410e-4f31-9d7b-623f11d02efd`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010582', 'lastCheck': '8.9', 'valid': True}} >Thread-53827::DEBUG::2014-05-16 17:24:29,830::task::579::TaskManager.Task::(_updateState) Task=`e114a273-410e-4f31-9d7b-623f11d02efd`::moving from state preparing -> state finished >Thread-53827::DEBUG::2014-05-16 17:24:29,830::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53827::DEBUG::2014-05-16 17:24:29,830::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53827::DEBUG::2014-05-16 17:24:29,830::task::974::TaskManager.Task::(_decref) Task=`e114a273-410e-4f31-9d7b-623f11d02efd`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:24:30,941::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:24:30,951::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109579 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:31,318::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:31,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309578 s, 33.1 MB/s\n'; <rc> = 0 >Thread-53829::DEBUG::2014-05-16 17:24:32,901::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53829::DEBUG::2014-05-16 17:24:32,902::task::579::TaskManager.Task::(_updateState) Task=`e1cc9b15-3c63-4baf-985a-e07c5fccfd6e`::moving from state init -> state preparing >Thread-53829::INFO::2014-05-16 17:24:32,902::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53829::INFO::2014-05-16 17:24:32,902::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53829::DEBUG::2014-05-16 17:24:32,902::task::1168::TaskManager.Task::(prepare) Task=`e1cc9b15-3c63-4baf-985a-e07c5fccfd6e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53829::DEBUG::2014-05-16 17:24:32,903::task::579::TaskManager.Task::(_updateState) Task=`e1cc9b15-3c63-4baf-985a-e07c5fccfd6e`::moving from state preparing -> state finished >Thread-53829::DEBUG::2014-05-16 17:24:32,903::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53829::DEBUG::2014-05-16 17:24:32,903::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53829::DEBUG::2014-05-16 17:24:32,903::task::974::TaskManager.Task::(_decref) Task=`e1cc9b15-3c63-4baf-985a-e07c5fccfd6e`::ref 0 aborting False >Thread-53830::DEBUG::2014-05-16 17:24:32,914::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53830::DEBUG::2014-05-16 17:24:32,914::task::579::TaskManager.Task::(_updateState) Task=`ec5f8996-b8f1-4960-b368-842bdde438c4`::moving from state init -> state preparing >Thread-53830::INFO::2014-05-16 17:24:32,915::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53830::DEBUG::2014-05-16 17:24:32,918::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3d60bf82-d865-42ec-945e-83ca4ab6bab2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53830::DEBUG::2014-05-16 17:24:32,919::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53830::DEBUG::2014-05-16 17:24:32,919::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53830::DEBUG::2014-05-16 17:24:32,919::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3d60bf82-d865-42ec-945e-83ca4ab6bab2`::Granted request >Thread-53830::DEBUG::2014-05-16 17:24:32,919::task::811::TaskManager.Task::(resourceAcquired) Task=`ec5f8996-b8f1-4960-b368-842bdde438c4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53830::DEBUG::2014-05-16 17:24:32,919::task::974::TaskManager.Task::(_decref) Task=`ec5f8996-b8f1-4960-b368-842bdde438c4`::ref 1 aborting False >Thread-53830::INFO::2014-05-16 17:24:32,920::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53830::DEBUG::2014-05-16 17:24:32,920::task::1168::TaskManager.Task::(prepare) Task=`ec5f8996-b8f1-4960-b368-842bdde438c4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53830::DEBUG::2014-05-16 17:24:32,920::task::579::TaskManager.Task::(_updateState) Task=`ec5f8996-b8f1-4960-b368-842bdde438c4`::moving from state preparing -> state finished >Thread-53830::DEBUG::2014-05-16 17:24:32,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53830::DEBUG::2014-05-16 17:24:32,921::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53830::DEBUG::2014-05-16 17:24:32,921::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53830::DEBUG::2014-05-16 17:24:32,921::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53830::DEBUG::2014-05-16 17:24:32,921::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53830::DEBUG::2014-05-16 17:24:32,922::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53830::DEBUG::2014-05-16 17:24:32,922::task::974::TaskManager.Task::(_decref) Task=`ec5f8996-b8f1-4960-b368-842bdde438c4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:24:33,398::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:33,469::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035411 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:35,481::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:35,548::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305173 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:37,560::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:37,630::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339705 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:39,642::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:39,713::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351906 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:24:40,986::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:24:40,997::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100505 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:41,725::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:41,795::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348969 s, 29.3 MB/s\n'; <rc> = 0 >Thread-53835::DEBUG::2014-05-16 17:24:42,951::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53835::DEBUG::2014-05-16 17:24:42,952::task::579::TaskManager.Task::(_updateState) Task=`84a3eb04-42fd-444e-aab2-e722bca2d83c`::moving from state init -> state preparing >Thread-53835::INFO::2014-05-16 17:24:42,952::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53835::INFO::2014-05-16 17:24:42,952::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53835::DEBUG::2014-05-16 17:24:42,952::task::1168::TaskManager.Task::(prepare) Task=`84a3eb04-42fd-444e-aab2-e722bca2d83c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53835::DEBUG::2014-05-16 17:24:42,953::task::579::TaskManager.Task::(_updateState) Task=`84a3eb04-42fd-444e-aab2-e722bca2d83c`::moving from state preparing -> state finished >Thread-53835::DEBUG::2014-05-16 17:24:42,953::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53835::DEBUG::2014-05-16 17:24:42,953::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53835::DEBUG::2014-05-16 17:24:42,953::task::974::TaskManager.Task::(_decref) Task=`84a3eb04-42fd-444e-aab2-e722bca2d83c`::ref 0 aborting False >Thread-53836::DEBUG::2014-05-16 17:24:42,961::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53836::DEBUG::2014-05-16 17:24:42,961::task::579::TaskManager.Task::(_updateState) Task=`ee1901d4-e2be-4918-a45a-762acaf5cb00`::moving from state init -> state preparing >Thread-53836::INFO::2014-05-16 17:24:42,961::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53836::DEBUG::2014-05-16 17:24:42,962::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7485ebe0-cb61-41f1-990a-82a6ddc89c0a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53836::DEBUG::2014-05-16 17:24:42,962::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53836::DEBUG::2014-05-16 17:24:42,962::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53836::DEBUG::2014-05-16 17:24:42,962::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7485ebe0-cb61-41f1-990a-82a6ddc89c0a`::Granted request >Thread-53836::DEBUG::2014-05-16 17:24:42,963::task::811::TaskManager.Task::(resourceAcquired) Task=`ee1901d4-e2be-4918-a45a-762acaf5cb00`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53836::DEBUG::2014-05-16 17:24:42,963::task::974::TaskManager.Task::(_decref) Task=`ee1901d4-e2be-4918-a45a-762acaf5cb00`::ref 1 aborting False >Thread-53836::INFO::2014-05-16 17:24:42,963::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53836::DEBUG::2014-05-16 17:24:42,964::task::1168::TaskManager.Task::(prepare) Task=`ee1901d4-e2be-4918-a45a-762acaf5cb00`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53836::DEBUG::2014-05-16 17:24:42,964::task::579::TaskManager.Task::(_updateState) Task=`ee1901d4-e2be-4918-a45a-762acaf5cb00`::moving from state preparing -> state finished >Thread-53836::DEBUG::2014-05-16 17:24:42,964::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53836::DEBUG::2014-05-16 17:24:42,964::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53836::DEBUG::2014-05-16 17:24:42,964::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53836::DEBUG::2014-05-16 17:24:42,965::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53836::DEBUG::2014-05-16 17:24:42,965::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53836::DEBUG::2014-05-16 17:24:42,965::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53836::DEBUG::2014-05-16 17:24:42,965::task::974::TaskManager.Task::(_decref) Task=`ee1901d4-e2be-4918-a45a-762acaf5cb00`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:24:43,807::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:43,874::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309042 s, 33.1 MB/s\n'; <rc> = 0 >Thread-53837::DEBUG::2014-05-16 17:24:45,003::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4340919.000000 / 8.008507 / 262500000.000000 = 0.206491 >Thread-53837::DEBUG::2014-05-16 17:24:45,004::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0056730150672043064, 'statsAge': 0.41458988189697266, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20649085101889528, 'rxDropped': 0} >Thread-53837::DEBUG::2014-05-16 17:24:45,004::task::579::TaskManager.Task::(_updateState) Task=`57d0f4e0-7043-4fc2-b107-a547c2d67c7a`::moving from state init -> state preparing >Thread-53837::INFO::2014-05-16 17:24:45,004::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53837::INFO::2014-05-16 17:24:45,005::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100505', 'lastCheck': '4.0', 'valid': True}} >Thread-53837::DEBUG::2014-05-16 17:24:45,005::task::1168::TaskManager.Task::(prepare) Task=`57d0f4e0-7043-4fc2-b107-a547c2d67c7a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100505', 'lastCheck': '4.0', 'valid': True}} >Thread-53837::DEBUG::2014-05-16 17:24:45,005::task::579::TaskManager.Task::(_updateState) Task=`57d0f4e0-7043-4fc2-b107-a547c2d67c7a`::moving from state preparing -> state finished >Thread-53837::DEBUG::2014-05-16 17:24:45,005::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53837::DEBUG::2014-05-16 17:24:45,005::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53837::DEBUG::2014-05-16 17:24:45,005::task::974::TaskManager.Task::(_decref) Task=`57d0f4e0-7043-4fc2-b107-a547c2d67c7a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:24:45,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:45,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353116 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:47,968::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:48,040::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034306 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:50,052::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:50,120::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315992 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:24:51,034::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:24:51,044::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000817 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:52,132::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:52,200::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312518 s, 32.8 MB/s\n'; <rc> = 0 >Thread-53841::DEBUG::2014-05-16 17:24:53,013::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53841::DEBUG::2014-05-16 17:24:53,013::task::579::TaskManager.Task::(_updateState) Task=`f7c306fd-c4d8-43bf-b879-87a3e4d8722b`::moving from state init -> state preparing >Thread-53841::INFO::2014-05-16 17:24:53,053::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53841::INFO::2014-05-16 17:24:53,053::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53841::DEBUG::2014-05-16 17:24:53,053::task::1168::TaskManager.Task::(prepare) Task=`f7c306fd-c4d8-43bf-b879-87a3e4d8722b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53841::DEBUG::2014-05-16 17:24:53,054::task::579::TaskManager.Task::(_updateState) Task=`f7c306fd-c4d8-43bf-b879-87a3e4d8722b`::moving from state preparing -> state finished >Thread-53841::DEBUG::2014-05-16 17:24:53,054::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53841::DEBUG::2014-05-16 17:24:53,054::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53841::DEBUG::2014-05-16 17:24:53,054::task::974::TaskManager.Task::(_decref) Task=`f7c306fd-c4d8-43bf-b879-87a3e4d8722b`::ref 0 aborting False >Thread-53842::DEBUG::2014-05-16 17:24:53,063::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53842::DEBUG::2014-05-16 17:24:53,063::task::579::TaskManager.Task::(_updateState) Task=`eed95dcb-ecb1-475c-b1a3-78876326a914`::moving from state init -> state preparing >Thread-53842::INFO::2014-05-16 17:24:53,063::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53842::DEBUG::2014-05-16 17:24:53,063::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`057927c5-6acd-47cd-87fb-4cbbfebdfdbe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53842::DEBUG::2014-05-16 17:24:53,064::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53842::DEBUG::2014-05-16 17:24:53,064::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53842::DEBUG::2014-05-16 17:24:53,064::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`057927c5-6acd-47cd-87fb-4cbbfebdfdbe`::Granted request >Thread-53842::DEBUG::2014-05-16 17:24:53,064::task::811::TaskManager.Task::(resourceAcquired) Task=`eed95dcb-ecb1-475c-b1a3-78876326a914`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53842::DEBUG::2014-05-16 17:24:53,065::task::974::TaskManager.Task::(_decref) Task=`eed95dcb-ecb1-475c-b1a3-78876326a914`::ref 1 aborting False >Thread-53842::INFO::2014-05-16 17:24:53,065::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53842::DEBUG::2014-05-16 17:24:53,065::task::1168::TaskManager.Task::(prepare) Task=`eed95dcb-ecb1-475c-b1a3-78876326a914`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53842::DEBUG::2014-05-16 17:24:53,066::task::579::TaskManager.Task::(_updateState) Task=`eed95dcb-ecb1-475c-b1a3-78876326a914`::moving from state preparing -> state finished >Thread-53842::DEBUG::2014-05-16 17:24:53,066::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53842::DEBUG::2014-05-16 17:24:53,066::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53842::DEBUG::2014-05-16 17:24:53,066::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53842::DEBUG::2014-05-16 17:24:53,066::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53842::DEBUG::2014-05-16 17:24:53,066::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53842::DEBUG::2014-05-16 17:24:53,067::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53842::DEBUG::2014-05-16 17:24:53,067::task::974::TaskManager.Task::(_decref) Task=`eed95dcb-ecb1-475c-b1a3-78876326a914`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:24:54,212::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:54,284::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355265 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:56,295::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:56,362::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307228 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:24:58,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:24:58,440::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296788 s, 34.5 MB/s\n'; <rc> = 0 >Thread-53845::DEBUG::2014-05-16 17:25:00,143::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5414670.000000 / 8.008528 / 262500000.000000 = 0.257567 >Thread-53845::DEBUG::2014-05-16 17:25:00,143::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066288384249861892, 'statsAge': 1.5393340587615967, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25756686248417676, 'rxDropped': 0} >Thread-53845::DEBUG::2014-05-16 17:25:00,144::task::579::TaskManager.Task::(_updateState) Task=`82fa660d-9b3f-42f2-8e35-c9203ae76f1f`::moving from state init -> state preparing >Thread-53845::INFO::2014-05-16 17:25:00,144::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53845::INFO::2014-05-16 17:25:00,144::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000817', 'lastCheck': '9.1', 'valid': True}} >Thread-53845::DEBUG::2014-05-16 17:25:00,144::task::1168::TaskManager.Task::(prepare) Task=`82fa660d-9b3f-42f2-8e35-c9203ae76f1f`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000817', 'lastCheck': '9.1', 'valid': True}} >Thread-53845::DEBUG::2014-05-16 17:25:00,144::task::579::TaskManager.Task::(_updateState) Task=`82fa660d-9b3f-42f2-8e35-c9203ae76f1f`::moving from state preparing -> state finished >Thread-53845::DEBUG::2014-05-16 17:25:00,145::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53845::DEBUG::2014-05-16 17:25:00,145::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53845::DEBUG::2014-05-16 17:25:00,145::task::974::TaskManager.Task::(_decref) Task=`82fa660d-9b3f-42f2-8e35-c9203ae76f1f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:25:00,452::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:00,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352205 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:25:01,077::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:25:01,087::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000814692 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:02,535::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:02,610::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363666 s, 28.2 MB/s\n'; <rc> = 0 >Thread-53847::DEBUG::2014-05-16 17:25:03,134::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53847::DEBUG::2014-05-16 17:25:03,135::task::579::TaskManager.Task::(_updateState) Task=`cf61e129-cbad-48f4-9004-75fab06f8d0d`::moving from state init -> state preparing >Thread-53847::INFO::2014-05-16 17:25:03,135::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53847::INFO::2014-05-16 17:25:03,135::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53847::DEBUG::2014-05-16 17:25:03,136::task::1168::TaskManager.Task::(prepare) Task=`cf61e129-cbad-48f4-9004-75fab06f8d0d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53847::DEBUG::2014-05-16 17:25:03,136::task::579::TaskManager.Task::(_updateState) Task=`cf61e129-cbad-48f4-9004-75fab06f8d0d`::moving from state preparing -> state finished >Thread-53847::DEBUG::2014-05-16 17:25:03,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53847::DEBUG::2014-05-16 17:25:03,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53847::DEBUG::2014-05-16 17:25:03,136::task::974::TaskManager.Task::(_decref) Task=`cf61e129-cbad-48f4-9004-75fab06f8d0d`::ref 0 aborting False >Thread-53848::DEBUG::2014-05-16 17:25:03,145::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53848::DEBUG::2014-05-16 17:25:03,145::task::579::TaskManager.Task::(_updateState) Task=`98cf407b-126e-451a-a2be-f80ca46ed45b`::moving from state init -> state preparing >Thread-53848::INFO::2014-05-16 17:25:03,145::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53848::DEBUG::2014-05-16 17:25:03,146::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`62d23590-eecb-44eb-aee5-361b647352cc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53848::DEBUG::2014-05-16 17:25:03,147::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53848::DEBUG::2014-05-16 17:25:03,147::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53848::DEBUG::2014-05-16 17:25:03,147::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`62d23590-eecb-44eb-aee5-361b647352cc`::Granted request >Thread-53848::DEBUG::2014-05-16 17:25:03,147::task::811::TaskManager.Task::(resourceAcquired) Task=`98cf407b-126e-451a-a2be-f80ca46ed45b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53848::DEBUG::2014-05-16 17:25:03,147::task::974::TaskManager.Task::(_decref) Task=`98cf407b-126e-451a-a2be-f80ca46ed45b`::ref 1 aborting False >Thread-53848::INFO::2014-05-16 17:25:03,148::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53848::DEBUG::2014-05-16 17:25:03,148::task::1168::TaskManager.Task::(prepare) Task=`98cf407b-126e-451a-a2be-f80ca46ed45b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53848::DEBUG::2014-05-16 17:25:03,148::task::579::TaskManager.Task::(_updateState) Task=`98cf407b-126e-451a-a2be-f80ca46ed45b`::moving from state preparing -> state finished >Thread-53848::DEBUG::2014-05-16 17:25:03,149::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53848::DEBUG::2014-05-16 17:25:03,149::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53848::DEBUG::2014-05-16 17:25:03,149::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53848::DEBUG::2014-05-16 17:25:03,149::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53848::DEBUG::2014-05-16 17:25:03,149::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53848::DEBUG::2014-05-16 17:25:03,149::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53848::DEBUG::2014-05-16 17:25:03,150::task::974::TaskManager.Task::(_decref) Task=`98cf407b-126e-451a-a2be-f80ca46ed45b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:25:04,624::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:04,691::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030812 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:06,702::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:06,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348744 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:08,785::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:08,857::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359001 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:10,868::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:10,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311819 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:25:11,123::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:25:11,133::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000800359 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:12,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:13,018::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349208 s, 29.3 MB/s\n'; <rc> = 0 >Thread-53853::DEBUG::2014-05-16 17:25:13,185::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53853::DEBUG::2014-05-16 17:25:13,185::task::579::TaskManager.Task::(_updateState) Task=`8acfd232-768c-46f1-8276-cd57bda9e384`::moving from state init -> state preparing >Thread-53853::INFO::2014-05-16 17:25:13,185::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53853::INFO::2014-05-16 17:25:13,186::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53853::DEBUG::2014-05-16 17:25:13,186::task::1168::TaskManager.Task::(prepare) Task=`8acfd232-768c-46f1-8276-cd57bda9e384`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53853::DEBUG::2014-05-16 17:25:13,186::task::579::TaskManager.Task::(_updateState) Task=`8acfd232-768c-46f1-8276-cd57bda9e384`::moving from state preparing -> state finished >Thread-53853::DEBUG::2014-05-16 17:25:13,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53853::DEBUG::2014-05-16 17:25:13,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53853::DEBUG::2014-05-16 17:25:13,186::task::974::TaskManager.Task::(_decref) Task=`8acfd232-768c-46f1-8276-cd57bda9e384`::ref 0 aborting False >Thread-53854::DEBUG::2014-05-16 17:25:13,205::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53854::DEBUG::2014-05-16 17:25:13,205::task::579::TaskManager.Task::(_updateState) Task=`53578424-889e-4d79-a9e5-d939650d68e8`::moving from state init -> state preparing >Thread-53854::INFO::2014-05-16 17:25:13,205::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53854::DEBUG::2014-05-16 17:25:13,205::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`eb4d18c0-9de3-446b-906b-f7494644cc54`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53854::DEBUG::2014-05-16 17:25:13,206::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53854::DEBUG::2014-05-16 17:25:13,206::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53854::DEBUG::2014-05-16 17:25:13,206::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`eb4d18c0-9de3-446b-906b-f7494644cc54`::Granted request >Thread-53854::DEBUG::2014-05-16 17:25:13,206::task::811::TaskManager.Task::(resourceAcquired) Task=`53578424-889e-4d79-a9e5-d939650d68e8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53854::DEBUG::2014-05-16 17:25:13,206::task::974::TaskManager.Task::(_decref) Task=`53578424-889e-4d79-a9e5-d939650d68e8`::ref 1 aborting False >Thread-53854::INFO::2014-05-16 17:25:13,207::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53854::DEBUG::2014-05-16 17:25:13,207::task::1168::TaskManager.Task::(prepare) Task=`53578424-889e-4d79-a9e5-d939650d68e8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53854::DEBUG::2014-05-16 17:25:13,207::task::579::TaskManager.Task::(_updateState) Task=`53578424-889e-4d79-a9e5-d939650d68e8`::moving from state preparing -> state finished >Thread-53854::DEBUG::2014-05-16 17:25:13,207::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53854::DEBUG::2014-05-16 17:25:13,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53854::DEBUG::2014-05-16 17:25:13,208::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53854::DEBUG::2014-05-16 17:25:13,208::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53854::DEBUG::2014-05-16 17:25:13,208::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53854::DEBUG::2014-05-16 17:25:13,208::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53854::DEBUG::2014-05-16 17:25:13,208::task::974::TaskManager.Task::(_decref) Task=`53578424-889e-4d79-a9e5-d939650d68e8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:25:15,029::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:15,097::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321868 s, 31.8 MB/s\n'; <rc> = 0 >Thread-53855::DEBUG::2014-05-16 17:25:15,285::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316583.000000 / 8.008414 / 262500000.000000 = 0.205336 >Thread-53855::DEBUG::2014-05-16 17:25:15,285::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053746329239026903, 'statsAge': 0.66133999824523926, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20533560892994393, 'rxDropped': 0} >Thread-53855::DEBUG::2014-05-16 17:25:15,286::task::579::TaskManager.Task::(_updateState) Task=`2c3a0e75-4bba-43c9-9089-0f6eedd24656`::moving from state init -> state preparing >Thread-53855::INFO::2014-05-16 17:25:15,286::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53855::INFO::2014-05-16 17:25:15,286::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000800359', 'lastCheck': '4.1', 'valid': True}} >Thread-53855::DEBUG::2014-05-16 17:25:15,287::task::1168::TaskManager.Task::(prepare) Task=`2c3a0e75-4bba-43c9-9089-0f6eedd24656`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000800359', 'lastCheck': '4.1', 'valid': True}} >Thread-53855::DEBUG::2014-05-16 17:25:15,287::task::579::TaskManager.Task::(_updateState) Task=`2c3a0e75-4bba-43c9-9089-0f6eedd24656`::moving from state preparing -> state finished >Thread-53855::DEBUG::2014-05-16 17:25:15,287::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53855::DEBUG::2014-05-16 17:25:15,287::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53855::DEBUG::2014-05-16 17:25:15,287::task::974::TaskManager.Task::(_decref) Task=`2c3a0e75-4bba-43c9-9089-0f6eedd24656`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:25:17,109::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:17,177::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03061 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:19,189::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:19,257::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309094 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:25:21,170::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:25:21,181::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000893754 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:21,269::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:21,339::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034723 s, 29.5 MB/s\n'; <rc> = 0 >Thread-53859::DEBUG::2014-05-16 17:25:23,256::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53859::DEBUG::2014-05-16 17:25:23,256::task::579::TaskManager.Task::(_updateState) Task=`cb5cacc8-24ff-4f0f-81f1-f138f521c406`::moving from state init -> state preparing >Thread-53859::INFO::2014-05-16 17:25:23,257::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53859::INFO::2014-05-16 17:25:23,257::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53859::DEBUG::2014-05-16 17:25:23,257::task::1168::TaskManager.Task::(prepare) Task=`cb5cacc8-24ff-4f0f-81f1-f138f521c406`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53859::DEBUG::2014-05-16 17:25:23,257::task::579::TaskManager.Task::(_updateState) Task=`cb5cacc8-24ff-4f0f-81f1-f138f521c406`::moving from state preparing -> state finished >Thread-53859::DEBUG::2014-05-16 17:25:23,257::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53859::DEBUG::2014-05-16 17:25:23,257::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53859::DEBUG::2014-05-16 17:25:23,258::task::974::TaskManager.Task::(_decref) Task=`cb5cacc8-24ff-4f0f-81f1-f138f521c406`::ref 0 aborting False >Thread-53860::DEBUG::2014-05-16 17:25:23,266::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53860::DEBUG::2014-05-16 17:25:23,267::task::579::TaskManager.Task::(_updateState) Task=`9d9ef807-a74d-47ee-8a00-91ecae054af4`::moving from state init -> state preparing >Thread-53860::INFO::2014-05-16 17:25:23,267::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53860::DEBUG::2014-05-16 17:25:23,267::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f71d8b5c-086b-46c5-98b5-3356d0f5409b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53860::DEBUG::2014-05-16 17:25:23,267::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53860::DEBUG::2014-05-16 17:25:23,268::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53860::DEBUG::2014-05-16 17:25:23,268::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f71d8b5c-086b-46c5-98b5-3356d0f5409b`::Granted request >Thread-53860::DEBUG::2014-05-16 17:25:23,268::task::811::TaskManager.Task::(resourceAcquired) Task=`9d9ef807-a74d-47ee-8a00-91ecae054af4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53860::DEBUG::2014-05-16 17:25:23,268::task::974::TaskManager.Task::(_decref) Task=`9d9ef807-a74d-47ee-8a00-91ecae054af4`::ref 1 aborting False >Thread-53860::INFO::2014-05-16 17:25:23,269::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53860::DEBUG::2014-05-16 17:25:23,269::task::1168::TaskManager.Task::(prepare) Task=`9d9ef807-a74d-47ee-8a00-91ecae054af4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53860::DEBUG::2014-05-16 17:25:23,269::task::579::TaskManager.Task::(_updateState) Task=`9d9ef807-a74d-47ee-8a00-91ecae054af4`::moving from state preparing -> state finished >Thread-53860::DEBUG::2014-05-16 17:25:23,269::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53860::DEBUG::2014-05-16 17:25:23,270::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53860::DEBUG::2014-05-16 17:25:23,270::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53860::DEBUG::2014-05-16 17:25:23,270::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53860::DEBUG::2014-05-16 17:25:23,270::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53860::DEBUG::2014-05-16 17:25:23,270::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53860::DEBUG::2014-05-16 17:25:23,270::task::974::TaskManager.Task::(_decref) Task=`9d9ef807-a74d-47ee-8a00-91ecae054af4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:25:23,351::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:23,423::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358865 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:25,435::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:25,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310266 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:27,513::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:27,596::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0442061 s, 23.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:29,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:29,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312993 s, 32.7 MB/s\n'; <rc> = 0 >Thread-53863::DEBUG::2014-05-16 17:25:30,459::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315866.000000 / 8.008445 / 262500000.000000 = 0.205301 >Thread-53863::DEBUG::2014-05-16 17:25:30,459::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053887876350322932, 'statsAge': 1.8209750652313232, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2053007073837107, 'rxDropped': 0} >Thread-53863::DEBUG::2014-05-16 17:25:30,460::task::579::TaskManager.Task::(_updateState) Task=`d01e319f-a6e7-4120-878e-89055d09dbc4`::moving from state init -> state preparing >Thread-53863::INFO::2014-05-16 17:25:30,460::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53863::INFO::2014-05-16 17:25:30,460::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000893754', 'lastCheck': '9.3', 'valid': True}} >Thread-53863::DEBUG::2014-05-16 17:25:30,461::task::1168::TaskManager.Task::(prepare) Task=`d01e319f-a6e7-4120-878e-89055d09dbc4`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000893754', 'lastCheck': '9.3', 'valid': True}} >Thread-53863::DEBUG::2014-05-16 17:25:30,461::task::579::TaskManager.Task::(_updateState) Task=`d01e319f-a6e7-4120-878e-89055d09dbc4`::moving from state preparing -> state finished >Thread-53863::DEBUG::2014-05-16 17:25:30,461::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53863::DEBUG::2014-05-16 17:25:30,461::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53863::DEBUG::2014-05-16 17:25:30,461::task::974::TaskManager.Task::(_decref) Task=`d01e319f-a6e7-4120-878e-89055d09dbc4`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:25:31,216::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:25:31,226::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111952 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:31,686::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:31,757::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351297 s, 29.1 MB/s\n'; <rc> = 0 >Thread-53865::DEBUG::2014-05-16 17:25:33,318::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53865::DEBUG::2014-05-16 17:25:33,318::task::579::TaskManager.Task::(_updateState) Task=`75877ba2-72fa-4315-a87b-fcd7f68f43df`::moving from state init -> state preparing >Thread-53865::INFO::2014-05-16 17:25:33,319::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53865::INFO::2014-05-16 17:25:33,319::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53865::DEBUG::2014-05-16 17:25:33,319::task::1168::TaskManager.Task::(prepare) Task=`75877ba2-72fa-4315-a87b-fcd7f68f43df`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53865::DEBUG::2014-05-16 17:25:33,319::task::579::TaskManager.Task::(_updateState) Task=`75877ba2-72fa-4315-a87b-fcd7f68f43df`::moving from state preparing -> state finished >Thread-53865::DEBUG::2014-05-16 17:25:33,319::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53865::DEBUG::2014-05-16 17:25:33,320::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53865::DEBUG::2014-05-16 17:25:33,320::task::974::TaskManager.Task::(_decref) Task=`75877ba2-72fa-4315-a87b-fcd7f68f43df`::ref 0 aborting False >Thread-53866::DEBUG::2014-05-16 17:25:33,329::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53866::DEBUG::2014-05-16 17:25:33,329::task::579::TaskManager.Task::(_updateState) Task=`8cb5c546-37b4-4368-9677-cf20ccbb019e`::moving from state init -> state preparing >Thread-53866::INFO::2014-05-16 17:25:33,329::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53866::DEBUG::2014-05-16 17:25:33,329::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f1db6cb8-f678-400f-a747-02d86f8b355e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53866::DEBUG::2014-05-16 17:25:33,330::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53866::DEBUG::2014-05-16 17:25:33,330::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53866::DEBUG::2014-05-16 17:25:33,330::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f1db6cb8-f678-400f-a747-02d86f8b355e`::Granted request >Thread-53866::DEBUG::2014-05-16 17:25:33,330::task::811::TaskManager.Task::(resourceAcquired) Task=`8cb5c546-37b4-4368-9677-cf20ccbb019e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53866::DEBUG::2014-05-16 17:25:33,330::task::974::TaskManager.Task::(_decref) Task=`8cb5c546-37b4-4368-9677-cf20ccbb019e`::ref 1 aborting False >Thread-53866::INFO::2014-05-16 17:25:33,331::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53866::DEBUG::2014-05-16 17:25:33,331::task::1168::TaskManager.Task::(prepare) Task=`8cb5c546-37b4-4368-9677-cf20ccbb019e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53866::DEBUG::2014-05-16 17:25:33,332::task::579::TaskManager.Task::(_updateState) Task=`8cb5c546-37b4-4368-9677-cf20ccbb019e`::moving from state preparing -> state finished >Thread-53866::DEBUG::2014-05-16 17:25:33,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53866::DEBUG::2014-05-16 17:25:33,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53866::DEBUG::2014-05-16 17:25:33,332::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53866::DEBUG::2014-05-16 17:25:33,332::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53866::DEBUG::2014-05-16 17:25:33,332::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53866::DEBUG::2014-05-16 17:25:33,333::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53866::DEBUG::2014-05-16 17:25:33,333::task::974::TaskManager.Task::(_decref) Task=`8cb5c546-37b4-4368-9677-cf20ccbb019e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:25:33,769::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:33,841::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358987 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:35,852::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:35,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303524 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:37,930::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:38,002::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345126 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:40,014::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:40,084::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035514 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:25:41,260::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:25:41,270::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637706 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:42,091::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:42,162::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356617 s, 28.7 MB/s\n'; <rc> = 0 >Thread-53871::DEBUG::2014-05-16 17:25:43,362::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53871::DEBUG::2014-05-16 17:25:43,362::task::579::TaskManager.Task::(_updateState) Task=`962e87f7-2af5-42dd-9bb1-169bbb057f9e`::moving from state init -> state preparing >Thread-53871::INFO::2014-05-16 17:25:43,362::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53871::INFO::2014-05-16 17:25:43,363::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53871::DEBUG::2014-05-16 17:25:43,363::task::1168::TaskManager.Task::(prepare) Task=`962e87f7-2af5-42dd-9bb1-169bbb057f9e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53871::DEBUG::2014-05-16 17:25:43,363::task::579::TaskManager.Task::(_updateState) Task=`962e87f7-2af5-42dd-9bb1-169bbb057f9e`::moving from state preparing -> state finished >Thread-53871::DEBUG::2014-05-16 17:25:43,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53871::DEBUG::2014-05-16 17:25:43,363::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53871::DEBUG::2014-05-16 17:25:43,363::task::974::TaskManager.Task::(_decref) Task=`962e87f7-2af5-42dd-9bb1-169bbb057f9e`::ref 0 aborting False >Thread-53872::DEBUG::2014-05-16 17:25:43,372::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53872::DEBUG::2014-05-16 17:25:43,372::task::579::TaskManager.Task::(_updateState) Task=`18856c56-69f9-4c25-810a-a1f083899060`::moving from state init -> state preparing >Thread-53872::INFO::2014-05-16 17:25:43,372::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53872::DEBUG::2014-05-16 17:25:43,372::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e08609ca-3d68-4d67-a809-1cb112c611f6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53872::DEBUG::2014-05-16 17:25:43,372::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53872::DEBUG::2014-05-16 17:25:43,373::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53872::DEBUG::2014-05-16 17:25:43,373::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e08609ca-3d68-4d67-a809-1cb112c611f6`::Granted request >Thread-53872::DEBUG::2014-05-16 17:25:43,373::task::811::TaskManager.Task::(resourceAcquired) Task=`18856c56-69f9-4c25-810a-a1f083899060`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53872::DEBUG::2014-05-16 17:25:43,373::task::974::TaskManager.Task::(_decref) Task=`18856c56-69f9-4c25-810a-a1f083899060`::ref 1 aborting False >Thread-53872::INFO::2014-05-16 17:25:43,374::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53872::DEBUG::2014-05-16 17:25:43,374::task::1168::TaskManager.Task::(prepare) Task=`18856c56-69f9-4c25-810a-a1f083899060`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53872::DEBUG::2014-05-16 17:25:43,374::task::579::TaskManager.Task::(_updateState) Task=`18856c56-69f9-4c25-810a-a1f083899060`::moving from state preparing -> state finished >Thread-53872::DEBUG::2014-05-16 17:25:43,374::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53872::DEBUG::2014-05-16 17:25:43,374::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53872::DEBUG::2014-05-16 17:25:43,375::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53872::DEBUG::2014-05-16 17:25:43,375::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53872::DEBUG::2014-05-16 17:25:43,375::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53872::DEBUG::2014-05-16 17:25:43,375::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53872::DEBUG::2014-05-16 17:25:43,375::task::974::TaskManager.Task::(_decref) Task=`18856c56-69f9-4c25-810a-a1f083899060`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:25:44,173::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:44,241::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311365 s, 32.9 MB/s\n'; <rc> = 0 >Thread-53873::DEBUG::2014-05-16 17:25:45,631::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5411375.000000 / 8.008416 / 262500000.000000 = 0.257414 >Thread-53873::DEBUG::2014-05-16 17:25:45,631::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066648933462375611, 'statsAge': 0.97574615478515625, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25741372658265849, 'rxDropped': 0} >Thread-53873::DEBUG::2014-05-16 17:25:45,631::task::579::TaskManager.Task::(_updateState) Task=`7526a92c-c3a5-4182-9987-5e12f5bd703e`::moving from state init -> state preparing >Thread-53873::INFO::2014-05-16 17:25:45,632::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53873::INFO::2014-05-16 17:25:45,632::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637706', 'lastCheck': '4.3', 'valid': True}} >Thread-53873::DEBUG::2014-05-16 17:25:45,632::task::1168::TaskManager.Task::(prepare) Task=`7526a92c-c3a5-4182-9987-5e12f5bd703e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637706', 'lastCheck': '4.3', 'valid': True}} >Thread-53873::DEBUG::2014-05-16 17:25:45,632::task::579::TaskManager.Task::(_updateState) Task=`7526a92c-c3a5-4182-9987-5e12f5bd703e`::moving from state preparing -> state finished >Thread-53873::DEBUG::2014-05-16 17:25:45,632::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53873::DEBUG::2014-05-16 17:25:45,633::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53873::DEBUG::2014-05-16 17:25:45,633::task::974::TaskManager.Task::(_decref) Task=`7526a92c-c3a5-4182-9987-5e12f5bd703e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:25:46,252::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:46,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305478 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:48,330::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:48,401::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347693 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:50,412::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:50,479::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310115 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:25:51,308::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:25:51,318::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000804787 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:52,490::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:52,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306982 s, 33.4 MB/s\n'; <rc> = 0 >Thread-53877::DEBUG::2014-05-16 17:25:53,437::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53877::DEBUG::2014-05-16 17:25:53,438::task::579::TaskManager.Task::(_updateState) Task=`4bf544bb-dc8e-4ed1-8d6b-2e86008cd318`::moving from state init -> state preparing >Thread-53877::INFO::2014-05-16 17:25:53,438::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53877::INFO::2014-05-16 17:25:53,439::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53877::DEBUG::2014-05-16 17:25:53,439::task::1168::TaskManager.Task::(prepare) Task=`4bf544bb-dc8e-4ed1-8d6b-2e86008cd318`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53877::DEBUG::2014-05-16 17:25:53,439::task::579::TaskManager.Task::(_updateState) Task=`4bf544bb-dc8e-4ed1-8d6b-2e86008cd318`::moving from state preparing -> state finished >Thread-53877::DEBUG::2014-05-16 17:25:53,439::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53877::DEBUG::2014-05-16 17:25:53,439::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53877::DEBUG::2014-05-16 17:25:53,439::task::974::TaskManager.Task::(_decref) Task=`4bf544bb-dc8e-4ed1-8d6b-2e86008cd318`::ref 0 aborting False >Thread-53878::DEBUG::2014-05-16 17:25:53,448::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53878::DEBUG::2014-05-16 17:25:53,448::task::579::TaskManager.Task::(_updateState) Task=`6bae0a77-2834-4583-9795-899a9990fe46`::moving from state init -> state preparing >Thread-53878::INFO::2014-05-16 17:25:53,449::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53878::DEBUG::2014-05-16 17:25:53,449::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`51302fc0-8bc0-4750-8460-08422429d6e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53878::DEBUG::2014-05-16 17:25:53,449::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53878::DEBUG::2014-05-16 17:25:53,449::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53878::DEBUG::2014-05-16 17:25:53,450::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`51302fc0-8bc0-4750-8460-08422429d6e5`::Granted request >Thread-53878::DEBUG::2014-05-16 17:25:53,451::task::811::TaskManager.Task::(resourceAcquired) Task=`6bae0a77-2834-4583-9795-899a9990fe46`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53878::DEBUG::2014-05-16 17:25:53,451::task::974::TaskManager.Task::(_decref) Task=`6bae0a77-2834-4583-9795-899a9990fe46`::ref 1 aborting False >Thread-53878::INFO::2014-05-16 17:25:53,451::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53878::DEBUG::2014-05-16 17:25:53,452::task::1168::TaskManager.Task::(prepare) Task=`6bae0a77-2834-4583-9795-899a9990fe46`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53878::DEBUG::2014-05-16 17:25:53,452::task::579::TaskManager.Task::(_updateState) Task=`6bae0a77-2834-4583-9795-899a9990fe46`::moving from state preparing -> state finished >Thread-53878::DEBUG::2014-05-16 17:25:53,452::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53878::DEBUG::2014-05-16 17:25:53,452::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53878::DEBUG::2014-05-16 17:25:53,452::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53878::DEBUG::2014-05-16 17:25:53,453::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53878::DEBUG::2014-05-16 17:25:53,453::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53878::DEBUG::2014-05-16 17:25:53,453::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53878::DEBUG::2014-05-16 17:25:53,453::task::974::TaskManager.Task::(_decref) Task=`6bae0a77-2834-4583-9795-899a9990fe46`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:25:54,568::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:54,640::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356045 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:56,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:56,718::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308511 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:25:58,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:25:58,798::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316352 s, 32.4 MB/s\n'; <rc> = 0 >Thread-53881::DEBUG::2014-05-16 17:26:00,797::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5407704.000000 / 8.008375 / 262500000.000000 = 0.257240 >Thread-53881::DEBUG::2014-05-16 17:26:00,797::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065681716223215444, 'statsAge': 0.12498712539672852, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25724041799237168, 'rxDropped': 0} >Thread-53881::DEBUG::2014-05-16 17:26:00,797::task::579::TaskManager.Task::(_updateState) Task=`61b5c731-a55f-4eeb-8ed7-0c54dbdf0195`::moving from state init -> state preparing >Thread-53881::INFO::2014-05-16 17:26:00,798::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53881::INFO::2014-05-16 17:26:00,798::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000804787', 'lastCheck': '9.5', 'valid': True}} >Thread-53881::DEBUG::2014-05-16 17:26:00,798::task::1168::TaskManager.Task::(prepare) Task=`61b5c731-a55f-4eeb-8ed7-0c54dbdf0195`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000804787', 'lastCheck': '9.5', 'valid': True}} >Thread-53881::DEBUG::2014-05-16 17:26:00,798::task::579::TaskManager.Task::(_updateState) Task=`61b5c731-a55f-4eeb-8ed7-0c54dbdf0195`::moving from state preparing -> state finished >Thread-53881::DEBUG::2014-05-16 17:26:00,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53881::DEBUG::2014-05-16 17:26:00,799::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53881::DEBUG::2014-05-16 17:26:00,799::task::974::TaskManager.Task::(_decref) Task=`61b5c731-a55f-4eeb-8ed7-0c54dbdf0195`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:26:00,809::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:00,880::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341092 s, 30.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:26:01,353::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:26:01,363::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000799777 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:02,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:02,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347848 s, 29.4 MB/s\n'; <rc> = 0 >Thread-53883::DEBUG::2014-05-16 17:26:03,483::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53883::DEBUG::2014-05-16 17:26:03,484::task::579::TaskManager.Task::(_updateState) Task=`f12286e9-18ff-416e-8dfd-9ff245298676`::moving from state init -> state preparing >Thread-53883::INFO::2014-05-16 17:26:03,484::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53883::INFO::2014-05-16 17:26:03,484::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53883::DEBUG::2014-05-16 17:26:03,484::task::1168::TaskManager.Task::(prepare) Task=`f12286e9-18ff-416e-8dfd-9ff245298676`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53883::DEBUG::2014-05-16 17:26:03,485::task::579::TaskManager.Task::(_updateState) Task=`f12286e9-18ff-416e-8dfd-9ff245298676`::moving from state preparing -> state finished >Thread-53883::DEBUG::2014-05-16 17:26:03,485::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53883::DEBUG::2014-05-16 17:26:03,485::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53883::DEBUG::2014-05-16 17:26:03,485::task::974::TaskManager.Task::(_decref) Task=`f12286e9-18ff-416e-8dfd-9ff245298676`::ref 0 aborting False >Thread-53884::DEBUG::2014-05-16 17:26:03,495::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53884::DEBUG::2014-05-16 17:26:03,495::task::579::TaskManager.Task::(_updateState) Task=`9f862caf-673d-464c-b4fb-68e452ac4152`::moving from state init -> state preparing >Thread-53884::INFO::2014-05-16 17:26:03,495::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53884::DEBUG::2014-05-16 17:26:03,496::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c4417779-577b-468d-9c4d-9b5405d0424d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53884::DEBUG::2014-05-16 17:26:03,496::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53884::DEBUG::2014-05-16 17:26:03,496::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53884::DEBUG::2014-05-16 17:26:03,496::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c4417779-577b-468d-9c4d-9b5405d0424d`::Granted request >Thread-53884::DEBUG::2014-05-16 17:26:03,497::task::811::TaskManager.Task::(resourceAcquired) Task=`9f862caf-673d-464c-b4fb-68e452ac4152`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53884::DEBUG::2014-05-16 17:26:03,497::task::974::TaskManager.Task::(_decref) Task=`9f862caf-673d-464c-b4fb-68e452ac4152`::ref 1 aborting False >Thread-53884::INFO::2014-05-16 17:26:03,497::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53884::DEBUG::2014-05-16 17:26:03,498::task::1168::TaskManager.Task::(prepare) Task=`9f862caf-673d-464c-b4fb-68e452ac4152`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53884::DEBUG::2014-05-16 17:26:03,498::task::579::TaskManager.Task::(_updateState) Task=`9f862caf-673d-464c-b4fb-68e452ac4152`::moving from state preparing -> state finished >Thread-53884::DEBUG::2014-05-16 17:26:03,498::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53884::DEBUG::2014-05-16 17:26:03,498::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53884::DEBUG::2014-05-16 17:26:03,498::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53884::DEBUG::2014-05-16 17:26:03,499::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53884::DEBUG::2014-05-16 17:26:03,499::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53884::DEBUG::2014-05-16 17:26:03,499::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53884::DEBUG::2014-05-16 17:26:03,499::task::974::TaskManager.Task::(_decref) Task=`9f862caf-673d-464c-b4fb-68e452ac4152`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:26:04,973::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:05,042::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319082 s, 32.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:07,053::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:07,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344393 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:09,128::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:09,199::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353797 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:11,210::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:11,281::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303824 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:26:11,399::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:26:11,410::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000799035 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:13,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:13,360::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030808 s, 33.2 MB/s\n'; <rc> = 0 >Thread-53889::DEBUG::2014-05-16 17:26:13,538::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53889::DEBUG::2014-05-16 17:26:13,539::task::579::TaskManager.Task::(_updateState) Task=`1515794e-b63e-4812-a538-f49251fc2ff4`::moving from state init -> state preparing >Thread-53889::INFO::2014-05-16 17:26:13,539::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53889::INFO::2014-05-16 17:26:13,539::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53889::DEBUG::2014-05-16 17:26:13,540::task::1168::TaskManager.Task::(prepare) Task=`1515794e-b63e-4812-a538-f49251fc2ff4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53889::DEBUG::2014-05-16 17:26:13,540::task::579::TaskManager.Task::(_updateState) Task=`1515794e-b63e-4812-a538-f49251fc2ff4`::moving from state preparing -> state finished >Thread-53889::DEBUG::2014-05-16 17:26:13,540::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53889::DEBUG::2014-05-16 17:26:13,540::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53889::DEBUG::2014-05-16 17:26:13,540::task::974::TaskManager.Task::(_decref) Task=`1515794e-b63e-4812-a538-f49251fc2ff4`::ref 0 aborting False >Thread-53890::DEBUG::2014-05-16 17:26:13,549::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53890::DEBUG::2014-05-16 17:26:13,550::task::579::TaskManager.Task::(_updateState) Task=`c685b7a6-22a6-4bc6-a508-4fb189c28a59`::moving from state init -> state preparing >Thread-53890::INFO::2014-05-16 17:26:13,550::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53890::DEBUG::2014-05-16 17:26:13,550::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`09dd55f4-0e03-4e43-96a2-649aa3fffe74`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53890::DEBUG::2014-05-16 17:26:13,550::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53890::DEBUG::2014-05-16 17:26:13,550::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53890::DEBUG::2014-05-16 17:26:13,551::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`09dd55f4-0e03-4e43-96a2-649aa3fffe74`::Granted request >Thread-53890::DEBUG::2014-05-16 17:26:13,551::task::811::TaskManager.Task::(resourceAcquired) Task=`c685b7a6-22a6-4bc6-a508-4fb189c28a59`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53890::DEBUG::2014-05-16 17:26:13,551::task::974::TaskManager.Task::(_decref) Task=`c685b7a6-22a6-4bc6-a508-4fb189c28a59`::ref 1 aborting False >Thread-53890::INFO::2014-05-16 17:26:13,552::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53890::DEBUG::2014-05-16 17:26:13,552::task::1168::TaskManager.Task::(prepare) Task=`c685b7a6-22a6-4bc6-a508-4fb189c28a59`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53890::DEBUG::2014-05-16 17:26:13,552::task::579::TaskManager.Task::(_updateState) Task=`c685b7a6-22a6-4bc6-a508-4fb189c28a59`::moving from state preparing -> state finished >Thread-53890::DEBUG::2014-05-16 17:26:13,552::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53890::DEBUG::2014-05-16 17:26:13,552::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53890::DEBUG::2014-05-16 17:26:13,553::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53890::DEBUG::2014-05-16 17:26:13,553::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53890::DEBUG::2014-05-16 17:26:13,553::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53890::DEBUG::2014-05-16 17:26:13,553::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53890::DEBUG::2014-05-16 17:26:13,553::task::974::TaskManager.Task::(_decref) Task=`c685b7a6-22a6-4bc6-a508-4fb189c28a59`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:26:15,372::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:15,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359568 s, 28.5 MB/s\n'; <rc> = 0 >Thread-53891::DEBUG::2014-05-16 17:26:15,977::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313109.000000 / 8.008205 / 262500000.000000 = 0.205176 >Thread-53891::DEBUG::2014-05-16 17:26:15,977::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053900908781218055, 'statsAge': 1.2909719944000244, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20517571113465125, 'rxDropped': 0} >Thread-53891::DEBUG::2014-05-16 17:26:15,978::task::579::TaskManager.Task::(_updateState) Task=`b98ae128-254d-4aa2-8243-4e5fee4a3ed1`::moving from state init -> state preparing >Thread-53891::INFO::2014-05-16 17:26:15,978::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53891::INFO::2014-05-16 17:26:15,978::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799035', 'lastCheck': '4.5', 'valid': True}} >Thread-53891::DEBUG::2014-05-16 17:26:15,978::task::1168::TaskManager.Task::(prepare) Task=`b98ae128-254d-4aa2-8243-4e5fee4a3ed1`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799035', 'lastCheck': '4.5', 'valid': True}} >Thread-53891::DEBUG::2014-05-16 17:26:15,979::task::579::TaskManager.Task::(_updateState) Task=`b98ae128-254d-4aa2-8243-4e5fee4a3ed1`::moving from state preparing -> state finished >Thread-53891::DEBUG::2014-05-16 17:26:15,979::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53891::DEBUG::2014-05-16 17:26:15,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53891::DEBUG::2014-05-16 17:26:15,979::task::974::TaskManager.Task::(_decref) Task=`b98ae128-254d-4aa2-8243-4e5fee4a3ed1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:26:17,455::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:17,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306354 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:19,535::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:19,603::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317759 s, 32.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:26:21,429::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 17:26:21,429::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:26:21,447::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:26:21,455::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000620865 s, 3.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:26:21,456::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000620865 s, 3.3 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 17:26:21,456::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 17:26:21,456::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 17:26:21,456::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:26:21,456::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:26:21,457::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:26:21,457::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:26:21,457::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:26:21,457::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:26:21,458::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:26:21,606::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:26:21,608::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:26:21,608::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 17:26:21,609::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 17:26:21,609::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 17:26:21,609::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 17:26:21,610::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:21,619::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:21,692::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035335 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:26:21,755::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:26:21,776::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:26:21,786::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000514684 s, 8.0 MB/s\n'; <rc> = 0 >Thread-53895::DEBUG::2014-05-16 17:26:23,645::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53895::DEBUG::2014-05-16 17:26:23,645::task::579::TaskManager.Task::(_updateState) Task=`8517ce79-08c6-4e10-a16f-ef7b9647f906`::moving from state init -> state preparing >Thread-53895::INFO::2014-05-16 17:26:23,646::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53895::INFO::2014-05-16 17:26:23,646::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53895::DEBUG::2014-05-16 17:26:23,646::task::1168::TaskManager.Task::(prepare) Task=`8517ce79-08c6-4e10-a16f-ef7b9647f906`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53895::DEBUG::2014-05-16 17:26:23,646::task::579::TaskManager.Task::(_updateState) Task=`8517ce79-08c6-4e10-a16f-ef7b9647f906`::moving from state preparing -> state finished >Thread-53895::DEBUG::2014-05-16 17:26:23,646::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53895::DEBUG::2014-05-16 17:26:23,646::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53895::DEBUG::2014-05-16 17:26:23,647::task::974::TaskManager.Task::(_decref) Task=`8517ce79-08c6-4e10-a16f-ef7b9647f906`::ref 0 aborting False >Thread-53896::DEBUG::2014-05-16 17:26:23,656::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53896::DEBUG::2014-05-16 17:26:23,656::task::579::TaskManager.Task::(_updateState) Task=`2b8abdf2-cf82-419e-9115-9a8ab4457952`::moving from state init -> state preparing >Thread-53896::INFO::2014-05-16 17:26:23,656::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53896::DEBUG::2014-05-16 17:26:23,656::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e3f9e964-f8b5-498b-a4ce-48b45e9ef166`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53896::DEBUG::2014-05-16 17:26:23,657::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53896::DEBUG::2014-05-16 17:26:23,657::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53896::DEBUG::2014-05-16 17:26:23,657::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e3f9e964-f8b5-498b-a4ce-48b45e9ef166`::Granted request >Thread-53896::DEBUG::2014-05-16 17:26:23,657::task::811::TaskManager.Task::(resourceAcquired) Task=`2b8abdf2-cf82-419e-9115-9a8ab4457952`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53896::DEBUG::2014-05-16 17:26:23,657::task::974::TaskManager.Task::(_decref) Task=`2b8abdf2-cf82-419e-9115-9a8ab4457952`::ref 1 aborting False >Thread-53896::INFO::2014-05-16 17:26:23,658::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53896::DEBUG::2014-05-16 17:26:23,658::task::1168::TaskManager.Task::(prepare) Task=`2b8abdf2-cf82-419e-9115-9a8ab4457952`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53896::DEBUG::2014-05-16 17:26:23,658::task::579::TaskManager.Task::(_updateState) Task=`2b8abdf2-cf82-419e-9115-9a8ab4457952`::moving from state preparing -> state finished >Thread-53896::DEBUG::2014-05-16 17:26:23,659::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53896::DEBUG::2014-05-16 17:26:23,659::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53896::DEBUG::2014-05-16 17:26:23,659::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53896::DEBUG::2014-05-16 17:26:23,659::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53896::DEBUG::2014-05-16 17:26:23,659::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53896::DEBUG::2014-05-16 17:26:23,659::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53896::DEBUG::2014-05-16 17:26:23,660::task::974::TaskManager.Task::(_decref) Task=`2b8abdf2-cf82-419e-9115-9a8ab4457952`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:26:23,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:23,776::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350089 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:25,787::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:25,854::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305857 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:27,865::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:27,936::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350132 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:29,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:30,015::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315547 s, 32.5 MB/s\n'; <rc> = 0 >Thread-53899::DEBUG::2014-05-16 17:26:31,162::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3240511.000000 / 8.008268 / 262500000.000000 = 0.154151 >Thread-53899::DEBUG::2014-05-16 17:26:31,163::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041894796348619957, 'statsAge': 0.45986485481262207, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15415073056712025, 'rxDropped': 0} >Thread-53899::DEBUG::2014-05-16 17:26:31,163::task::579::TaskManager.Task::(_updateState) Task=`3401398e-3a8a-4ef3-bb7b-30b2623f15a8`::moving from state init -> state preparing >Thread-53899::INFO::2014-05-16 17:26:31,163::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53899::INFO::2014-05-16 17:26:31,164::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514684', 'lastCheck': '9.4', 'valid': True}} >Thread-53899::DEBUG::2014-05-16 17:26:31,164::task::1168::TaskManager.Task::(prepare) Task=`3401398e-3a8a-4ef3-bb7b-30b2623f15a8`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514684', 'lastCheck': '9.4', 'valid': True}} >Thread-53899::DEBUG::2014-05-16 17:26:31,164::task::579::TaskManager.Task::(_updateState) Task=`3401398e-3a8a-4ef3-bb7b-30b2623f15a8`::moving from state preparing -> state finished >Thread-53899::DEBUG::2014-05-16 17:26:31,164::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53899::DEBUG::2014-05-16 17:26:31,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53899::DEBUG::2014-05-16 17:26:31,164::task::974::TaskManager.Task::(_decref) Task=`3401398e-3a8a-4ef3-bb7b-30b2623f15a8`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:26:31,819::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:26:31,830::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103268 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:32,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:32,098::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353894 s, 28.9 MB/s\n'; <rc> = 0 >Thread-53901::DEBUG::2014-05-16 17:26:33,752::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53901::DEBUG::2014-05-16 17:26:33,753::task::579::TaskManager.Task::(_updateState) Task=`8030dda7-b2ee-4afd-bc8a-abd65b5b58f6`::moving from state init -> state preparing >Thread-53901::INFO::2014-05-16 17:26:33,753::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53901::INFO::2014-05-16 17:26:33,753::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53901::DEBUG::2014-05-16 17:26:33,753::task::1168::TaskManager.Task::(prepare) Task=`8030dda7-b2ee-4afd-bc8a-abd65b5b58f6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53901::DEBUG::2014-05-16 17:26:33,753::task::579::TaskManager.Task::(_updateState) Task=`8030dda7-b2ee-4afd-bc8a-abd65b5b58f6`::moving from state preparing -> state finished >Thread-53901::DEBUG::2014-05-16 17:26:33,754::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53901::DEBUG::2014-05-16 17:26:33,754::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53901::DEBUG::2014-05-16 17:26:33,754::task::974::TaskManager.Task::(_decref) Task=`8030dda7-b2ee-4afd-bc8a-abd65b5b58f6`::ref 0 aborting False >Thread-53902::DEBUG::2014-05-16 17:26:33,773::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53902::DEBUG::2014-05-16 17:26:33,773::task::579::TaskManager.Task::(_updateState) Task=`fbe32d89-8da3-40ee-a33e-51bcc72c73bc`::moving from state init -> state preparing >Thread-53902::INFO::2014-05-16 17:26:33,773::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53902::DEBUG::2014-05-16 17:26:33,773::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`56ae1533-bcda-4d63-9a34-a56504ca865d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53902::DEBUG::2014-05-16 17:26:33,774::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53902::DEBUG::2014-05-16 17:26:33,774::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53902::DEBUG::2014-05-16 17:26:33,774::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`56ae1533-bcda-4d63-9a34-a56504ca865d`::Granted request >Thread-53902::DEBUG::2014-05-16 17:26:33,774::task::811::TaskManager.Task::(resourceAcquired) Task=`fbe32d89-8da3-40ee-a33e-51bcc72c73bc`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53902::DEBUG::2014-05-16 17:26:33,774::task::974::TaskManager.Task::(_decref) Task=`fbe32d89-8da3-40ee-a33e-51bcc72c73bc`::ref 1 aborting False >Thread-53902::INFO::2014-05-16 17:26:33,775::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53902::DEBUG::2014-05-16 17:26:33,775::task::1168::TaskManager.Task::(prepare) Task=`fbe32d89-8da3-40ee-a33e-51bcc72c73bc`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53902::DEBUG::2014-05-16 17:26:33,775::task::579::TaskManager.Task::(_updateState) Task=`fbe32d89-8da3-40ee-a33e-51bcc72c73bc`::moving from state preparing -> state finished >Thread-53902::DEBUG::2014-05-16 17:26:33,776::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53902::DEBUG::2014-05-16 17:26:33,776::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53902::DEBUG::2014-05-16 17:26:33,776::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53902::DEBUG::2014-05-16 17:26:33,776::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53902::DEBUG::2014-05-16 17:26:33,776::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53902::DEBUG::2014-05-16 17:26:33,776::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53902::DEBUG::2014-05-16 17:26:33,777::task::974::TaskManager.Task::(_decref) Task=`fbe32d89-8da3-40ee-a33e-51bcc72c73bc`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:26:34,109::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:34,177::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032178 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:36,189::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:36,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347034 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:38,271::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:38,343::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354476 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:40,355::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:40,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303546 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:26:41,867::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:26:41,877::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000995932 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:42,433::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:42,503::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349259 s, 29.3 MB/s\n'; <rc> = 0 >Thread-53907::DEBUG::2014-05-16 17:26:43,806::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53907::DEBUG::2014-05-16 17:26:43,807::task::579::TaskManager.Task::(_updateState) Task=`c9e50b7a-3685-42e2-8c4a-971eb562913c`::moving from state init -> state preparing >Thread-53907::INFO::2014-05-16 17:26:43,807::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53907::INFO::2014-05-16 17:26:43,807::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53907::DEBUG::2014-05-16 17:26:43,808::task::1168::TaskManager.Task::(prepare) Task=`c9e50b7a-3685-42e2-8c4a-971eb562913c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53907::DEBUG::2014-05-16 17:26:43,808::task::579::TaskManager.Task::(_updateState) Task=`c9e50b7a-3685-42e2-8c4a-971eb562913c`::moving from state preparing -> state finished >Thread-53907::DEBUG::2014-05-16 17:26:43,808::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53907::DEBUG::2014-05-16 17:26:43,808::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53907::DEBUG::2014-05-16 17:26:43,808::task::974::TaskManager.Task::(_decref) Task=`c9e50b7a-3685-42e2-8c4a-971eb562913c`::ref 0 aborting False >Thread-53908::DEBUG::2014-05-16 17:26:43,816::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53908::DEBUG::2014-05-16 17:26:43,817::task::579::TaskManager.Task::(_updateState) Task=`ec0b8317-ba8f-4d52-a044-c756ec0e23a5`::moving from state init -> state preparing >Thread-53908::INFO::2014-05-16 17:26:43,817::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53908::DEBUG::2014-05-16 17:26:43,817::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`997bb1ce-aa4f-4a81-a948-53e15efd5b83`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53908::DEBUG::2014-05-16 17:26:43,817::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53908::DEBUG::2014-05-16 17:26:43,817::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53908::DEBUG::2014-05-16 17:26:43,818::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`997bb1ce-aa4f-4a81-a948-53e15efd5b83`::Granted request >Thread-53908::DEBUG::2014-05-16 17:26:43,818::task::811::TaskManager.Task::(resourceAcquired) Task=`ec0b8317-ba8f-4d52-a044-c756ec0e23a5`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53908::DEBUG::2014-05-16 17:26:43,818::task::974::TaskManager.Task::(_decref) Task=`ec0b8317-ba8f-4d52-a044-c756ec0e23a5`::ref 1 aborting False >Thread-53908::INFO::2014-05-16 17:26:43,819::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53908::DEBUG::2014-05-16 17:26:43,819::task::1168::TaskManager.Task::(prepare) Task=`ec0b8317-ba8f-4d52-a044-c756ec0e23a5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53908::DEBUG::2014-05-16 17:26:43,819::task::579::TaskManager.Task::(_updateState) Task=`ec0b8317-ba8f-4d52-a044-c756ec0e23a5`::moving from state preparing -> state finished >Thread-53908::DEBUG::2014-05-16 17:26:43,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53908::DEBUG::2014-05-16 17:26:43,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53908::DEBUG::2014-05-16 17:26:43,819::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53908::DEBUG::2014-05-16 17:26:43,819::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53908::DEBUG::2014-05-16 17:26:43,820::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53908::DEBUG::2014-05-16 17:26:43,820::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53908::DEBUG::2014-05-16 17:26:43,820::task::974::TaskManager.Task::(_decref) Task=`ec0b8317-ba8f-4d52-a044-c756ec0e23a5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:26:44,515::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:44,582::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312321 s, 32.8 MB/s\n'; <rc> = 0 >Thread-53909::DEBUG::2014-05-16 17:26:46,301::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5410883.000000 / 8.008545 / 262500000.000000 = 0.257386 >Thread-53909::DEBUG::2014-05-16 17:26:46,301::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066392892285442838, 'statsAge': 1.5834188461303711, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25738616947865206, 'rxDropped': 0} >Thread-53909::DEBUG::2014-05-16 17:26:46,302::task::579::TaskManager.Task::(_updateState) Task=`ac3f4752-50b3-4dc1-be98-fbe0ab45a69f`::moving from state init -> state preparing >Thread-53909::INFO::2014-05-16 17:26:46,302::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53909::INFO::2014-05-16 17:26:46,302::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000995932', 'lastCheck': '4.4', 'valid': True}} >Thread-53909::DEBUG::2014-05-16 17:26:46,302::task::1168::TaskManager.Task::(prepare) Task=`ac3f4752-50b3-4dc1-be98-fbe0ab45a69f`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000995932', 'lastCheck': '4.4', 'valid': True}} >Thread-53909::DEBUG::2014-05-16 17:26:46,302::task::579::TaskManager.Task::(_updateState) Task=`ac3f4752-50b3-4dc1-be98-fbe0ab45a69f`::moving from state preparing -> state finished >Thread-53909::DEBUG::2014-05-16 17:26:46,302::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53909::DEBUG::2014-05-16 17:26:46,302::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53909::DEBUG::2014-05-16 17:26:46,303::task::974::TaskManager.Task::(_decref) Task=`ac3f4752-50b3-4dc1-be98-fbe0ab45a69f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:26:46,594::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:46,660::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304863 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:48,672::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:48,749::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035222 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:50,760::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:50,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302237 s, 33.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:26:51,915::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:26:51,925::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000783848 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:52,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:52,915::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358352 s, 28.6 MB/s\n'; <rc> = 0 >Thread-53913::DEBUG::2014-05-16 17:26:53,854::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53913::DEBUG::2014-05-16 17:26:53,854::task::579::TaskManager.Task::(_updateState) Task=`c3709f4b-6461-4169-a898-a1edd1cf86f2`::moving from state init -> state preparing >Thread-53913::INFO::2014-05-16 17:26:53,854::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53913::INFO::2014-05-16 17:26:53,855::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53913::DEBUG::2014-05-16 17:26:53,855::task::1168::TaskManager.Task::(prepare) Task=`c3709f4b-6461-4169-a898-a1edd1cf86f2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53913::DEBUG::2014-05-16 17:26:53,855::task::579::TaskManager.Task::(_updateState) Task=`c3709f4b-6461-4169-a898-a1edd1cf86f2`::moving from state preparing -> state finished >Thread-53913::DEBUG::2014-05-16 17:26:53,855::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53913::DEBUG::2014-05-16 17:26:53,855::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53913::DEBUG::2014-05-16 17:26:53,855::task::974::TaskManager.Task::(_decref) Task=`c3709f4b-6461-4169-a898-a1edd1cf86f2`::ref 0 aborting False >Thread-53914::DEBUG::2014-05-16 17:26:53,863::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53914::DEBUG::2014-05-16 17:26:53,864::task::579::TaskManager.Task::(_updateState) Task=`3b6214bc-7a32-4cf1-b414-491eba3123ca`::moving from state init -> state preparing >Thread-53914::INFO::2014-05-16 17:26:53,864::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53914::DEBUG::2014-05-16 17:26:53,864::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2411f1cd-db71-4489-abea-e8d8661b98df`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53914::DEBUG::2014-05-16 17:26:53,864::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53914::DEBUG::2014-05-16 17:26:53,865::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53914::DEBUG::2014-05-16 17:26:53,865::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2411f1cd-db71-4489-abea-e8d8661b98df`::Granted request >Thread-53914::DEBUG::2014-05-16 17:26:53,865::task::811::TaskManager.Task::(resourceAcquired) Task=`3b6214bc-7a32-4cf1-b414-491eba3123ca`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53914::DEBUG::2014-05-16 17:26:53,865::task::974::TaskManager.Task::(_decref) Task=`3b6214bc-7a32-4cf1-b414-491eba3123ca`::ref 1 aborting False >Thread-53914::INFO::2014-05-16 17:26:53,866::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53914::DEBUG::2014-05-16 17:26:53,866::task::1168::TaskManager.Task::(prepare) Task=`3b6214bc-7a32-4cf1-b414-491eba3123ca`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53914::DEBUG::2014-05-16 17:26:53,866::task::579::TaskManager.Task::(_updateState) Task=`3b6214bc-7a32-4cf1-b414-491eba3123ca`::moving from state preparing -> state finished >Thread-53914::DEBUG::2014-05-16 17:26:53,867::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53914::DEBUG::2014-05-16 17:26:53,867::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53914::DEBUG::2014-05-16 17:26:53,867::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53914::DEBUG::2014-05-16 17:26:53,867::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53914::DEBUG::2014-05-16 17:26:53,867::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53914::DEBUG::2014-05-16 17:26:53,867::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53914::DEBUG::2014-05-16 17:26:53,868::task::974::TaskManager.Task::(_decref) Task=`3b6214bc-7a32-4cf1-b414-491eba3123ca`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:26:54,927::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:54,997::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351845 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:57,009::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:57,076::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030715 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:26:59,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:26:59,155::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031275 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:01,167::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:01,232::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296271 s, 34.6 MB/s\n'; <rc> = 0 >Thread-53917::DEBUG::2014-05-16 17:27:01,444::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4311837.000000 / 8.008121 / 262500000.000000 = 0.205117 >Thread-53917::DEBUG::2014-05-16 17:27:01,444::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053685504011150489, 'statsAge': 0.7069551944732666, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20511735743431964, 'rxDropped': 0} >Thread-53917::DEBUG::2014-05-16 17:27:01,444::task::579::TaskManager.Task::(_updateState) Task=`a3cc0eeb-7aaf-4dc8-a9a6-53eac35a1d80`::moving from state init -> state preparing >Thread-53917::INFO::2014-05-16 17:27:01,444::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53917::INFO::2014-05-16 17:27:01,445::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000783848', 'lastCheck': '9.5', 'valid': True}} >Thread-53917::DEBUG::2014-05-16 17:27:01,445::task::1168::TaskManager.Task::(prepare) Task=`a3cc0eeb-7aaf-4dc8-a9a6-53eac35a1d80`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000783848', 'lastCheck': '9.5', 'valid': True}} >Thread-53917::DEBUG::2014-05-16 17:27:01,445::task::579::TaskManager.Task::(_updateState) Task=`a3cc0eeb-7aaf-4dc8-a9a6-53eac35a1d80`::moving from state preparing -> state finished >Thread-53917::DEBUG::2014-05-16 17:27:01,445::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53917::DEBUG::2014-05-16 17:27:01,445::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53917::DEBUG::2014-05-16 17:27:01,446::task::974::TaskManager.Task::(_decref) Task=`a3cc0eeb-7aaf-4dc8-a9a6-53eac35a1d80`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:27:01,962::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:27:01,973::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000711085 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:03,245::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:03,315::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348827 s, 29.4 MB/s\n'; <rc> = 0 >Thread-53919::DEBUG::2014-05-16 17:27:03,893::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53919::DEBUG::2014-05-16 17:27:03,894::task::579::TaskManager.Task::(_updateState) Task=`788e431c-c7a8-4934-941c-10d57dfe8930`::moving from state init -> state preparing >Thread-53919::INFO::2014-05-16 17:27:03,894::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53919::INFO::2014-05-16 17:27:03,894::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53919::DEBUG::2014-05-16 17:27:03,894::task::1168::TaskManager.Task::(prepare) Task=`788e431c-c7a8-4934-941c-10d57dfe8930`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53919::DEBUG::2014-05-16 17:27:03,895::task::579::TaskManager.Task::(_updateState) Task=`788e431c-c7a8-4934-941c-10d57dfe8930`::moving from state preparing -> state finished >Thread-53919::DEBUG::2014-05-16 17:27:03,895::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53919::DEBUG::2014-05-16 17:27:03,895::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53919::DEBUG::2014-05-16 17:27:03,895::task::974::TaskManager.Task::(_decref) Task=`788e431c-c7a8-4934-941c-10d57dfe8930`::ref 0 aborting False >Thread-53920::DEBUG::2014-05-16 17:27:03,903::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53920::DEBUG::2014-05-16 17:27:03,903::task::579::TaskManager.Task::(_updateState) Task=`9faaa1f7-60af-4bb9-b94b-4fd20739ab63`::moving from state init -> state preparing >Thread-53920::INFO::2014-05-16 17:27:03,903::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53920::DEBUG::2014-05-16 17:27:03,904::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c3d43eab-4a15-4cec-88d4-329c3d14ca00`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53920::DEBUG::2014-05-16 17:27:03,904::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53920::DEBUG::2014-05-16 17:27:03,904::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53920::DEBUG::2014-05-16 17:27:03,904::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c3d43eab-4a15-4cec-88d4-329c3d14ca00`::Granted request >Thread-53920::DEBUG::2014-05-16 17:27:03,905::task::811::TaskManager.Task::(resourceAcquired) Task=`9faaa1f7-60af-4bb9-b94b-4fd20739ab63`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53920::DEBUG::2014-05-16 17:27:03,905::task::974::TaskManager.Task::(_decref) Task=`9faaa1f7-60af-4bb9-b94b-4fd20739ab63`::ref 1 aborting False >Thread-53920::INFO::2014-05-16 17:27:03,906::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53920::DEBUG::2014-05-16 17:27:03,906::task::1168::TaskManager.Task::(prepare) Task=`9faaa1f7-60af-4bb9-b94b-4fd20739ab63`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53920::DEBUG::2014-05-16 17:27:03,906::task::579::TaskManager.Task::(_updateState) Task=`9faaa1f7-60af-4bb9-b94b-4fd20739ab63`::moving from state preparing -> state finished >Thread-53920::DEBUG::2014-05-16 17:27:03,906::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53920::DEBUG::2014-05-16 17:27:03,906::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53920::DEBUG::2014-05-16 17:27:03,906::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53920::DEBUG::2014-05-16 17:27:03,907::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53920::DEBUG::2014-05-16 17:27:03,907::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53920::DEBUG::2014-05-16 17:27:03,907::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53920::DEBUG::2014-05-16 17:27:03,907::task::974::TaskManager.Task::(_decref) Task=`9faaa1f7-60af-4bb9-b94b-4fd20739ab63`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:27:05,327::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:05,395::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318477 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:07,407::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:07,475::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306392 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:09,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:09,559::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361073 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:11,571::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:11,638::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305183 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:27:12,010::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:27:12,021::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000757348 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:13,650::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:13,720::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336604 s, 30.4 MB/s\n'; <rc> = 0 >Thread-53925::DEBUG::2014-05-16 17:27:13,949::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53925::DEBUG::2014-05-16 17:27:13,949::task::579::TaskManager.Task::(_updateState) Task=`1f801d47-8e92-4aa9-a14b-6cf66dfe90a6`::moving from state init -> state preparing >Thread-53925::INFO::2014-05-16 17:27:13,950::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53925::INFO::2014-05-16 17:27:13,950::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53925::DEBUG::2014-05-16 17:27:13,950::task::1168::TaskManager.Task::(prepare) Task=`1f801d47-8e92-4aa9-a14b-6cf66dfe90a6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53925::DEBUG::2014-05-16 17:27:13,950::task::579::TaskManager.Task::(_updateState) Task=`1f801d47-8e92-4aa9-a14b-6cf66dfe90a6`::moving from state preparing -> state finished >Thread-53925::DEBUG::2014-05-16 17:27:13,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53925::DEBUG::2014-05-16 17:27:13,951::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53925::DEBUG::2014-05-16 17:27:13,951::task::974::TaskManager.Task::(_decref) Task=`1f801d47-8e92-4aa9-a14b-6cf66dfe90a6`::ref 0 aborting False >Thread-53926::DEBUG::2014-05-16 17:27:13,968::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53926::DEBUG::2014-05-16 17:27:13,968::task::579::TaskManager.Task::(_updateState) Task=`13bbb89e-7e64-4e05-8919-c2463e35d09d`::moving from state init -> state preparing >Thread-53926::INFO::2014-05-16 17:27:13,968::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53926::DEBUG::2014-05-16 17:27:13,969::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ca2aa10a-042d-41c7-937e-f95077ad7d39`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53926::DEBUG::2014-05-16 17:27:13,969::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53926::DEBUG::2014-05-16 17:27:13,969::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53926::DEBUG::2014-05-16 17:27:13,969::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ca2aa10a-042d-41c7-937e-f95077ad7d39`::Granted request >Thread-53926::DEBUG::2014-05-16 17:27:13,970::task::811::TaskManager.Task::(resourceAcquired) Task=`13bbb89e-7e64-4e05-8919-c2463e35d09d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53926::DEBUG::2014-05-16 17:27:13,970::task::974::TaskManager.Task::(_decref) Task=`13bbb89e-7e64-4e05-8919-c2463e35d09d`::ref 1 aborting False >Thread-53926::INFO::2014-05-16 17:27:13,970::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53926::DEBUG::2014-05-16 17:27:13,971::task::1168::TaskManager.Task::(prepare) Task=`13bbb89e-7e64-4e05-8919-c2463e35d09d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53926::DEBUG::2014-05-16 17:27:13,971::task::579::TaskManager.Task::(_updateState) Task=`13bbb89e-7e64-4e05-8919-c2463e35d09d`::moving from state preparing -> state finished >Thread-53926::DEBUG::2014-05-16 17:27:13,971::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53926::DEBUG::2014-05-16 17:27:13,971::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53926::DEBUG::2014-05-16 17:27:13,971::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53926::DEBUG::2014-05-16 17:27:13,972::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53926::DEBUG::2014-05-16 17:27:13,972::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53926::DEBUG::2014-05-16 17:27:13,972::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53926::DEBUG::2014-05-16 17:27:13,972::task::974::TaskManager.Task::(_decref) Task=`13bbb89e-7e64-4e05-8919-c2463e35d09d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:27:15,732::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:15,803::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353494 s, 29.0 MB/s\n'; <rc> = 0 >Thread-53927::DEBUG::2014-05-16 17:27:16,695::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316179.000000 / 8.008272 / 262500000.000000 = 0.205320 >Thread-53927::DEBUG::2014-05-16 17:27:16,695::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005116233667015151, 'statsAge': 1.9440741539001465, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20532003414779629, 'rxDropped': 0} >Thread-53927::DEBUG::2014-05-16 17:27:16,696::task::579::TaskManager.Task::(_updateState) Task=`842fd91a-2abc-4355-b6e6-969a7a050955`::moving from state init -> state preparing >Thread-53927::INFO::2014-05-16 17:27:16,696::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53927::INFO::2014-05-16 17:27:16,697::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757348', 'lastCheck': '4.7', 'valid': True}} >Thread-53927::DEBUG::2014-05-16 17:27:16,697::task::1168::TaskManager.Task::(prepare) Task=`842fd91a-2abc-4355-b6e6-969a7a050955`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757348', 'lastCheck': '4.7', 'valid': True}} >Thread-53927::DEBUG::2014-05-16 17:27:16,697::task::579::TaskManager.Task::(_updateState) Task=`842fd91a-2abc-4355-b6e6-969a7a050955`::moving from state preparing -> state finished >Thread-53927::DEBUG::2014-05-16 17:27:16,697::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53927::DEBUG::2014-05-16 17:27:16,697::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53927::DEBUG::2014-05-16 17:27:16,697::task::974::TaskManager.Task::(_decref) Task=`842fd91a-2abc-4355-b6e6-969a7a050955`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:27:17,815::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:17,881::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304837 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:19,893::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:19,960::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312125 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:21,972::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:22,093::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339999 s, 30.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:27:22,189::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:27:22,200::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000786422 s, 5.2 MB/s\n'; <rc> = 0 >Thread-53931::DEBUG::2014-05-16 17:27:24,009::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53931::DEBUG::2014-05-16 17:27:24,009::task::579::TaskManager.Task::(_updateState) Task=`9266d4d8-4167-4118-9043-725e8a3ebf91`::moving from state init -> state preparing >Thread-53931::INFO::2014-05-16 17:27:24,010::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53931::INFO::2014-05-16 17:27:24,010::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53931::DEBUG::2014-05-16 17:27:24,010::task::1168::TaskManager.Task::(prepare) Task=`9266d4d8-4167-4118-9043-725e8a3ebf91`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53931::DEBUG::2014-05-16 17:27:24,010::task::579::TaskManager.Task::(_updateState) Task=`9266d4d8-4167-4118-9043-725e8a3ebf91`::moving from state preparing -> state finished >Thread-53931::DEBUG::2014-05-16 17:27:24,010::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53931::DEBUG::2014-05-16 17:27:24,010::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53931::DEBUG::2014-05-16 17:27:24,011::task::974::TaskManager.Task::(_decref) Task=`9266d4d8-4167-4118-9043-725e8a3ebf91`::ref 0 aborting False >Thread-53932::DEBUG::2014-05-16 17:27:24,019::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53932::DEBUG::2014-05-16 17:27:24,019::task::579::TaskManager.Task::(_updateState) Task=`bfe693da-d702-4fae-84de-be8ee2d29506`::moving from state init -> state preparing >Thread-53932::INFO::2014-05-16 17:27:24,019::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53932::DEBUG::2014-05-16 17:27:24,020::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`88828aca-7762-4ce4-9646-c11feb0f1edc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53932::DEBUG::2014-05-16 17:27:24,020::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53932::DEBUG::2014-05-16 17:27:24,020::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53932::DEBUG::2014-05-16 17:27:24,020::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`88828aca-7762-4ce4-9646-c11feb0f1edc`::Granted request >Thread-53932::DEBUG::2014-05-16 17:27:24,021::task::811::TaskManager.Task::(resourceAcquired) Task=`bfe693da-d702-4fae-84de-be8ee2d29506`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53932::DEBUG::2014-05-16 17:27:24,021::task::974::TaskManager.Task::(_decref) Task=`bfe693da-d702-4fae-84de-be8ee2d29506`::ref 1 aborting False >Thread-53932::INFO::2014-05-16 17:27:24,022::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53932::DEBUG::2014-05-16 17:27:24,022::task::1168::TaskManager.Task::(prepare) Task=`bfe693da-d702-4fae-84de-be8ee2d29506`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53932::DEBUG::2014-05-16 17:27:24,022::task::579::TaskManager.Task::(_updateState) Task=`bfe693da-d702-4fae-84de-be8ee2d29506`::moving from state preparing -> state finished >Thread-53932::DEBUG::2014-05-16 17:27:24,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53932::DEBUG::2014-05-16 17:27:24,022::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53932::DEBUG::2014-05-16 17:27:24,022::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53932::DEBUG::2014-05-16 17:27:24,023::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53932::DEBUG::2014-05-16 17:27:24,023::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53932::DEBUG::2014-05-16 17:27:24,023::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53932::DEBUG::2014-05-16 17:27:24,023::task::974::TaskManager.Task::(_decref) Task=`bfe693da-d702-4fae-84de-be8ee2d29506`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:27:24,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:24,263::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356692 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:26,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:26,342::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315847 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:28,354::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:28,420::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308101 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:30,432::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:30,555::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0861816 s, 11.9 MB/s\n'; <rc> = 0 >Thread-53935::DEBUG::2014-05-16 17:27:32,109::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5388440.000000 / 8.008494 / 262500000.000000 = 0.256320 >Thread-53935::DEBUG::2014-05-16 17:27:32,109::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066030842988453959, 'statsAge': 1.3414628505706787, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25632022850524799, 'rxDropped': 0} >Thread-53935::DEBUG::2014-05-16 17:27:32,110::task::579::TaskManager.Task::(_updateState) Task=`2e905812-adf4-4012-b656-810c76ac46fb`::moving from state init -> state preparing >Thread-53935::INFO::2014-05-16 17:27:32,110::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53935::INFO::2014-05-16 17:27:32,111::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000786422', 'lastCheck': '9.9', 'valid': True}} >Thread-53935::DEBUG::2014-05-16 17:27:32,111::task::1168::TaskManager.Task::(prepare) Task=`2e905812-adf4-4012-b656-810c76ac46fb`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000786422', 'lastCheck': '9.9', 'valid': True}} >Thread-53935::DEBUG::2014-05-16 17:27:32,111::task::579::TaskManager.Task::(_updateState) Task=`2e905812-adf4-4012-b656-810c76ac46fb`::moving from state preparing -> state finished >Thread-53935::DEBUG::2014-05-16 17:27:32,111::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53935::DEBUG::2014-05-16 17:27:32,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53935::DEBUG::2014-05-16 17:27:32,111::task::974::TaskManager.Task::(_decref) Task=`2e905812-adf4-4012-b656-810c76ac46fb`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:27:32,232::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:27:32,242::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107398 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:32,567::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:32,637::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344662 s, 29.7 MB/s\n'; <rc> = 0 >Thread-53937::DEBUG::2014-05-16 17:27:34,064::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53937::DEBUG::2014-05-16 17:27:34,064::task::579::TaskManager.Task::(_updateState) Task=`6dd5e3a3-cffc-47e2-874d-6c72c8ea4497`::moving from state init -> state preparing >Thread-53937::INFO::2014-05-16 17:27:34,064::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53937::INFO::2014-05-16 17:27:34,065::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53937::DEBUG::2014-05-16 17:27:34,065::task::1168::TaskManager.Task::(prepare) Task=`6dd5e3a3-cffc-47e2-874d-6c72c8ea4497`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53937::DEBUG::2014-05-16 17:27:34,065::task::579::TaskManager.Task::(_updateState) Task=`6dd5e3a3-cffc-47e2-874d-6c72c8ea4497`::moving from state preparing -> state finished >Thread-53937::DEBUG::2014-05-16 17:27:34,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53937::DEBUG::2014-05-16 17:27:34,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53937::DEBUG::2014-05-16 17:27:34,066::task::974::TaskManager.Task::(_decref) Task=`6dd5e3a3-cffc-47e2-874d-6c72c8ea4497`::ref 0 aborting False >Thread-53938::DEBUG::2014-05-16 17:27:34,075::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53938::DEBUG::2014-05-16 17:27:34,076::task::579::TaskManager.Task::(_updateState) Task=`980662e1-eff0-4d2e-adcf-5df863d0029d`::moving from state init -> state preparing >Thread-53938::INFO::2014-05-16 17:27:34,076::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53938::DEBUG::2014-05-16 17:27:34,076::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`adf9e617-5ede-4e8c-8fe6-80e14e155b29`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53938::DEBUG::2014-05-16 17:27:34,077::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53938::DEBUG::2014-05-16 17:27:34,077::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53938::DEBUG::2014-05-16 17:27:34,077::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`adf9e617-5ede-4e8c-8fe6-80e14e155b29`::Granted request >Thread-53938::DEBUG::2014-05-16 17:27:34,077::task::811::TaskManager.Task::(resourceAcquired) Task=`980662e1-eff0-4d2e-adcf-5df863d0029d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53938::DEBUG::2014-05-16 17:27:34,077::task::974::TaskManager.Task::(_decref) Task=`980662e1-eff0-4d2e-adcf-5df863d0029d`::ref 1 aborting False >Thread-53938::INFO::2014-05-16 17:27:34,078::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53938::DEBUG::2014-05-16 17:27:34,078::task::1168::TaskManager.Task::(prepare) Task=`980662e1-eff0-4d2e-adcf-5df863d0029d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53938::DEBUG::2014-05-16 17:27:34,078::task::579::TaskManager.Task::(_updateState) Task=`980662e1-eff0-4d2e-adcf-5df863d0029d`::moving from state preparing -> state finished >Thread-53938::DEBUG::2014-05-16 17:27:34,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53938::DEBUG::2014-05-16 17:27:34,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53938::DEBUG::2014-05-16 17:27:34,079::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53938::DEBUG::2014-05-16 17:27:34,079::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53938::DEBUG::2014-05-16 17:27:34,079::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53938::DEBUG::2014-05-16 17:27:34,079::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53938::DEBUG::2014-05-16 17:27:34,080::task::974::TaskManager.Task::(_decref) Task=`980662e1-eff0-4d2e-adcf-5df863d0029d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:27:34,649::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:34,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312598 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:36,727::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:36,803::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347605 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:38,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:38,884::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348761 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:40,896::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:40,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305693 s, 33.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:27:42,279::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:27:42,289::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622795 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:42,973::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:43,044::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344685 s, 29.7 MB/s\n'; <rc> = 0 >Thread-53942::DEBUG::2014-05-16 17:27:44,109::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53942::DEBUG::2014-05-16 17:27:44,109::task::579::TaskManager.Task::(_updateState) Task=`e68ee98f-e0ec-440e-b01d-357f1634f1c3`::moving from state init -> state preparing >Thread-53942::INFO::2014-05-16 17:27:44,109::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53942::INFO::2014-05-16 17:27:44,110::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53942::DEBUG::2014-05-16 17:27:44,110::task::1168::TaskManager.Task::(prepare) Task=`e68ee98f-e0ec-440e-b01d-357f1634f1c3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53942::DEBUG::2014-05-16 17:27:44,110::task::579::TaskManager.Task::(_updateState) Task=`e68ee98f-e0ec-440e-b01d-357f1634f1c3`::moving from state preparing -> state finished >Thread-53942::DEBUG::2014-05-16 17:27:44,110::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53942::DEBUG::2014-05-16 17:27:44,110::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53942::DEBUG::2014-05-16 17:27:44,110::task::974::TaskManager.Task::(_decref) Task=`e68ee98f-e0ec-440e-b01d-357f1634f1c3`::ref 0 aborting False >Thread-53943::DEBUG::2014-05-16 17:27:44,119::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53943::DEBUG::2014-05-16 17:27:44,120::task::579::TaskManager.Task::(_updateState) Task=`5daed90f-34bc-417c-ad67-b075bcea4435`::moving from state init -> state preparing >Thread-53943::INFO::2014-05-16 17:27:44,120::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53943::DEBUG::2014-05-16 17:27:44,120::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`96296a25-2a7b-42d4-a226-b7707f104011`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53943::DEBUG::2014-05-16 17:27:44,120::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53943::DEBUG::2014-05-16 17:27:44,121::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53943::DEBUG::2014-05-16 17:27:44,121::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`96296a25-2a7b-42d4-a226-b7707f104011`::Granted request >Thread-53943::DEBUG::2014-05-16 17:27:44,121::task::811::TaskManager.Task::(resourceAcquired) Task=`5daed90f-34bc-417c-ad67-b075bcea4435`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53943::DEBUG::2014-05-16 17:27:44,121::task::974::TaskManager.Task::(_decref) Task=`5daed90f-34bc-417c-ad67-b075bcea4435`::ref 1 aborting False >Thread-53943::INFO::2014-05-16 17:27:44,122::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53943::DEBUG::2014-05-16 17:27:44,122::task::1168::TaskManager.Task::(prepare) Task=`5daed90f-34bc-417c-ad67-b075bcea4435`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53943::DEBUG::2014-05-16 17:27:44,122::task::579::TaskManager.Task::(_updateState) Task=`5daed90f-34bc-417c-ad67-b075bcea4435`::moving from state preparing -> state finished >Thread-53943::DEBUG::2014-05-16 17:27:44,122::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53943::DEBUG::2014-05-16 17:27:44,122::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53943::DEBUG::2014-05-16 17:27:44,122::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53943::DEBUG::2014-05-16 17:27:44,123::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53943::DEBUG::2014-05-16 17:27:44,123::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53943::DEBUG::2014-05-16 17:27:44,123::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53943::DEBUG::2014-05-16 17:27:44,123::task::974::TaskManager.Task::(_decref) Task=`5daed90f-34bc-417c-ad67-b075bcea4435`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:27:45,056::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:45,123::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316501 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:47,135::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:47,203::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306925 s, 33.4 MB/s\n'; <rc> = 0 >Thread-53945::DEBUG::2014-05-16 17:27:47,244::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413397.000000 / 8.008168 / 262500000.000000 = 0.257518 >Thread-53945::DEBUG::2014-05-16 17:27:47,244::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065709101630438086, 'statsAge': 0.4568169116973877, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25751788434004824, 'rxDropped': 0} >Thread-53945::DEBUG::2014-05-16 17:27:47,245::task::579::TaskManager.Task::(_updateState) Task=`9f84cbc3-2e6a-4a51-9ef7-89923952b56a`::moving from state init -> state preparing >Thread-53945::INFO::2014-05-16 17:27:47,245::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53945::INFO::2014-05-16 17:27:47,245::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622795', 'lastCheck': '4.9', 'valid': True}} >Thread-53945::DEBUG::2014-05-16 17:27:47,245::task::1168::TaskManager.Task::(prepare) Task=`9f84cbc3-2e6a-4a51-9ef7-89923952b56a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622795', 'lastCheck': '4.9', 'valid': True}} >Thread-53945::DEBUG::2014-05-16 17:27:47,246::task::579::TaskManager.Task::(_updateState) Task=`9f84cbc3-2e6a-4a51-9ef7-89923952b56a`::moving from state preparing -> state finished >Thread-53945::DEBUG::2014-05-16 17:27:47,246::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53945::DEBUG::2014-05-16 17:27:47,246::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53945::DEBUG::2014-05-16 17:27:47,246::task::974::TaskManager.Task::(_decref) Task=`9f84cbc3-2e6a-4a51-9ef7-89923952b56a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:27:49,215::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:49,283::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316889 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:51,294::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:51,365::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035005 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:27:52,324::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:27:52,334::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000779742 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:53,376::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:53,447::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345896 s, 29.6 MB/s\n'; <rc> = 0 >Thread-53949::DEBUG::2014-05-16 17:27:54,189::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53949::DEBUG::2014-05-16 17:27:54,189::task::579::TaskManager.Task::(_updateState) Task=`c61494af-c433-4db1-b482-9771e9ae041a`::moving from state init -> state preparing >Thread-53949::INFO::2014-05-16 17:27:54,189::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53949::INFO::2014-05-16 17:27:54,190::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53949::DEBUG::2014-05-16 17:27:54,190::task::1168::TaskManager.Task::(prepare) Task=`c61494af-c433-4db1-b482-9771e9ae041a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53949::DEBUG::2014-05-16 17:27:54,190::task::579::TaskManager.Task::(_updateState) Task=`c61494af-c433-4db1-b482-9771e9ae041a`::moving from state preparing -> state finished >Thread-53949::DEBUG::2014-05-16 17:27:54,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53949::DEBUG::2014-05-16 17:27:54,190::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53949::DEBUG::2014-05-16 17:27:54,191::task::974::TaskManager.Task::(_decref) Task=`c61494af-c433-4db1-b482-9771e9ae041a`::ref 0 aborting False >Thread-53950::DEBUG::2014-05-16 17:27:54,199::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53950::DEBUG::2014-05-16 17:27:54,199::task::579::TaskManager.Task::(_updateState) Task=`58ea81a9-0feb-40c4-ab10-76b103e05c99`::moving from state init -> state preparing >Thread-53950::INFO::2014-05-16 17:27:54,199::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53950::DEBUG::2014-05-16 17:27:54,200::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7a7996bd-4ec1-4b22-bb91-d61ac0d0de46`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53950::DEBUG::2014-05-16 17:27:54,200::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53950::DEBUG::2014-05-16 17:27:54,200::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53950::DEBUG::2014-05-16 17:27:54,200::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7a7996bd-4ec1-4b22-bb91-d61ac0d0de46`::Granted request >Thread-53950::DEBUG::2014-05-16 17:27:54,201::task::811::TaskManager.Task::(resourceAcquired) Task=`58ea81a9-0feb-40c4-ab10-76b103e05c99`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53950::DEBUG::2014-05-16 17:27:54,201::task::974::TaskManager.Task::(_decref) Task=`58ea81a9-0feb-40c4-ab10-76b103e05c99`::ref 1 aborting False >Thread-53950::INFO::2014-05-16 17:27:54,202::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53950::DEBUG::2014-05-16 17:27:54,202::task::1168::TaskManager.Task::(prepare) Task=`58ea81a9-0feb-40c4-ab10-76b103e05c99`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53950::DEBUG::2014-05-16 17:27:54,202::task::579::TaskManager.Task::(_updateState) Task=`58ea81a9-0feb-40c4-ab10-76b103e05c99`::moving from state preparing -> state finished >Thread-53950::DEBUG::2014-05-16 17:27:54,202::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53950::DEBUG::2014-05-16 17:27:54,202::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53950::DEBUG::2014-05-16 17:27:54,202::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53950::DEBUG::2014-05-16 17:27:54,203::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53950::DEBUG::2014-05-16 17:27:54,203::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53950::DEBUG::2014-05-16 17:27:54,203::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53950::DEBUG::2014-05-16 17:27:54,203::task::974::TaskManager.Task::(_decref) Task=`58ea81a9-0feb-40c4-ab10-76b103e05c99`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:27:55,458::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:55,526::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313341 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:57,537::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:57,608::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349683 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:27:59,620::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:27:59,688::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315985 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:01,699::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:01,766::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312422 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:28:02,371::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:28:02,381::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000541468 s, 7.6 MB/s\n'; <rc> = 0 >Thread-53953::DEBUG::2014-05-16 17:28:02,405::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4307068.000000 / 8.008347 / 262500000.000000 = 0.204885 >Thread-53953::DEBUG::2014-05-16 17:28:02,405::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053378591596388277, 'statsAge': 1.6024458408355713, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2048847037303255, 'rxDropped': 0} >Thread-53953::DEBUG::2014-05-16 17:28:02,406::task::579::TaskManager.Task::(_updateState) Task=`0b0cd2f0-6100-4ceb-9de0-29a674dc8737`::moving from state init -> state preparing >Thread-53953::INFO::2014-05-16 17:28:02,406::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53953::INFO::2014-05-16 17:28:02,406::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541468', 'lastCheck': '0.0', 'valid': True}} >Thread-53953::DEBUG::2014-05-16 17:28:02,406::task::1168::TaskManager.Task::(prepare) Task=`0b0cd2f0-6100-4ceb-9de0-29a674dc8737`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541468', 'lastCheck': '0.0', 'valid': True}} >Thread-53953::DEBUG::2014-05-16 17:28:02,406::task::579::TaskManager.Task::(_updateState) Task=`0b0cd2f0-6100-4ceb-9de0-29a674dc8737`::moving from state preparing -> state finished >Thread-53953::DEBUG::2014-05-16 17:28:02,406::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53953::DEBUG::2014-05-16 17:28:02,407::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53953::DEBUG::2014-05-16 17:28:02,407::task::974::TaskManager.Task::(_decref) Task=`0b0cd2f0-6100-4ceb-9de0-29a674dc8737`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:28:03,778::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:03,849::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346247 s, 29.6 MB/s\n'; <rc> = 0 >Thread-53955::DEBUG::2014-05-16 17:28:04,229::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53955::DEBUG::2014-05-16 17:28:04,229::task::579::TaskManager.Task::(_updateState) Task=`c092e414-095b-4850-ad7c-0c8b3fe1f28b`::moving from state init -> state preparing >Thread-53955::INFO::2014-05-16 17:28:04,229::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53955::INFO::2014-05-16 17:28:04,230::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53955::DEBUG::2014-05-16 17:28:04,230::task::1168::TaskManager.Task::(prepare) Task=`c092e414-095b-4850-ad7c-0c8b3fe1f28b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53955::DEBUG::2014-05-16 17:28:04,230::task::579::TaskManager.Task::(_updateState) Task=`c092e414-095b-4850-ad7c-0c8b3fe1f28b`::moving from state preparing -> state finished >Thread-53955::DEBUG::2014-05-16 17:28:04,230::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53955::DEBUG::2014-05-16 17:28:04,230::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53955::DEBUG::2014-05-16 17:28:04,231::task::974::TaskManager.Task::(_decref) Task=`c092e414-095b-4850-ad7c-0c8b3fe1f28b`::ref 0 aborting False >Thread-53956::DEBUG::2014-05-16 17:28:04,241::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53956::DEBUG::2014-05-16 17:28:04,241::task::579::TaskManager.Task::(_updateState) Task=`b1937c70-2fdb-4590-9ff9-c3029bb5fcb1`::moving from state init -> state preparing >Thread-53956::INFO::2014-05-16 17:28:04,241::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53956::DEBUG::2014-05-16 17:28:04,241::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`61db7016-011d-48b3-a664-dc175ef1fe67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53956::DEBUG::2014-05-16 17:28:04,242::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53956::DEBUG::2014-05-16 17:28:04,242::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53956::DEBUG::2014-05-16 17:28:04,242::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`61db7016-011d-48b3-a664-dc175ef1fe67`::Granted request >Thread-53956::DEBUG::2014-05-16 17:28:04,242::task::811::TaskManager.Task::(resourceAcquired) Task=`b1937c70-2fdb-4590-9ff9-c3029bb5fcb1`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53956::DEBUG::2014-05-16 17:28:04,242::task::974::TaskManager.Task::(_decref) Task=`b1937c70-2fdb-4590-9ff9-c3029bb5fcb1`::ref 1 aborting False >Thread-53956::INFO::2014-05-16 17:28:04,243::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53956::DEBUG::2014-05-16 17:28:04,243::task::1168::TaskManager.Task::(prepare) Task=`b1937c70-2fdb-4590-9ff9-c3029bb5fcb1`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53956::DEBUG::2014-05-16 17:28:04,243::task::579::TaskManager.Task::(_updateState) Task=`b1937c70-2fdb-4590-9ff9-c3029bb5fcb1`::moving from state preparing -> state finished >Thread-53956::DEBUG::2014-05-16 17:28:04,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53956::DEBUG::2014-05-16 17:28:04,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53956::DEBUG::2014-05-16 17:28:04,244::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53956::DEBUG::2014-05-16 17:28:04,244::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53956::DEBUG::2014-05-16 17:28:04,244::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53956::DEBUG::2014-05-16 17:28:04,244::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53956::DEBUG::2014-05-16 17:28:04,244::task::974::TaskManager.Task::(_decref) Task=`b1937c70-2fdb-4590-9ff9-c3029bb5fcb1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:28:05,860::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:05,926::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302221 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:07,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:08,005::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308376 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:10,017::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:10,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354838 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:12,099::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:12,167::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311917 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:28:12,423::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:28:12,433::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000733163 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:14,178::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:14,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319398 s, 32.1 MB/s\n'; <rc> = 0 >Thread-53960::DEBUG::2014-05-16 17:28:14,273::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53960::DEBUG::2014-05-16 17:28:14,273::task::579::TaskManager.Task::(_updateState) Task=`bc94e906-17c4-497d-ad02-32a38e604b73`::moving from state init -> state preparing >Thread-53960::INFO::2014-05-16 17:28:14,274::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53960::INFO::2014-05-16 17:28:14,274::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53960::DEBUG::2014-05-16 17:28:14,274::task::1168::TaskManager.Task::(prepare) Task=`bc94e906-17c4-497d-ad02-32a38e604b73`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53960::DEBUG::2014-05-16 17:28:14,274::task::579::TaskManager.Task::(_updateState) Task=`bc94e906-17c4-497d-ad02-32a38e604b73`::moving from state preparing -> state finished >Thread-53960::DEBUG::2014-05-16 17:28:14,274::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53960::DEBUG::2014-05-16 17:28:14,275::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53960::DEBUG::2014-05-16 17:28:14,275::task::974::TaskManager.Task::(_decref) Task=`bc94e906-17c4-497d-ad02-32a38e604b73`::ref 0 aborting False >Thread-53961::DEBUG::2014-05-16 17:28:14,283::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53961::DEBUG::2014-05-16 17:28:14,284::task::579::TaskManager.Task::(_updateState) Task=`8e14f640-8c6e-428e-a195-0ddedb023261`::moving from state init -> state preparing >Thread-53961::INFO::2014-05-16 17:28:14,284::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53961::DEBUG::2014-05-16 17:28:14,284::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1ef1866a-0861-47f4-b6d3-2140df0dd205`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53961::DEBUG::2014-05-16 17:28:14,284::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53961::DEBUG::2014-05-16 17:28:14,285::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53961::DEBUG::2014-05-16 17:28:14,285::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1ef1866a-0861-47f4-b6d3-2140df0dd205`::Granted request >Thread-53961::DEBUG::2014-05-16 17:28:14,285::task::811::TaskManager.Task::(resourceAcquired) Task=`8e14f640-8c6e-428e-a195-0ddedb023261`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53961::DEBUG::2014-05-16 17:28:14,285::task::974::TaskManager.Task::(_decref) Task=`8e14f640-8c6e-428e-a195-0ddedb023261`::ref 1 aborting False >Thread-53961::INFO::2014-05-16 17:28:14,286::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53961::DEBUG::2014-05-16 17:28:14,286::task::1168::TaskManager.Task::(prepare) Task=`8e14f640-8c6e-428e-a195-0ddedb023261`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53961::DEBUG::2014-05-16 17:28:14,286::task::579::TaskManager.Task::(_updateState) Task=`8e14f640-8c6e-428e-a195-0ddedb023261`::moving from state preparing -> state finished >Thread-53961::DEBUG::2014-05-16 17:28:14,287::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53961::DEBUG::2014-05-16 17:28:14,287::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53961::DEBUG::2014-05-16 17:28:14,287::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53961::DEBUG::2014-05-16 17:28:14,287::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53961::DEBUG::2014-05-16 17:28:14,287::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53961::DEBUG::2014-05-16 17:28:14,287::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53961::DEBUG::2014-05-16 17:28:14,288::task::974::TaskManager.Task::(_decref) Task=`8e14f640-8c6e-428e-a195-0ddedb023261`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:28:16,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:16,327::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03154 s, 32.5 MB/s\n'; <rc> = 0 >Thread-53963::DEBUG::2014-05-16 17:28:17,728::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315721.000000 / 8.008333 / 262500000.000000 = 0.205297 >Thread-53963::DEBUG::2014-05-16 17:28:17,728::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052819268057069449, 'statsAge': 0.90923905372619629, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20529668248002794, 'rxDropped': 0} >Thread-53963::DEBUG::2014-05-16 17:28:17,728::task::579::TaskManager.Task::(_updateState) Task=`99deac84-7ab9-4f2f-90d3-fc3446f9920b`::moving from state init -> state preparing >Thread-53963::INFO::2014-05-16 17:28:17,729::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53963::INFO::2014-05-16 17:28:17,729::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000733163', 'lastCheck': '5.3', 'valid': True}} >Thread-53963::DEBUG::2014-05-16 17:28:17,729::task::1168::TaskManager.Task::(prepare) Task=`99deac84-7ab9-4f2f-90d3-fc3446f9920b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000733163', 'lastCheck': '5.3', 'valid': True}} >Thread-53963::DEBUG::2014-05-16 17:28:17,729::task::579::TaskManager.Task::(_updateState) Task=`99deac84-7ab9-4f2f-90d3-fc3446f9920b`::moving from state preparing -> state finished >Thread-53963::DEBUG::2014-05-16 17:28:17,729::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53963::DEBUG::2014-05-16 17:28:17,729::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53963::DEBUG::2014-05-16 17:28:17,730::task::974::TaskManager.Task::(_decref) Task=`99deac84-7ab9-4f2f-90d3-fc3446f9920b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:28:18,339::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:18,410::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352513 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:20,422::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:20,489::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311513 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:28:22,467::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:28:22,477::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106216 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:22,500::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:22,570::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345684 s, 29.6 MB/s\n'; <rc> = 0 >Thread-53967::DEBUG::2014-05-16 17:28:24,344::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53967::DEBUG::2014-05-16 17:28:24,346::task::579::TaskManager.Task::(_updateState) Task=`b50afc00-a4cd-4a29-a8c4-3b6af5586db2`::moving from state init -> state preparing >Thread-53967::INFO::2014-05-16 17:28:24,346::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53967::INFO::2014-05-16 17:28:24,346::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53967::DEBUG::2014-05-16 17:28:24,346::task::1168::TaskManager.Task::(prepare) Task=`b50afc00-a4cd-4a29-a8c4-3b6af5586db2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53967::DEBUG::2014-05-16 17:28:24,347::task::579::TaskManager.Task::(_updateState) Task=`b50afc00-a4cd-4a29-a8c4-3b6af5586db2`::moving from state preparing -> state finished >Thread-53967::DEBUG::2014-05-16 17:28:24,347::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53967::DEBUG::2014-05-16 17:28:24,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53967::DEBUG::2014-05-16 17:28:24,347::task::974::TaskManager.Task::(_decref) Task=`b50afc00-a4cd-4a29-a8c4-3b6af5586db2`::ref 0 aborting False >Thread-53968::DEBUG::2014-05-16 17:28:24,356::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53968::DEBUG::2014-05-16 17:28:24,356::task::579::TaskManager.Task::(_updateState) Task=`949d241c-02d5-4b4e-96ac-5dd81b06c651`::moving from state init -> state preparing >Thread-53968::INFO::2014-05-16 17:28:24,356::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53968::DEBUG::2014-05-16 17:28:24,357::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7d7b82ee-503a-4f84-a90f-f2c375c70466`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53968::DEBUG::2014-05-16 17:28:24,357::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53968::DEBUG::2014-05-16 17:28:24,357::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53968::DEBUG::2014-05-16 17:28:24,357::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7d7b82ee-503a-4f84-a90f-f2c375c70466`::Granted request >Thread-53968::DEBUG::2014-05-16 17:28:24,357::task::811::TaskManager.Task::(resourceAcquired) Task=`949d241c-02d5-4b4e-96ac-5dd81b06c651`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53968::DEBUG::2014-05-16 17:28:24,358::task::974::TaskManager.Task::(_decref) Task=`949d241c-02d5-4b4e-96ac-5dd81b06c651`::ref 1 aborting False >Thread-53968::INFO::2014-05-16 17:28:24,358::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53968::DEBUG::2014-05-16 17:28:24,358::task::1168::TaskManager.Task::(prepare) Task=`949d241c-02d5-4b4e-96ac-5dd81b06c651`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53968::DEBUG::2014-05-16 17:28:24,359::task::579::TaskManager.Task::(_updateState) Task=`949d241c-02d5-4b4e-96ac-5dd81b06c651`::moving from state preparing -> state finished >Thread-53968::DEBUG::2014-05-16 17:28:24,359::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53968::DEBUG::2014-05-16 17:28:24,359::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53968::DEBUG::2014-05-16 17:28:24,359::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53968::DEBUG::2014-05-16 17:28:24,359::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53968::DEBUG::2014-05-16 17:28:24,359::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53968::DEBUG::2014-05-16 17:28:24,360::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53968::DEBUG::2014-05-16 17:28:24,360::task::974::TaskManager.Task::(_decref) Task=`949d241c-02d5-4b4e-96ac-5dd81b06c651`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:28:24,581::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:24,653::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356511 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:26,664::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:26,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313556 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:28,743::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:28,815::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355916 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:30,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:30,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350557 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:28:32,510::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:28:32,521::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101777 s, 4.0 MB/s\n'; <rc> = 0 >Thread-53971::DEBUG::2014-05-16 17:28:32,868::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3236500.000000 / 8.010366 / 262500000.000000 = 0.153920 >Thread-53971::DEBUG::2014-05-16 17:28:32,869::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0038647066100072464, 'statsAge': 0.030982017517089844, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15391960700049781, 'rxDropped': 0} >Thread-53971::DEBUG::2014-05-16 17:28:32,869::task::579::TaskManager.Task::(_updateState) Task=`e36b326d-4d82-4761-8c92-eb15096d3241`::moving from state init -> state preparing >Thread-53971::INFO::2014-05-16 17:28:32,869::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53971::INFO::2014-05-16 17:28:32,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101777', 'lastCheck': '0.3', 'valid': True}} >Thread-53971::DEBUG::2014-05-16 17:28:32,870::task::1168::TaskManager.Task::(prepare) Task=`e36b326d-4d82-4761-8c92-eb15096d3241`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101777', 'lastCheck': '0.3', 'valid': True}} >Thread-53971::DEBUG::2014-05-16 17:28:32,870::task::579::TaskManager.Task::(_updateState) Task=`e36b326d-4d82-4761-8c92-eb15096d3241`::moving from state preparing -> state finished >Thread-53971::DEBUG::2014-05-16 17:28:32,870::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53971::DEBUG::2014-05-16 17:28:32,870::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53971::DEBUG::2014-05-16 17:28:32,870::task::974::TaskManager.Task::(_decref) Task=`e36b326d-4d82-4761-8c92-eb15096d3241`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:28:32,910::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:32,980::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342876 s, 29.9 MB/s\n'; <rc> = 0 >Thread-53973::DEBUG::2014-05-16 17:28:34,394::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53973::DEBUG::2014-05-16 17:28:34,395::task::579::TaskManager.Task::(_updateState) Task=`3f7765d2-dd31-4be4-9c76-75d384f90dbe`::moving from state init -> state preparing >Thread-53973::INFO::2014-05-16 17:28:34,395::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53973::INFO::2014-05-16 17:28:34,395::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53973::DEBUG::2014-05-16 17:28:34,395::task::1168::TaskManager.Task::(prepare) Task=`3f7765d2-dd31-4be4-9c76-75d384f90dbe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53973::DEBUG::2014-05-16 17:28:34,396::task::579::TaskManager.Task::(_updateState) Task=`3f7765d2-dd31-4be4-9c76-75d384f90dbe`::moving from state preparing -> state finished >Thread-53973::DEBUG::2014-05-16 17:28:34,396::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53973::DEBUG::2014-05-16 17:28:34,396::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53973::DEBUG::2014-05-16 17:28:34,396::task::974::TaskManager.Task::(_decref) Task=`3f7765d2-dd31-4be4-9c76-75d384f90dbe`::ref 0 aborting False >Thread-53974::DEBUG::2014-05-16 17:28:34,404::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53974::DEBUG::2014-05-16 17:28:34,405::task::579::TaskManager.Task::(_updateState) Task=`a395a927-fff4-4173-ac00-cfb269f0efbb`::moving from state init -> state preparing >Thread-53974::INFO::2014-05-16 17:28:34,405::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53974::DEBUG::2014-05-16 17:28:34,405::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7c76da3d-30a4-4aba-88bf-959f5c739d16`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53974::DEBUG::2014-05-16 17:28:34,405::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53974::DEBUG::2014-05-16 17:28:34,405::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53974::DEBUG::2014-05-16 17:28:34,406::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7c76da3d-30a4-4aba-88bf-959f5c739d16`::Granted request >Thread-53974::DEBUG::2014-05-16 17:28:34,406::task::811::TaskManager.Task::(resourceAcquired) Task=`a395a927-fff4-4173-ac00-cfb269f0efbb`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53974::DEBUG::2014-05-16 17:28:34,406::task::974::TaskManager.Task::(_decref) Task=`a395a927-fff4-4173-ac00-cfb269f0efbb`::ref 1 aborting False >Thread-53974::INFO::2014-05-16 17:28:34,407::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53974::DEBUG::2014-05-16 17:28:34,407::task::1168::TaskManager.Task::(prepare) Task=`a395a927-fff4-4173-ac00-cfb269f0efbb`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53974::DEBUG::2014-05-16 17:28:34,407::task::579::TaskManager.Task::(_updateState) Task=`a395a927-fff4-4173-ac00-cfb269f0efbb`::moving from state preparing -> state finished >Thread-53974::DEBUG::2014-05-16 17:28:34,407::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53974::DEBUG::2014-05-16 17:28:34,407::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53974::DEBUG::2014-05-16 17:28:34,407::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53974::DEBUG::2014-05-16 17:28:34,408::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53974::DEBUG::2014-05-16 17:28:34,408::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53974::DEBUG::2014-05-16 17:28:34,408::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53974::DEBUG::2014-05-16 17:28:34,408::task::974::TaskManager.Task::(_decref) Task=`a395a927-fff4-4173-ac00-cfb269f0efbb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:28:34,991::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:35,063::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316296 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:37,075::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:37,146::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034646 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:39,157::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:39,229::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358576 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:41,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:41,306::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300533 s, 34.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:28:42,558::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:28:42,569::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100425 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:43,318::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:43,392::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372514 s, 27.5 MB/s\n'; <rc> = 0 >Thread-53978::DEBUG::2014-05-16 17:28:44,440::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53978::DEBUG::2014-05-16 17:28:44,440::task::579::TaskManager.Task::(_updateState) Task=`4290476a-f805-43b4-90d1-51195fdccce1`::moving from state init -> state preparing >Thread-53978::INFO::2014-05-16 17:28:44,441::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53978::INFO::2014-05-16 17:28:44,441::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53978::DEBUG::2014-05-16 17:28:44,441::task::1168::TaskManager.Task::(prepare) Task=`4290476a-f805-43b4-90d1-51195fdccce1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53978::DEBUG::2014-05-16 17:28:44,441::task::579::TaskManager.Task::(_updateState) Task=`4290476a-f805-43b4-90d1-51195fdccce1`::moving from state preparing -> state finished >Thread-53978::DEBUG::2014-05-16 17:28:44,442::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53978::DEBUG::2014-05-16 17:28:44,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53978::DEBUG::2014-05-16 17:28:44,442::task::974::TaskManager.Task::(_decref) Task=`4290476a-f805-43b4-90d1-51195fdccce1`::ref 0 aborting False >Thread-53979::DEBUG::2014-05-16 17:28:44,450::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53979::DEBUG::2014-05-16 17:28:44,451::task::579::TaskManager.Task::(_updateState) Task=`e2cd0424-7d25-468c-8aa0-3535d4a5f168`::moving from state init -> state preparing >Thread-53979::INFO::2014-05-16 17:28:44,451::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53979::DEBUG::2014-05-16 17:28:44,451::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`009f4e28-a741-4e76-bfaa-9e9698fc20eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53979::DEBUG::2014-05-16 17:28:44,451::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53979::DEBUG::2014-05-16 17:28:44,452::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53979::DEBUG::2014-05-16 17:28:44,452::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`009f4e28-a741-4e76-bfaa-9e9698fc20eb`::Granted request >Thread-53979::DEBUG::2014-05-16 17:28:44,452::task::811::TaskManager.Task::(resourceAcquired) Task=`e2cd0424-7d25-468c-8aa0-3535d4a5f168`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53979::DEBUG::2014-05-16 17:28:44,452::task::974::TaskManager.Task::(_decref) Task=`e2cd0424-7d25-468c-8aa0-3535d4a5f168`::ref 1 aborting False >Thread-53979::INFO::2014-05-16 17:28:44,453::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53979::DEBUG::2014-05-16 17:28:44,453::task::1168::TaskManager.Task::(prepare) Task=`e2cd0424-7d25-468c-8aa0-3535d4a5f168`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53979::DEBUG::2014-05-16 17:28:44,453::task::579::TaskManager.Task::(_updateState) Task=`e2cd0424-7d25-468c-8aa0-3535d4a5f168`::moving from state preparing -> state finished >Thread-53979::DEBUG::2014-05-16 17:28:44,453::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53979::DEBUG::2014-05-16 17:28:44,454::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53979::DEBUG::2014-05-16 17:28:44,454::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53979::DEBUG::2014-05-16 17:28:44,454::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53979::DEBUG::2014-05-16 17:28:44,454::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53979::DEBUG::2014-05-16 17:28:44,454::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53979::DEBUG::2014-05-16 17:28:44,455::task::974::TaskManager.Task::(_decref) Task=`e2cd0424-7d25-468c-8aa0-3535d4a5f168`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:28:45,403::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:45,475::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361002 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:47,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:47,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309834 s, 33.0 MB/s\n'; <rc> = 0 >Thread-53981::DEBUG::2014-05-16 17:28:48,208::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413876.000000 / 8.008060 / 262500000.000000 = 0.257544 >Thread-53981::DEBUG::2014-05-16 17:28:48,208::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066188553305787465, 'statsAge': 1.3566579818725586, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25754414401515308, 'rxDropped': 0} >Thread-53981::DEBUG::2014-05-16 17:28:48,209::task::579::TaskManager.Task::(_updateState) Task=`3448a63d-6e94-490a-9858-93e9daa6d576`::moving from state init -> state preparing >Thread-53981::INFO::2014-05-16 17:28:48,209::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53981::INFO::2014-05-16 17:28:48,209::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100425', 'lastCheck': '5.6', 'valid': True}} >Thread-53981::DEBUG::2014-05-16 17:28:48,210::task::1168::TaskManager.Task::(prepare) Task=`3448a63d-6e94-490a-9858-93e9daa6d576`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100425', 'lastCheck': '5.6', 'valid': True}} >Thread-53981::DEBUG::2014-05-16 17:28:48,210::task::579::TaskManager.Task::(_updateState) Task=`3448a63d-6e94-490a-9858-93e9daa6d576`::moving from state preparing -> state finished >Thread-53981::DEBUG::2014-05-16 17:28:48,210::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53981::DEBUG::2014-05-16 17:28:48,210::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53981::DEBUG::2014-05-16 17:28:48,210::task::974::TaskManager.Task::(_decref) Task=`3448a63d-6e94-490a-9858-93e9daa6d576`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:28:49,567::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:49,635::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315222 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:51,646::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:51,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344906 s, 29.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:28:52,603::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:28:52,613::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759107 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:53,728::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:53,800::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352773 s, 29.0 MB/s\n'; <rc> = 0 >Thread-53984::DEBUG::2014-05-16 17:28:54,513::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53984::DEBUG::2014-05-16 17:28:54,513::task::579::TaskManager.Task::(_updateState) Task=`528434fc-26c4-4325-8ec5-5e07ea50097f`::moving from state init -> state preparing >Thread-53984::INFO::2014-05-16 17:28:54,513::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53984::INFO::2014-05-16 17:28:54,514::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53984::DEBUG::2014-05-16 17:28:54,514::task::1168::TaskManager.Task::(prepare) Task=`528434fc-26c4-4325-8ec5-5e07ea50097f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53984::DEBUG::2014-05-16 17:28:54,514::task::579::TaskManager.Task::(_updateState) Task=`528434fc-26c4-4325-8ec5-5e07ea50097f`::moving from state preparing -> state finished >Thread-53984::DEBUG::2014-05-16 17:28:54,514::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53984::DEBUG::2014-05-16 17:28:54,514::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53984::DEBUG::2014-05-16 17:28:54,515::task::974::TaskManager.Task::(_decref) Task=`528434fc-26c4-4325-8ec5-5e07ea50097f`::ref 0 aborting False >Thread-53985::DEBUG::2014-05-16 17:28:54,524::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53985::DEBUG::2014-05-16 17:28:54,524::task::579::TaskManager.Task::(_updateState) Task=`5b8922ca-228c-4235-b410-3df2fa09e1c4`::moving from state init -> state preparing >Thread-53985::INFO::2014-05-16 17:28:54,524::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53985::DEBUG::2014-05-16 17:28:54,525::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2af9658e-b9a2-4183-bf0b-a41bd0f1d271`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53985::DEBUG::2014-05-16 17:28:54,525::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53985::DEBUG::2014-05-16 17:28:54,525::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53985::DEBUG::2014-05-16 17:28:54,525::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2af9658e-b9a2-4183-bf0b-a41bd0f1d271`::Granted request >Thread-53985::DEBUG::2014-05-16 17:28:54,526::task::811::TaskManager.Task::(resourceAcquired) Task=`5b8922ca-228c-4235-b410-3df2fa09e1c4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53985::DEBUG::2014-05-16 17:28:54,526::task::974::TaskManager.Task::(_decref) Task=`5b8922ca-228c-4235-b410-3df2fa09e1c4`::ref 1 aborting False >Thread-53985::INFO::2014-05-16 17:28:54,527::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53985::DEBUG::2014-05-16 17:28:54,527::task::1168::TaskManager.Task::(prepare) Task=`5b8922ca-228c-4235-b410-3df2fa09e1c4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53985::DEBUG::2014-05-16 17:28:54,527::task::579::TaskManager.Task::(_updateState) Task=`5b8922ca-228c-4235-b410-3df2fa09e1c4`::moving from state preparing -> state finished >Thread-53985::DEBUG::2014-05-16 17:28:54,527::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53985::DEBUG::2014-05-16 17:28:54,527::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53985::DEBUG::2014-05-16 17:28:54,527::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53985::DEBUG::2014-05-16 17:28:54,528::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53985::DEBUG::2014-05-16 17:28:54,528::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53985::DEBUG::2014-05-16 17:28:54,528::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53985::DEBUG::2014-05-16 17:28:54,528::task::974::TaskManager.Task::(_decref) Task=`5b8922ca-228c-4235-b410-3df2fa09e1c4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:28:55,812::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:55,879::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307194 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:57,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:28:57,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348519 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:28:59,974::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:00,047::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354821 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:02,058::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:02,126::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310443 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:29:02,651::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:29:02,661::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000789934 s, 5.2 MB/s\n'; <rc> = 0 >Thread-53989::DEBUG::2014-05-16 17:29:03,669::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4307593.000000 / 8.008401 / 262500000.000000 = 0.204908 >Thread-53989::DEBUG::2014-05-16 17:29:03,669::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0050610662526572731, 'statsAge': 0.80042815208435059, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20490829898756227, 'rxDropped': 0} >Thread-53989::DEBUG::2014-05-16 17:29:03,670::task::579::TaskManager.Task::(_updateState) Task=`e5ba8d3f-9205-4b59-9d3e-d595e5cfee6c`::moving from state init -> state preparing >Thread-53989::INFO::2014-05-16 17:29:03,670::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53989::INFO::2014-05-16 17:29:03,670::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789934', 'lastCheck': '1.0', 'valid': True}} >Thread-53989::DEBUG::2014-05-16 17:29:03,670::task::1168::TaskManager.Task::(prepare) Task=`e5ba8d3f-9205-4b59-9d3e-d595e5cfee6c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789934', 'lastCheck': '1.0', 'valid': True}} >Thread-53989::DEBUG::2014-05-16 17:29:03,670::task::579::TaskManager.Task::(_updateState) Task=`e5ba8d3f-9205-4b59-9d3e-d595e5cfee6c`::moving from state preparing -> state finished >Thread-53989::DEBUG::2014-05-16 17:29:03,671::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53989::DEBUG::2014-05-16 17:29:03,671::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53989::DEBUG::2014-05-16 17:29:03,671::task::974::TaskManager.Task::(_decref) Task=`e5ba8d3f-9205-4b59-9d3e-d595e5cfee6c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:29:04,138::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:04,208::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339512 s, 30.2 MB/s\n'; <rc> = 0 >Thread-53991::DEBUG::2014-05-16 17:29:04,631::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53991::DEBUG::2014-05-16 17:29:04,631::task::579::TaskManager.Task::(_updateState) Task=`2e710ff1-31b2-42ca-b294-038990f2aa1c`::moving from state init -> state preparing >Thread-53991::INFO::2014-05-16 17:29:04,631::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53991::INFO::2014-05-16 17:29:04,632::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53991::DEBUG::2014-05-16 17:29:04,632::task::1168::TaskManager.Task::(prepare) Task=`2e710ff1-31b2-42ca-b294-038990f2aa1c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53991::DEBUG::2014-05-16 17:29:04,632::task::579::TaskManager.Task::(_updateState) Task=`2e710ff1-31b2-42ca-b294-038990f2aa1c`::moving from state preparing -> state finished >Thread-53991::DEBUG::2014-05-16 17:29:04,632::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53991::DEBUG::2014-05-16 17:29:04,632::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53991::DEBUG::2014-05-16 17:29:04,632::task::974::TaskManager.Task::(_decref) Task=`2e710ff1-31b2-42ca-b294-038990f2aa1c`::ref 0 aborting False >Thread-53992::DEBUG::2014-05-16 17:29:04,642::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53992::DEBUG::2014-05-16 17:29:04,642::task::579::TaskManager.Task::(_updateState) Task=`d8cf2ebb-1201-4e03-9586-a6bfb8da4c22`::moving from state init -> state preparing >Thread-53992::INFO::2014-05-16 17:29:04,643::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53992::DEBUG::2014-05-16 17:29:04,643::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`94cd7762-5763-48a1-93e2-e66bb397db38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53992::DEBUG::2014-05-16 17:29:04,643::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53992::DEBUG::2014-05-16 17:29:04,643::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53992::DEBUG::2014-05-16 17:29:04,643::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`94cd7762-5763-48a1-93e2-e66bb397db38`::Granted request >Thread-53992::DEBUG::2014-05-16 17:29:04,644::task::811::TaskManager.Task::(resourceAcquired) Task=`d8cf2ebb-1201-4e03-9586-a6bfb8da4c22`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53992::DEBUG::2014-05-16 17:29:04,644::task::974::TaskManager.Task::(_decref) Task=`d8cf2ebb-1201-4e03-9586-a6bfb8da4c22`::ref 1 aborting False >Thread-53992::INFO::2014-05-16 17:29:04,644::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53992::DEBUG::2014-05-16 17:29:04,645::task::1168::TaskManager.Task::(prepare) Task=`d8cf2ebb-1201-4e03-9586-a6bfb8da4c22`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53992::DEBUG::2014-05-16 17:29:04,645::task::579::TaskManager.Task::(_updateState) Task=`d8cf2ebb-1201-4e03-9586-a6bfb8da4c22`::moving from state preparing -> state finished >Thread-53992::DEBUG::2014-05-16 17:29:04,645::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53992::DEBUG::2014-05-16 17:29:04,645::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53992::DEBUG::2014-05-16 17:29:04,645::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53992::DEBUG::2014-05-16 17:29:04,645::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53992::DEBUG::2014-05-16 17:29:04,645::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53992::DEBUG::2014-05-16 17:29:04,646::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53992::DEBUG::2014-05-16 17:29:04,646::task::974::TaskManager.Task::(_decref) Task=`d8cf2ebb-1201-4e03-9586-a6bfb8da4c22`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:29:06,220::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:06,286::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302737 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:08,298::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:08,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301434 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:10,375::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:10,443::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309901 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:12,455::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:12,526::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352258 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:29:12,698::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:29:12,708::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693463 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:14,537::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:14,609::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359369 s, 28.5 MB/s\n'; <rc> = 0 >Thread-53996::DEBUG::2014-05-16 17:29:14,768::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53996::DEBUG::2014-05-16 17:29:14,769::task::579::TaskManager.Task::(_updateState) Task=`f5740b23-49a0-4398-b40d-2445ecfd956e`::moving from state init -> state preparing >Thread-53996::INFO::2014-05-16 17:29:14,769::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53996::INFO::2014-05-16 17:29:14,769::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53996::DEBUG::2014-05-16 17:29:14,769::task::1168::TaskManager.Task::(prepare) Task=`f5740b23-49a0-4398-b40d-2445ecfd956e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-53996::DEBUG::2014-05-16 17:29:14,769::task::579::TaskManager.Task::(_updateState) Task=`f5740b23-49a0-4398-b40d-2445ecfd956e`::moving from state preparing -> state finished >Thread-53996::DEBUG::2014-05-16 17:29:14,770::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53996::DEBUG::2014-05-16 17:29:14,770::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53996::DEBUG::2014-05-16 17:29:14,770::task::974::TaskManager.Task::(_decref) Task=`f5740b23-49a0-4398-b40d-2445ecfd956e`::ref 0 aborting False >Thread-53997::DEBUG::2014-05-16 17:29:14,778::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-53997::DEBUG::2014-05-16 17:29:14,778::task::579::TaskManager.Task::(_updateState) Task=`fb87ad20-2bf3-4cb9-9c7c-5f0ec535c0ff`::moving from state init -> state preparing >Thread-53997::INFO::2014-05-16 17:29:14,778::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-53997::DEBUG::2014-05-16 17:29:14,780::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5153a81c-30fe-4d8e-8722-ae9587d1acb5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-53997::DEBUG::2014-05-16 17:29:14,780::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-53997::DEBUG::2014-05-16 17:29:14,780::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-53997::DEBUG::2014-05-16 17:29:14,780::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5153a81c-30fe-4d8e-8722-ae9587d1acb5`::Granted request >Thread-53997::DEBUG::2014-05-16 17:29:14,781::task::811::TaskManager.Task::(resourceAcquired) Task=`fb87ad20-2bf3-4cb9-9c7c-5f0ec535c0ff`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-53997::DEBUG::2014-05-16 17:29:14,781::task::974::TaskManager.Task::(_decref) Task=`fb87ad20-2bf3-4cb9-9c7c-5f0ec535c0ff`::ref 1 aborting False >Thread-53997::INFO::2014-05-16 17:29:14,781::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53997::DEBUG::2014-05-16 17:29:14,782::task::1168::TaskManager.Task::(prepare) Task=`fb87ad20-2bf3-4cb9-9c7c-5f0ec535c0ff`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-53997::DEBUG::2014-05-16 17:29:14,782::task::579::TaskManager.Task::(_updateState) Task=`fb87ad20-2bf3-4cb9-9c7c-5f0ec535c0ff`::moving from state preparing -> state finished >Thread-53997::DEBUG::2014-05-16 17:29:14,782::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-53997::DEBUG::2014-05-16 17:29:14,782::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53997::DEBUG::2014-05-16 17:29:14,782::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-53997::DEBUG::2014-05-16 17:29:14,783::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-53997::DEBUG::2014-05-16 17:29:14,783::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-53997::DEBUG::2014-05-16 17:29:14,783::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-53997::DEBUG::2014-05-16 17:29:14,783::task::974::TaskManager.Task::(_decref) Task=`fb87ad20-2bf3-4cb9-9c7c-5f0ec535c0ff`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:29:16,621::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:16,687::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303322 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:18,699::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:18,770::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353809 s, 28.9 MB/s\n'; <rc> = 0 >Thread-53999::DEBUG::2014-05-16 17:29:18,938::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314647.000000 / 8.008569 / 262500000.000000 = 0.205240 >Thread-53999::DEBUG::2014-05-16 17:29:18,938::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053064114067500967, 'statsAge': 0.052438020706176758, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20523954369094866, 'rxDropped': 0} >Thread-53999::DEBUG::2014-05-16 17:29:18,938::task::579::TaskManager.Task::(_updateState) Task=`f772789f-e634-45bb-926f-49e989198456`::moving from state init -> state preparing >Thread-53999::INFO::2014-05-16 17:29:18,939::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53999::INFO::2014-05-16 17:29:18,939::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693463', 'lastCheck': '6.2', 'valid': True}} >Thread-53999::DEBUG::2014-05-16 17:29:18,939::task::1168::TaskManager.Task::(prepare) Task=`f772789f-e634-45bb-926f-49e989198456`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693463', 'lastCheck': '6.2', 'valid': True}} >Thread-53999::DEBUG::2014-05-16 17:29:18,939::task::579::TaskManager.Task::(_updateState) Task=`f772789f-e634-45bb-926f-49e989198456`::moving from state preparing -> state finished >Thread-53999::DEBUG::2014-05-16 17:29:18,939::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53999::DEBUG::2014-05-16 17:29:18,939::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53999::DEBUG::2014-05-16 17:29:18,940::task::974::TaskManager.Task::(_decref) Task=`f772789f-e634-45bb-926f-49e989198456`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:29:20,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:20,865::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318602 s, 32.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:29:22,743::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:29:22,753::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000977524 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:22,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:22,950::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356036 s, 28.8 MB/s\n'; <rc> = 0 >Thread-54002::DEBUG::2014-05-16 17:29:24,884::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54002::DEBUG::2014-05-16 17:29:24,884::task::579::TaskManager.Task::(_updateState) Task=`ca2936d3-ce19-47ac-91f6-b4935797d444`::moving from state init -> state preparing >Thread-54002::INFO::2014-05-16 17:29:24,884::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54002::INFO::2014-05-16 17:29:24,885::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54002::DEBUG::2014-05-16 17:29:24,885::task::1168::TaskManager.Task::(prepare) Task=`ca2936d3-ce19-47ac-91f6-b4935797d444`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54002::DEBUG::2014-05-16 17:29:24,885::task::579::TaskManager.Task::(_updateState) Task=`ca2936d3-ce19-47ac-91f6-b4935797d444`::moving from state preparing -> state finished >Thread-54002::DEBUG::2014-05-16 17:29:24,885::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54002::DEBUG::2014-05-16 17:29:24,885::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54002::DEBUG::2014-05-16 17:29:24,886::task::974::TaskManager.Task::(_decref) Task=`ca2936d3-ce19-47ac-91f6-b4935797d444`::ref 0 aborting False >Thread-54003::DEBUG::2014-05-16 17:29:24,895::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54003::DEBUG::2014-05-16 17:29:24,895::task::579::TaskManager.Task::(_updateState) Task=`24ced483-90df-4199-ae40-9c299dee6d60`::moving from state init -> state preparing >Thread-54003::INFO::2014-05-16 17:29:24,896::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54003::DEBUG::2014-05-16 17:29:24,896::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bb426f9e-57b1-45d0-9d84-30d1b3c55638`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54003::DEBUG::2014-05-16 17:29:24,896::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54003::DEBUG::2014-05-16 17:29:24,896::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54003::DEBUG::2014-05-16 17:29:24,897::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bb426f9e-57b1-45d0-9d84-30d1b3c55638`::Granted request >Thread-54003::DEBUG::2014-05-16 17:29:24,897::task::811::TaskManager.Task::(resourceAcquired) Task=`24ced483-90df-4199-ae40-9c299dee6d60`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54003::DEBUG::2014-05-16 17:29:24,897::task::974::TaskManager.Task::(_decref) Task=`24ced483-90df-4199-ae40-9c299dee6d60`::ref 1 aborting False >Thread-54003::INFO::2014-05-16 17:29:24,898::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54003::DEBUG::2014-05-16 17:29:24,898::task::1168::TaskManager.Task::(prepare) Task=`24ced483-90df-4199-ae40-9c299dee6d60`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54003::DEBUG::2014-05-16 17:29:24,898::task::579::TaskManager.Task::(_updateState) Task=`24ced483-90df-4199-ae40-9c299dee6d60`::moving from state preparing -> state finished >Thread-54003::DEBUG::2014-05-16 17:29:24,898::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54003::DEBUG::2014-05-16 17:29:24,898::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54003::DEBUG::2014-05-16 17:29:24,899::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54003::DEBUG::2014-05-16 17:29:24,899::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54003::DEBUG::2014-05-16 17:29:24,899::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54003::DEBUG::2014-05-16 17:29:24,899::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54003::DEBUG::2014-05-16 17:29:24,899::task::974::TaskManager.Task::(_decref) Task=`24ced483-90df-4199-ae40-9c299dee6d60`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:29:24,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:25,032::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341084 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:27,044::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:27,112::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308888 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:29,123::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:29,197::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366319 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:31,208::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:31,280::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034347 s, 29.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:29:32,787::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:29:32,798::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104424 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:33,292::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:33,362::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348134 s, 29.4 MB/s\n'; <rc> = 0 >Thread-54007::DEBUG::2014-05-16 17:29:34,127::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4310625.000000 / 8.009501 / 262500000.000000 = 0.205024 >Thread-54007::DEBUG::2014-05-16 17:29:34,128::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053560200222395552, 'statsAge': 1.2258720397949219, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20502436558357504, 'rxDropped': 0} >Thread-54007::DEBUG::2014-05-16 17:29:34,128::task::579::TaskManager.Task::(_updateState) Task=`77043827-9b40-40a6-ab67-6f12f3187515`::moving from state init -> state preparing >Thread-54007::INFO::2014-05-16 17:29:34,129::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54007::INFO::2014-05-16 17:29:34,129::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104424', 'lastCheck': '1.3', 'valid': True}} >Thread-54007::DEBUG::2014-05-16 17:29:34,129::task::1168::TaskManager.Task::(prepare) Task=`77043827-9b40-40a6-ab67-6f12f3187515`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104424', 'lastCheck': '1.3', 'valid': True}} >Thread-54007::DEBUG::2014-05-16 17:29:34,129::task::579::TaskManager.Task::(_updateState) Task=`77043827-9b40-40a6-ab67-6f12f3187515`::moving from state preparing -> state finished >Thread-54007::DEBUG::2014-05-16 17:29:34,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54007::DEBUG::2014-05-16 17:29:34,129::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54007::DEBUG::2014-05-16 17:29:34,130::task::974::TaskManager.Task::(_decref) Task=`77043827-9b40-40a6-ab67-6f12f3187515`::ref 0 aborting False >Thread-54009::DEBUG::2014-05-16 17:29:34,966::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54009::DEBUG::2014-05-16 17:29:34,967::task::579::TaskManager.Task::(_updateState) Task=`46a26655-576d-4217-833a-94f33ba69bd0`::moving from state init -> state preparing >Thread-54009::INFO::2014-05-16 17:29:34,967::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54009::INFO::2014-05-16 17:29:34,967::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54009::DEBUG::2014-05-16 17:29:34,967::task::1168::TaskManager.Task::(prepare) Task=`46a26655-576d-4217-833a-94f33ba69bd0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54009::DEBUG::2014-05-16 17:29:34,967::task::579::TaskManager.Task::(_updateState) Task=`46a26655-576d-4217-833a-94f33ba69bd0`::moving from state preparing -> state finished >Thread-54009::DEBUG::2014-05-16 17:29:34,968::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54009::DEBUG::2014-05-16 17:29:34,968::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54009::DEBUG::2014-05-16 17:29:34,968::task::974::TaskManager.Task::(_decref) Task=`46a26655-576d-4217-833a-94f33ba69bd0`::ref 0 aborting False >Thread-54010::DEBUG::2014-05-16 17:29:34,976::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54010::DEBUG::2014-05-16 17:29:34,976::task::579::TaskManager.Task::(_updateState) Task=`590a2611-28d1-46d7-b970-7a35f8c3333d`::moving from state init -> state preparing >Thread-54010::INFO::2014-05-16 17:29:34,976::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54010::DEBUG::2014-05-16 17:29:34,976::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e1de0dff-2b53-4ef4-90c3-ffe5e11a98f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54010::DEBUG::2014-05-16 17:29:34,977::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54010::DEBUG::2014-05-16 17:29:34,977::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54010::DEBUG::2014-05-16 17:29:34,977::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e1de0dff-2b53-4ef4-90c3-ffe5e11a98f5`::Granted request >Thread-54010::DEBUG::2014-05-16 17:29:34,977::task::811::TaskManager.Task::(resourceAcquired) Task=`590a2611-28d1-46d7-b970-7a35f8c3333d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54010::DEBUG::2014-05-16 17:29:34,977::task::974::TaskManager.Task::(_decref) Task=`590a2611-28d1-46d7-b970-7a35f8c3333d`::ref 1 aborting False >Thread-54010::INFO::2014-05-16 17:29:34,978::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54010::DEBUG::2014-05-16 17:29:34,978::task::1168::TaskManager.Task::(prepare) Task=`590a2611-28d1-46d7-b970-7a35f8c3333d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54010::DEBUG::2014-05-16 17:29:34,978::task::579::TaskManager.Task::(_updateState) Task=`590a2611-28d1-46d7-b970-7a35f8c3333d`::moving from state preparing -> state finished >Thread-54010::DEBUG::2014-05-16 17:29:34,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54010::DEBUG::2014-05-16 17:29:34,978::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54010::DEBUG::2014-05-16 17:29:34,979::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54010::DEBUG::2014-05-16 17:29:34,979::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54010::DEBUG::2014-05-16 17:29:34,979::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54010::DEBUG::2014-05-16 17:29:34,979::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54010::DEBUG::2014-05-16 17:29:34,979::task::974::TaskManager.Task::(_decref) Task=`590a2611-28d1-46d7-b970-7a35f8c3333d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:29:35,373::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:35,441::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313258 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:37,452::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:37,519::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306598 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:39,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:39,604::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354166 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:41,615::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:41,682::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305173 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:29:42,833::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:29:42,843::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000763656 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:43,694::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:43,765::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349588 s, 29.3 MB/s\n'; <rc> = 0 >Thread-54014::DEBUG::2014-05-16 17:29:45,017::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54014::DEBUG::2014-05-16 17:29:45,018::task::579::TaskManager.Task::(_updateState) Task=`fb7d66fd-4118-44d1-b7d8-589440ff4acd`::moving from state init -> state preparing >Thread-54014::INFO::2014-05-16 17:29:45,018::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54014::INFO::2014-05-16 17:29:45,018::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54014::DEBUG::2014-05-16 17:29:45,018::task::1168::TaskManager.Task::(prepare) Task=`fb7d66fd-4118-44d1-b7d8-589440ff4acd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54014::DEBUG::2014-05-16 17:29:45,019::task::579::TaskManager.Task::(_updateState) Task=`fb7d66fd-4118-44d1-b7d8-589440ff4acd`::moving from state preparing -> state finished >Thread-54014::DEBUG::2014-05-16 17:29:45,019::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54014::DEBUG::2014-05-16 17:29:45,019::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54014::DEBUG::2014-05-16 17:29:45,019::task::974::TaskManager.Task::(_decref) Task=`fb7d66fd-4118-44d1-b7d8-589440ff4acd`::ref 0 aborting False >Thread-54015::DEBUG::2014-05-16 17:29:45,028::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54015::DEBUG::2014-05-16 17:29:45,028::task::579::TaskManager.Task::(_updateState) Task=`17df91ee-8029-4e25-9d4b-bd2542af5f54`::moving from state init -> state preparing >Thread-54015::INFO::2014-05-16 17:29:45,028::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54015::DEBUG::2014-05-16 17:29:45,029::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4e4f6b03-b7bb-40b4-b55e-09c448d19424`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54015::DEBUG::2014-05-16 17:29:45,029::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54015::DEBUG::2014-05-16 17:29:45,029::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54015::DEBUG::2014-05-16 17:29:45,029::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4e4f6b03-b7bb-40b4-b55e-09c448d19424`::Granted request >Thread-54015::DEBUG::2014-05-16 17:29:45,029::task::811::TaskManager.Task::(resourceAcquired) Task=`17df91ee-8029-4e25-9d4b-bd2542af5f54`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54015::DEBUG::2014-05-16 17:29:45,030::task::974::TaskManager.Task::(_decref) Task=`17df91ee-8029-4e25-9d4b-bd2542af5f54`::ref 1 aborting False >Thread-54015::INFO::2014-05-16 17:29:45,030::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54015::DEBUG::2014-05-16 17:29:45,030::task::1168::TaskManager.Task::(prepare) Task=`17df91ee-8029-4e25-9d4b-bd2542af5f54`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54015::DEBUG::2014-05-16 17:29:45,031::task::579::TaskManager.Task::(_updateState) Task=`17df91ee-8029-4e25-9d4b-bd2542af5f54`::moving from state preparing -> state finished >Thread-54015::DEBUG::2014-05-16 17:29:45,031::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54015::DEBUG::2014-05-16 17:29:45,031::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54015::DEBUG::2014-05-16 17:29:45,031::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54015::DEBUG::2014-05-16 17:29:45,031::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54015::DEBUG::2014-05-16 17:29:45,032::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54015::DEBUG::2014-05-16 17:29:45,032::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54015::DEBUG::2014-05-16 17:29:45,032::task::974::TaskManager.Task::(_decref) Task=`17df91ee-8029-4e25-9d4b-bd2542af5f54`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:29:45,777::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:45,846::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340831 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:47,858::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:47,924::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302853 s, 33.8 MB/s\n'; <rc> = 0 >Thread-54017::DEBUG::2014-05-16 17:29:49,368::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5411567.000000 / 8.008042 / 262500000.000000 = 0.257435 >Thread-54017::DEBUG::2014-05-16 17:29:49,368::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065933719328443172, 'statsAge': 0.45026397705078125, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25743487713208169, 'rxDropped': 0} >Thread-54017::DEBUG::2014-05-16 17:29:49,369::task::579::TaskManager.Task::(_updateState) Task=`e261d7a1-0a60-482b-894f-1fa18d2b91ac`::moving from state init -> state preparing >Thread-54017::INFO::2014-05-16 17:29:49,369::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54017::INFO::2014-05-16 17:29:49,369::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000763656', 'lastCheck': '6.5', 'valid': True}} >Thread-54017::DEBUG::2014-05-16 17:29:49,369::task::1168::TaskManager.Task::(prepare) Task=`e261d7a1-0a60-482b-894f-1fa18d2b91ac`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000763656', 'lastCheck': '6.5', 'valid': True}} >Thread-54017::DEBUG::2014-05-16 17:29:49,369::task::579::TaskManager.Task::(_updateState) Task=`e261d7a1-0a60-482b-894f-1fa18d2b91ac`::moving from state preparing -> state finished >Thread-54017::DEBUG::2014-05-16 17:29:49,369::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54017::DEBUG::2014-05-16 17:29:49,370::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54017::DEBUG::2014-05-16 17:29:49,370::task::974::TaskManager.Task::(_decref) Task=`e261d7a1-0a60-482b-894f-1fa18d2b91ac`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:29:49,936::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:50,003::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03155 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:52,015::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:52,087::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365248 s, 28.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:29:52,879::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:29:52,889::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650981 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:54,099::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:54,171::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363598 s, 28.2 MB/s\n'; <rc> = 0 >Thread-54020::DEBUG::2014-05-16 17:29:55,121::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54020::DEBUG::2014-05-16 17:29:55,121::task::579::TaskManager.Task::(_updateState) Task=`355efb90-14b9-4caf-8a09-abf8ff9fead9`::moving from state init -> state preparing >Thread-54020::INFO::2014-05-16 17:29:55,122::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54020::INFO::2014-05-16 17:29:55,122::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54020::DEBUG::2014-05-16 17:29:55,122::task::1168::TaskManager.Task::(prepare) Task=`355efb90-14b9-4caf-8a09-abf8ff9fead9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54020::DEBUG::2014-05-16 17:29:55,122::task::579::TaskManager.Task::(_updateState) Task=`355efb90-14b9-4caf-8a09-abf8ff9fead9`::moving from state preparing -> state finished >Thread-54020::DEBUG::2014-05-16 17:29:55,122::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54020::DEBUG::2014-05-16 17:29:55,123::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54020::DEBUG::2014-05-16 17:29:55,123::task::974::TaskManager.Task::(_decref) Task=`355efb90-14b9-4caf-8a09-abf8ff9fead9`::ref 0 aborting False >Thread-54021::DEBUG::2014-05-16 17:29:55,131::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54021::DEBUG::2014-05-16 17:29:55,131::task::579::TaskManager.Task::(_updateState) Task=`fbd8a494-86c0-4733-a037-3915975bfef9`::moving from state init -> state preparing >Thread-54021::INFO::2014-05-16 17:29:55,132::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54021::DEBUG::2014-05-16 17:29:55,132::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ec7759b3-7e1f-4271-87c3-fda56878cf6a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54021::DEBUG::2014-05-16 17:29:55,132::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54021::DEBUG::2014-05-16 17:29:55,132::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54021::DEBUG::2014-05-16 17:29:55,132::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ec7759b3-7e1f-4271-87c3-fda56878cf6a`::Granted request >Thread-54021::DEBUG::2014-05-16 17:29:55,133::task::811::TaskManager.Task::(resourceAcquired) Task=`fbd8a494-86c0-4733-a037-3915975bfef9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54021::DEBUG::2014-05-16 17:29:55,133::task::974::TaskManager.Task::(_decref) Task=`fbd8a494-86c0-4733-a037-3915975bfef9`::ref 1 aborting False >Thread-54021::INFO::2014-05-16 17:29:55,134::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54021::DEBUG::2014-05-16 17:29:55,134::task::1168::TaskManager.Task::(prepare) Task=`fbd8a494-86c0-4733-a037-3915975bfef9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54021::DEBUG::2014-05-16 17:29:55,134::task::579::TaskManager.Task::(_updateState) Task=`fbd8a494-86c0-4733-a037-3915975bfef9`::moving from state preparing -> state finished >Thread-54021::DEBUG::2014-05-16 17:29:55,134::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54021::DEBUG::2014-05-16 17:29:55,134::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54021::DEBUG::2014-05-16 17:29:55,135::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54021::DEBUG::2014-05-16 17:29:55,135::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54021::DEBUG::2014-05-16 17:29:55,135::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54021::DEBUG::2014-05-16 17:29:55,135::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54021::DEBUG::2014-05-16 17:29:55,135::task::974::TaskManager.Task::(_decref) Task=`fbd8a494-86c0-4733-a037-3915975bfef9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:29:56,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:56,250::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313687 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:29:58,262::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:29:58,334::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356355 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:00,346::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:00,417::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358144 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:02,429::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:02,496::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306921 s, 33.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:30:02,926::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:30:02,940::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699377 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:04,507::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54025::DEBUG::2014-05-16 17:30:04,569::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4305829.000000 / 8.009588 / 262500000.000000 = 0.204794 >Thread-54025::DEBUG::2014-05-16 17:30:04,570::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053547252168562962, 'statsAge': 1.635200023651123, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20479403046410793, 'rxDropped': 0} >Thread-54025::DEBUG::2014-05-16 17:30:04,573::task::579::TaskManager.Task::(_updateState) Task=`3cdff33b-e322-4f11-bf69-e1ccb6020824`::moving from state init -> state preparing >Thread-54025::INFO::2014-05-16 17:30:04,574::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54025::INFO::2014-05-16 17:30:04,575::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699377', 'lastCheck': '1.6', 'valid': True}} >Thread-54025::DEBUG::2014-05-16 17:30:04,576::task::1168::TaskManager.Task::(prepare) Task=`3cdff33b-e322-4f11-bf69-e1ccb6020824`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699377', 'lastCheck': '1.6', 'valid': True}} >Thread-54025::DEBUG::2014-05-16 17:30:04,577::task::579::TaskManager.Task::(_updateState) Task=`3cdff33b-e322-4f11-bf69-e1ccb6020824`::moving from state preparing -> state finished >Thread-54025::DEBUG::2014-05-16 17:30:04,578::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54025::DEBUG::2014-05-16 17:30:04,578::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54025::DEBUG::2014-05-16 17:30:04,579::task::974::TaskManager.Task::(_decref) Task=`3cdff33b-e322-4f11-bf69-e1ccb6020824`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:30:04,603::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318916 s, 32.1 MB/s\n'; <rc> = 0 >Thread-54027::DEBUG::2014-05-16 17:30:05,173::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54027::DEBUG::2014-05-16 17:30:05,174::task::579::TaskManager.Task::(_updateState) Task=`488dd0eb-1858-43ae-bfb4-a96ca735eb1a`::moving from state init -> state preparing >Thread-54027::INFO::2014-05-16 17:30:05,174::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54027::INFO::2014-05-16 17:30:05,174::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54027::DEBUG::2014-05-16 17:30:05,175::task::1168::TaskManager.Task::(prepare) Task=`488dd0eb-1858-43ae-bfb4-a96ca735eb1a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54027::DEBUG::2014-05-16 17:30:05,175::task::579::TaskManager.Task::(_updateState) Task=`488dd0eb-1858-43ae-bfb4-a96ca735eb1a`::moving from state preparing -> state finished >Thread-54027::DEBUG::2014-05-16 17:30:05,175::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54027::DEBUG::2014-05-16 17:30:05,175::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54027::DEBUG::2014-05-16 17:30:05,175::task::974::TaskManager.Task::(_decref) Task=`488dd0eb-1858-43ae-bfb4-a96ca735eb1a`::ref 0 aborting False >Thread-54028::DEBUG::2014-05-16 17:30:05,184::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54028::DEBUG::2014-05-16 17:30:05,184::task::579::TaskManager.Task::(_updateState) Task=`28116853-5d5a-45d5-8ce5-dabfb3abf8c2`::moving from state init -> state preparing >Thread-54028::INFO::2014-05-16 17:30:05,184::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54028::DEBUG::2014-05-16 17:30:05,184::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fc3799a1-78aa-46db-a99a-17894e35cd71`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54028::DEBUG::2014-05-16 17:30:05,185::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54028::DEBUG::2014-05-16 17:30:05,185::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54028::DEBUG::2014-05-16 17:30:05,185::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fc3799a1-78aa-46db-a99a-17894e35cd71`::Granted request >Thread-54028::DEBUG::2014-05-16 17:30:05,185::task::811::TaskManager.Task::(resourceAcquired) Task=`28116853-5d5a-45d5-8ce5-dabfb3abf8c2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54028::DEBUG::2014-05-16 17:30:05,185::task::974::TaskManager.Task::(_decref) Task=`28116853-5d5a-45d5-8ce5-dabfb3abf8c2`::ref 1 aborting False >Thread-54028::INFO::2014-05-16 17:30:05,186::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54028::DEBUG::2014-05-16 17:30:05,186::task::1168::TaskManager.Task::(prepare) Task=`28116853-5d5a-45d5-8ce5-dabfb3abf8c2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54028::DEBUG::2014-05-16 17:30:05,186::task::579::TaskManager.Task::(_updateState) Task=`28116853-5d5a-45d5-8ce5-dabfb3abf8c2`::moving from state preparing -> state finished >Thread-54028::DEBUG::2014-05-16 17:30:05,187::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54028::DEBUG::2014-05-16 17:30:05,187::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54028::DEBUG::2014-05-16 17:30:05,187::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54028::DEBUG::2014-05-16 17:30:05,187::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54028::DEBUG::2014-05-16 17:30:05,187::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54028::DEBUG::2014-05-16 17:30:05,187::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54028::DEBUG::2014-05-16 17:30:05,188::task::974::TaskManager.Task::(_decref) Task=`28116853-5d5a-45d5-8ce5-dabfb3abf8c2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:30:06,615::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:06,686::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345717 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:08,698::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:08,770::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362003 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:10,782::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:10,850::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322407 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:12,862::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:12,934::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357951 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:30:12,976::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:30:12,986::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000745157 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:14,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:15,019::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361335 s, 28.3 MB/s\n'; <rc> = 0 >Thread-54032::DEBUG::2014-05-16 17:30:15,254::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54032::DEBUG::2014-05-16 17:30:15,254::task::579::TaskManager.Task::(_updateState) Task=`909b7494-34a8-46f7-ba88-78fb4bba84ab`::moving from state init -> state preparing >Thread-54032::INFO::2014-05-16 17:30:15,255::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54032::INFO::2014-05-16 17:30:15,255::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54032::DEBUG::2014-05-16 17:30:15,255::task::1168::TaskManager.Task::(prepare) Task=`909b7494-34a8-46f7-ba88-78fb4bba84ab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54032::DEBUG::2014-05-16 17:30:15,255::task::579::TaskManager.Task::(_updateState) Task=`909b7494-34a8-46f7-ba88-78fb4bba84ab`::moving from state preparing -> state finished >Thread-54032::DEBUG::2014-05-16 17:30:15,255::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54032::DEBUG::2014-05-16 17:30:15,255::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54032::DEBUG::2014-05-16 17:30:15,256::task::974::TaskManager.Task::(_decref) Task=`909b7494-34a8-46f7-ba88-78fb4bba84ab`::ref 0 aborting False >Thread-54033::DEBUG::2014-05-16 17:30:15,264::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54033::DEBUG::2014-05-16 17:30:15,264::task::579::TaskManager.Task::(_updateState) Task=`495aae91-7277-4554-ba3a-855378763ef8`::moving from state init -> state preparing >Thread-54033::INFO::2014-05-16 17:30:15,264::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54033::DEBUG::2014-05-16 17:30:15,265::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`47e9085b-0487-4505-9cdf-0eb626ae1383`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54033::DEBUG::2014-05-16 17:30:15,265::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54033::DEBUG::2014-05-16 17:30:15,265::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54033::DEBUG::2014-05-16 17:30:15,265::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`47e9085b-0487-4505-9cdf-0eb626ae1383`::Granted request >Thread-54033::DEBUG::2014-05-16 17:30:15,266::task::811::TaskManager.Task::(resourceAcquired) Task=`495aae91-7277-4554-ba3a-855378763ef8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54033::DEBUG::2014-05-16 17:30:15,266::task::974::TaskManager.Task::(_decref) Task=`495aae91-7277-4554-ba3a-855378763ef8`::ref 1 aborting False >Thread-54033::INFO::2014-05-16 17:30:15,267::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54033::DEBUG::2014-05-16 17:30:15,267::task::1168::TaskManager.Task::(prepare) Task=`495aae91-7277-4554-ba3a-855378763ef8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54033::DEBUG::2014-05-16 17:30:15,267::task::579::TaskManager.Task::(_updateState) Task=`495aae91-7277-4554-ba3a-855378763ef8`::moving from state preparing -> state finished >Thread-54033::DEBUG::2014-05-16 17:30:15,267::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54033::DEBUG::2014-05-16 17:30:15,267::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54033::DEBUG::2014-05-16 17:30:15,267::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54033::DEBUG::2014-05-16 17:30:15,268::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54033::DEBUG::2014-05-16 17:30:15,268::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54033::DEBUG::2014-05-16 17:30:15,268::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54033::DEBUG::2014-05-16 17:30:15,268::task::974::TaskManager.Task::(_decref) Task=`495aae91-7277-4554-ba3a-855378763ef8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:30:17,032::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:17,099::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310758 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:19,110::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:19,182::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356638 s, 28.7 MB/s\n'; <rc> = 0 >Thread-54035::DEBUG::2014-05-16 17:30:19,759::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4312837.000000 / 8.013304 / 262500000.000000 = 0.205032 >Thread-54035::DEBUG::2014-05-16 17:30:19,759::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052766534998688382, 'statsAge': 0.80047821998596191, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20503222201572899, 'rxDropped': 0} >Thread-54035::DEBUG::2014-05-16 17:30:19,760::task::579::TaskManager.Task::(_updateState) Task=`604261bf-1c6c-4635-af22-b0e285387db1`::moving from state init -> state preparing >Thread-54035::INFO::2014-05-16 17:30:19,760::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54035::INFO::2014-05-16 17:30:19,760::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745157', 'lastCheck': '6.8', 'valid': True}} >Thread-54035::DEBUG::2014-05-16 17:30:19,760::task::1168::TaskManager.Task::(prepare) Task=`604261bf-1c6c-4635-af22-b0e285387db1`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745157', 'lastCheck': '6.8', 'valid': True}} >Thread-54035::DEBUG::2014-05-16 17:30:19,760::task::579::TaskManager.Task::(_updateState) Task=`604261bf-1c6c-4635-af22-b0e285387db1`::moving from state preparing -> state finished >Thread-54035::DEBUG::2014-05-16 17:30:19,761::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54035::DEBUG::2014-05-16 17:30:19,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54035::DEBUG::2014-05-16 17:30:19,761::task::974::TaskManager.Task::(_decref) Task=`604261bf-1c6c-4635-af22-b0e285387db1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:30:21,193::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:21,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304298 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:30:23,021::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:30:23,031::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109176 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:23,272::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:23,342::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347736 s, 29.4 MB/s\n'; <rc> = 0 >Thread-54038::DEBUG::2014-05-16 17:30:25,308::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54038::DEBUG::2014-05-16 17:30:25,308::task::579::TaskManager.Task::(_updateState) Task=`0f667808-7c28-4730-aafa-f05381ece0e6`::moving from state init -> state preparing >Thread-54038::INFO::2014-05-16 17:30:25,309::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54038::INFO::2014-05-16 17:30:25,309::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54038::DEBUG::2014-05-16 17:30:25,309::task::1168::TaskManager.Task::(prepare) Task=`0f667808-7c28-4730-aafa-f05381ece0e6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54038::DEBUG::2014-05-16 17:30:25,309::task::579::TaskManager.Task::(_updateState) Task=`0f667808-7c28-4730-aafa-f05381ece0e6`::moving from state preparing -> state finished >Thread-54038::DEBUG::2014-05-16 17:30:25,309::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54038::DEBUG::2014-05-16 17:30:25,310::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54038::DEBUG::2014-05-16 17:30:25,310::task::974::TaskManager.Task::(_decref) Task=`0f667808-7c28-4730-aafa-f05381ece0e6`::ref 0 aborting False >Thread-54039::DEBUG::2014-05-16 17:30:25,318::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54039::DEBUG::2014-05-16 17:30:25,318::task::579::TaskManager.Task::(_updateState) Task=`59b60c33-2b1c-465c-a886-df22944536b1`::moving from state init -> state preparing >Thread-54039::INFO::2014-05-16 17:30:25,318::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54039::DEBUG::2014-05-16 17:30:25,319::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bf585a05-3274-469a-a0f8-23f8c1c5739d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54039::DEBUG::2014-05-16 17:30:25,319::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54039::DEBUG::2014-05-16 17:30:25,319::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54039::DEBUG::2014-05-16 17:30:25,319::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bf585a05-3274-469a-a0f8-23f8c1c5739d`::Granted request >Thread-54039::DEBUG::2014-05-16 17:30:25,320::task::811::TaskManager.Task::(resourceAcquired) Task=`59b60c33-2b1c-465c-a886-df22944536b1`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54039::DEBUG::2014-05-16 17:30:25,320::task::974::TaskManager.Task::(_decref) Task=`59b60c33-2b1c-465c-a886-df22944536b1`::ref 1 aborting False >Thread-54039::INFO::2014-05-16 17:30:25,321::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54039::DEBUG::2014-05-16 17:30:25,321::task::1168::TaskManager.Task::(prepare) Task=`59b60c33-2b1c-465c-a886-df22944536b1`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54039::DEBUG::2014-05-16 17:30:25,321::task::579::TaskManager.Task::(_updateState) Task=`59b60c33-2b1c-465c-a886-df22944536b1`::moving from state preparing -> state finished >Thread-54039::DEBUG::2014-05-16 17:30:25,321::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54039::DEBUG::2014-05-16 17:30:25,321::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54039::DEBUG::2014-05-16 17:30:25,322::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54039::DEBUG::2014-05-16 17:30:25,322::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54039::DEBUG::2014-05-16 17:30:25,322::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54039::DEBUG::2014-05-16 17:30:25,322::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54039::DEBUG::2014-05-16 17:30:25,322::task::974::TaskManager.Task::(_decref) Task=`59b60c33-2b1c-465c-a886-df22944536b1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:30:25,354::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:25,423::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329376 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:27,434::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:27,505::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346281 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:29,516::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:29,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362403 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:31,600::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:31,667::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306218 s, 33.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:30:33,070::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:30:33,080::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624227 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:33,678::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:33,750::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356825 s, 28.7 MB/s\n'; <rc> = 0 >Thread-54043::DEBUG::2014-05-16 17:30:34,987::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4310071.000000 / 8.012824 / 262500000.000000 = 0.204913 >Thread-54043::DEBUG::2014-05-16 17:30:34,988::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0050530427925753194, 'statsAge': 0.0080120563507080078, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20491299915356875, 'rxDropped': 0} >Thread-54043::DEBUG::2014-05-16 17:30:34,988::task::579::TaskManager.Task::(_updateState) Task=`b3dfe98f-1b8a-46e4-a1db-9089a2d45960`::moving from state init -> state preparing >Thread-54043::INFO::2014-05-16 17:30:34,988::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54043::INFO::2014-05-16 17:30:34,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624227', 'lastCheck': '1.9', 'valid': True}} >Thread-54043::DEBUG::2014-05-16 17:30:34,989::task::1168::TaskManager.Task::(prepare) Task=`b3dfe98f-1b8a-46e4-a1db-9089a2d45960`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624227', 'lastCheck': '1.9', 'valid': True}} >Thread-54043::DEBUG::2014-05-16 17:30:34,989::task::579::TaskManager.Task::(_updateState) Task=`b3dfe98f-1b8a-46e4-a1db-9089a2d45960`::moving from state preparing -> state finished >Thread-54043::DEBUG::2014-05-16 17:30:34,989::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54043::DEBUG::2014-05-16 17:30:34,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54043::DEBUG::2014-05-16 17:30:34,989::task::974::TaskManager.Task::(_decref) Task=`b3dfe98f-1b8a-46e4-a1db-9089a2d45960`::ref 0 aborting False >Thread-54045::DEBUG::2014-05-16 17:30:35,727::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54045::DEBUG::2014-05-16 17:30:35,727::task::579::TaskManager.Task::(_updateState) Task=`0e7e18bc-3b2f-4b96-8adf-eb852b402a1b`::moving from state init -> state preparing >Thread-54045::INFO::2014-05-16 17:30:35,727::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54045::INFO::2014-05-16 17:30:35,728::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54045::DEBUG::2014-05-16 17:30:35,728::task::1168::TaskManager.Task::(prepare) Task=`0e7e18bc-3b2f-4b96-8adf-eb852b402a1b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54045::DEBUG::2014-05-16 17:30:35,728::task::579::TaskManager.Task::(_updateState) Task=`0e7e18bc-3b2f-4b96-8adf-eb852b402a1b`::moving from state preparing -> state finished >Thread-54045::DEBUG::2014-05-16 17:30:35,728::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54045::DEBUG::2014-05-16 17:30:35,728::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54045::DEBUG::2014-05-16 17:30:35,728::task::974::TaskManager.Task::(_decref) Task=`0e7e18bc-3b2f-4b96-8adf-eb852b402a1b`::ref 0 aborting False >Thread-54046::DEBUG::2014-05-16 17:30:35,738::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54046::DEBUG::2014-05-16 17:30:35,738::task::579::TaskManager.Task::(_updateState) Task=`c8cd4011-3a2c-4fe7-8f39-2be81d396766`::moving from state init -> state preparing >Thread-54046::INFO::2014-05-16 17:30:35,738::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54046::DEBUG::2014-05-16 17:30:35,738::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c4a1d2f4-eca3-456f-97a2-84c85eeecbba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54046::DEBUG::2014-05-16 17:30:35,739::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54046::DEBUG::2014-05-16 17:30:35,739::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54046::DEBUG::2014-05-16 17:30:35,739::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c4a1d2f4-eca3-456f-97a2-84c85eeecbba`::Granted request >Thread-54046::DEBUG::2014-05-16 17:30:35,739::task::811::TaskManager.Task::(resourceAcquired) Task=`c8cd4011-3a2c-4fe7-8f39-2be81d396766`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54046::DEBUG::2014-05-16 17:30:35,739::task::974::TaskManager.Task::(_decref) Task=`c8cd4011-3a2c-4fe7-8f39-2be81d396766`::ref 1 aborting False >Thread-54046::INFO::2014-05-16 17:30:35,740::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54046::DEBUG::2014-05-16 17:30:35,740::task::1168::TaskManager.Task::(prepare) Task=`c8cd4011-3a2c-4fe7-8f39-2be81d396766`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54046::DEBUG::2014-05-16 17:30:35,740::task::579::TaskManager.Task::(_updateState) Task=`c8cd4011-3a2c-4fe7-8f39-2be81d396766`::moving from state preparing -> state finished >Thread-54046::DEBUG::2014-05-16 17:30:35,740::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54046::DEBUG::2014-05-16 17:30:35,740::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54046::DEBUG::2014-05-16 17:30:35,741::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54046::DEBUG::2014-05-16 17:30:35,741::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54046::DEBUG::2014-05-16 17:30:35,741::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54046::DEBUG::2014-05-16 17:30:35,741::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54046::DEBUG::2014-05-16 17:30:35,741::task::974::TaskManager.Task::(_decref) Task=`c8cd4011-3a2c-4fe7-8f39-2be81d396766`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:30:35,762::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:35,831::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321063 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:37,842::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:37,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312382 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:39,923::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:39,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360575 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:42,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:42,074::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313032 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:30:43,117::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:30:43,127::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000797396 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:44,086::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:44,166::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370172 s, 27.7 MB/s\n'; <rc> = 0 >Thread-54050::DEBUG::2014-05-16 17:30:45,770::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54050::DEBUG::2014-05-16 17:30:45,771::task::579::TaskManager.Task::(_updateState) Task=`6dfc168c-4e09-4bae-933f-fbdc88ce705f`::moving from state init -> state preparing >Thread-54050::INFO::2014-05-16 17:30:45,771::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54050::INFO::2014-05-16 17:30:45,771::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54050::DEBUG::2014-05-16 17:30:45,772::task::1168::TaskManager.Task::(prepare) Task=`6dfc168c-4e09-4bae-933f-fbdc88ce705f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54050::DEBUG::2014-05-16 17:30:45,772::task::579::TaskManager.Task::(_updateState) Task=`6dfc168c-4e09-4bae-933f-fbdc88ce705f`::moving from state preparing -> state finished >Thread-54050::DEBUG::2014-05-16 17:30:45,772::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54050::DEBUG::2014-05-16 17:30:45,772::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54050::DEBUG::2014-05-16 17:30:45,772::task::974::TaskManager.Task::(_decref) Task=`6dfc168c-4e09-4bae-933f-fbdc88ce705f`::ref 0 aborting False >Thread-54051::DEBUG::2014-05-16 17:30:45,808::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54051::DEBUG::2014-05-16 17:30:45,808::task::579::TaskManager.Task::(_updateState) Task=`2979a75f-aba5-4765-bcd9-f1082cb0d8bf`::moving from state init -> state preparing >Thread-54051::INFO::2014-05-16 17:30:45,808::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54051::DEBUG::2014-05-16 17:30:45,809::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`59cad80b-4cc3-4712-8e36-de76ee12a3ef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54051::DEBUG::2014-05-16 17:30:45,809::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54051::DEBUG::2014-05-16 17:30:45,809::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54051::DEBUG::2014-05-16 17:30:45,809::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`59cad80b-4cc3-4712-8e36-de76ee12a3ef`::Granted request >Thread-54051::DEBUG::2014-05-16 17:30:45,809::task::811::TaskManager.Task::(resourceAcquired) Task=`2979a75f-aba5-4765-bcd9-f1082cb0d8bf`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54051::DEBUG::2014-05-16 17:30:45,810::task::974::TaskManager.Task::(_decref) Task=`2979a75f-aba5-4765-bcd9-f1082cb0d8bf`::ref 1 aborting False >Thread-54051::INFO::2014-05-16 17:30:45,810::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54051::DEBUG::2014-05-16 17:30:45,810::task::1168::TaskManager.Task::(prepare) Task=`2979a75f-aba5-4765-bcd9-f1082cb0d8bf`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54051::DEBUG::2014-05-16 17:30:45,811::task::579::TaskManager.Task::(_updateState) Task=`2979a75f-aba5-4765-bcd9-f1082cb0d8bf`::moving from state preparing -> state finished >Thread-54051::DEBUG::2014-05-16 17:30:45,811::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54051::DEBUG::2014-05-16 17:30:45,811::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54051::DEBUG::2014-05-16 17:30:45,811::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54051::DEBUG::2014-05-16 17:30:45,811::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54051::DEBUG::2014-05-16 17:30:45,811::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54051::DEBUG::2014-05-16 17:30:45,812::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54051::DEBUG::2014-05-16 17:30:45,812::task::974::TaskManager.Task::(_decref) Task=`2979a75f-aba5-4765-bcd9-f1082cb0d8bf`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:30:46,178::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:46,249::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351915 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:48,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:48,328::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308744 s, 33.2 MB/s\n'; <rc> = 0 >Thread-54053::DEBUG::2014-05-16 17:30:50,169::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5416769.000000 / 8.008372 / 262500000.000000 = 0.257672 >Thread-54053::DEBUG::2014-05-16 17:30:50,169::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0068187688619858293, 'statsAge': 1.175123929977417, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25767172528860727, 'rxDropped': 0} >Thread-54053::DEBUG::2014-05-16 17:30:50,170::task::579::TaskManager.Task::(_updateState) Task=`e9091275-e019-4009-9210-67c4fe84cf5f`::moving from state init -> state preparing >Thread-54053::INFO::2014-05-16 17:30:50,170::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54053::INFO::2014-05-16 17:30:50,170::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797396', 'lastCheck': '7.0', 'valid': True}} >Thread-54053::DEBUG::2014-05-16 17:30:50,170::task::1168::TaskManager.Task::(prepare) Task=`e9091275-e019-4009-9210-67c4fe84cf5f`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797396', 'lastCheck': '7.0', 'valid': True}} >Thread-54053::DEBUG::2014-05-16 17:30:50,171::task::579::TaskManager.Task::(_updateState) Task=`e9091275-e019-4009-9210-67c4fe84cf5f`::moving from state preparing -> state finished >Thread-54053::DEBUG::2014-05-16 17:30:50,171::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54053::DEBUG::2014-05-16 17:30:50,171::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54053::DEBUG::2014-05-16 17:30:50,171::task::974::TaskManager.Task::(_decref) Task=`e9091275-e019-4009-9210-67c4fe84cf5f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:30:50,340::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:50,407::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312868 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:52,418::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:52,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312212 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:30:53,163::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:30:53,174::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000552175 s, 7.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:54,498::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:54,569::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355822 s, 28.8 MB/s\n'; <rc> = 0 >Thread-54056::DEBUG::2014-05-16 17:30:56,045::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54056::DEBUG::2014-05-16 17:30:56,045::task::579::TaskManager.Task::(_updateState) Task=`750600d9-2502-4ac0-93bc-6969313c8e78`::moving from state init -> state preparing >Thread-54056::INFO::2014-05-16 17:30:56,046::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54056::INFO::2014-05-16 17:30:56,046::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54056::DEBUG::2014-05-16 17:30:56,046::task::1168::TaskManager.Task::(prepare) Task=`750600d9-2502-4ac0-93bc-6969313c8e78`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54056::DEBUG::2014-05-16 17:30:56,046::task::579::TaskManager.Task::(_updateState) Task=`750600d9-2502-4ac0-93bc-6969313c8e78`::moving from state preparing -> state finished >Thread-54056::DEBUG::2014-05-16 17:30:56,046::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54056::DEBUG::2014-05-16 17:30:56,046::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54056::DEBUG::2014-05-16 17:30:56,047::task::974::TaskManager.Task::(_decref) Task=`750600d9-2502-4ac0-93bc-6969313c8e78`::ref 0 aborting False >Thread-54057::DEBUG::2014-05-16 17:30:56,055::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54057::DEBUG::2014-05-16 17:30:56,056::task::579::TaskManager.Task::(_updateState) Task=`b79d3111-b1c9-4989-943f-c035646b4b69`::moving from state init -> state preparing >Thread-54057::INFO::2014-05-16 17:30:56,056::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54057::DEBUG::2014-05-16 17:30:56,057::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`eca573a3-669b-4d66-8013-1cf49e044628`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54057::DEBUG::2014-05-16 17:30:56,057::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54057::DEBUG::2014-05-16 17:30:56,057::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54057::DEBUG::2014-05-16 17:30:56,057::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`eca573a3-669b-4d66-8013-1cf49e044628`::Granted request >Thread-54057::DEBUG::2014-05-16 17:30:56,058::task::811::TaskManager.Task::(resourceAcquired) Task=`b79d3111-b1c9-4989-943f-c035646b4b69`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54057::DEBUG::2014-05-16 17:30:56,058::task::974::TaskManager.Task::(_decref) Task=`b79d3111-b1c9-4989-943f-c035646b4b69`::ref 1 aborting False >Thread-54057::INFO::2014-05-16 17:30:56,058::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54057::DEBUG::2014-05-16 17:30:56,059::task::1168::TaskManager.Task::(prepare) Task=`b79d3111-b1c9-4989-943f-c035646b4b69`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54057::DEBUG::2014-05-16 17:30:56,059::task::579::TaskManager.Task::(_updateState) Task=`b79d3111-b1c9-4989-943f-c035646b4b69`::moving from state preparing -> state finished >Thread-54057::DEBUG::2014-05-16 17:30:56,059::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54057::DEBUG::2014-05-16 17:30:56,059::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54057::DEBUG::2014-05-16 17:30:56,059::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54057::DEBUG::2014-05-16 17:30:56,059::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54057::DEBUG::2014-05-16 17:30:56,059::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54057::DEBUG::2014-05-16 17:30:56,060::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54057::DEBUG::2014-05-16 17:30:56,060::task::974::TaskManager.Task::(_decref) Task=`b79d3111-b1c9-4989-943f-c035646b4b69`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:30:56,581::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:56,648::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308842 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:30:58,659::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:30:58,727::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307037 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:00,738::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:00,810::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361675 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:02,822::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:02,889::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316207 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:31:03,211::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:31:03,221::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000797006 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:04,901::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:04,970::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315633 s, 32.4 MB/s\n'; <rc> = 0 >Thread-54061::DEBUG::2014-05-16 17:31:05,337::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3233985.000000 / 8.008374 / 262500000.000000 = 0.153838 >Thread-54061::DEBUG::2014-05-16 17:31:05,337::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0038446422989924494, 'statsAge': 0.32604598999023438, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15383825598608172, 'rxDropped': 0} >Thread-54061::DEBUG::2014-05-16 17:31:05,338::task::579::TaskManager.Task::(_updateState) Task=`abf4b40f-dc12-4f84-9874-5cbb80d6e9bc`::moving from state init -> state preparing >Thread-54061::INFO::2014-05-16 17:31:05,338::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54061::INFO::2014-05-16 17:31:05,338::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797006', 'lastCheck': '2.1', 'valid': True}} >Thread-54061::DEBUG::2014-05-16 17:31:05,338::task::1168::TaskManager.Task::(prepare) Task=`abf4b40f-dc12-4f84-9874-5cbb80d6e9bc`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797006', 'lastCheck': '2.1', 'valid': True}} >Thread-54061::DEBUG::2014-05-16 17:31:05,339::task::579::TaskManager.Task::(_updateState) Task=`abf4b40f-dc12-4f84-9874-5cbb80d6e9bc`::moving from state preparing -> state finished >Thread-54061::DEBUG::2014-05-16 17:31:05,339::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54061::DEBUG::2014-05-16 17:31:05,339::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54061::DEBUG::2014-05-16 17:31:05,339::task::974::TaskManager.Task::(_decref) Task=`abf4b40f-dc12-4f84-9874-5cbb80d6e9bc`::ref 0 aborting False >Thread-54063::DEBUG::2014-05-16 17:31:06,094::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54063::DEBUG::2014-05-16 17:31:06,094::task::579::TaskManager.Task::(_updateState) Task=`4d1f43d5-0e11-47f9-81f6-925a72ac5039`::moving from state init -> state preparing >Thread-54063::INFO::2014-05-16 17:31:06,094::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54063::INFO::2014-05-16 17:31:06,095::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54063::DEBUG::2014-05-16 17:31:06,095::task::1168::TaskManager.Task::(prepare) Task=`4d1f43d5-0e11-47f9-81f6-925a72ac5039`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54063::DEBUG::2014-05-16 17:31:06,095::task::579::TaskManager.Task::(_updateState) Task=`4d1f43d5-0e11-47f9-81f6-925a72ac5039`::moving from state preparing -> state finished >Thread-54063::DEBUG::2014-05-16 17:31:06,095::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54063::DEBUG::2014-05-16 17:31:06,095::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54063::DEBUG::2014-05-16 17:31:06,095::task::974::TaskManager.Task::(_decref) Task=`4d1f43d5-0e11-47f9-81f6-925a72ac5039`::ref 0 aborting False >Thread-54064::DEBUG::2014-05-16 17:31:06,106::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54064::DEBUG::2014-05-16 17:31:06,106::task::579::TaskManager.Task::(_updateState) Task=`28b89f22-ff3a-4f3b-97a2-aef2c6616966`::moving from state init -> state preparing >Thread-54064::INFO::2014-05-16 17:31:06,106::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54064::DEBUG::2014-05-16 17:31:06,107::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a2087331-872c-4d9d-8d74-5866c228137c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54064::DEBUG::2014-05-16 17:31:06,107::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54064::DEBUG::2014-05-16 17:31:06,107::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54064::DEBUG::2014-05-16 17:31:06,107::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a2087331-872c-4d9d-8d74-5866c228137c`::Granted request >Thread-54064::DEBUG::2014-05-16 17:31:06,108::task::811::TaskManager.Task::(resourceAcquired) Task=`28b89f22-ff3a-4f3b-97a2-aef2c6616966`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54064::DEBUG::2014-05-16 17:31:06,108::task::974::TaskManager.Task::(_decref) Task=`28b89f22-ff3a-4f3b-97a2-aef2c6616966`::ref 1 aborting False >Thread-54064::INFO::2014-05-16 17:31:06,108::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54064::DEBUG::2014-05-16 17:31:06,108::task::1168::TaskManager.Task::(prepare) Task=`28b89f22-ff3a-4f3b-97a2-aef2c6616966`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54064::DEBUG::2014-05-16 17:31:06,109::task::579::TaskManager.Task::(_updateState) Task=`28b89f22-ff3a-4f3b-97a2-aef2c6616966`::moving from state preparing -> state finished >Thread-54064::DEBUG::2014-05-16 17:31:06,109::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54064::DEBUG::2014-05-16 17:31:06,109::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54064::DEBUG::2014-05-16 17:31:06,109::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54064::DEBUG::2014-05-16 17:31:06,109::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54064::DEBUG::2014-05-16 17:31:06,110::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54064::DEBUG::2014-05-16 17:31:06,110::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54064::DEBUG::2014-05-16 17:31:06,110::task::974::TaskManager.Task::(_decref) Task=`28b89f22-ff3a-4f3b-97a2-aef2c6616966`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:31:06,982::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:07,058::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390983 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:09,070::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:09,142::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362845 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:11,154::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:11,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315328 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:13,234::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 17:31:13,369::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:31:13,404::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703788 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:13,492::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.219495 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:15,503::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:15,575::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355287 s, 28.8 MB/s\n'; <rc> = 0 >Thread-54068::DEBUG::2014-05-16 17:31:16,136::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54068::DEBUG::2014-05-16 17:31:16,136::task::579::TaskManager.Task::(_updateState) Task=`e8bed71f-7e82-441d-87fe-8b8caeab1e15`::moving from state init -> state preparing >Thread-54068::INFO::2014-05-16 17:31:16,136::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54068::INFO::2014-05-16 17:31:16,137::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54068::DEBUG::2014-05-16 17:31:16,137::task::1168::TaskManager.Task::(prepare) Task=`e8bed71f-7e82-441d-87fe-8b8caeab1e15`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54068::DEBUG::2014-05-16 17:31:16,137::task::579::TaskManager.Task::(_updateState) Task=`e8bed71f-7e82-441d-87fe-8b8caeab1e15`::moving from state preparing -> state finished >Thread-54068::DEBUG::2014-05-16 17:31:16,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54068::DEBUG::2014-05-16 17:31:16,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54068::DEBUG::2014-05-16 17:31:16,137::task::974::TaskManager.Task::(_decref) Task=`e8bed71f-7e82-441d-87fe-8b8caeab1e15`::ref 0 aborting False >Thread-54069::DEBUG::2014-05-16 17:31:16,146::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54069::DEBUG::2014-05-16 17:31:16,146::task::579::TaskManager.Task::(_updateState) Task=`88fb492f-b60a-4376-a8d4-bafd2b460002`::moving from state init -> state preparing >Thread-54069::INFO::2014-05-16 17:31:16,146::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54069::DEBUG::2014-05-16 17:31:16,147::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3167b02d-a973-4335-b95e-b5044f140d23`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54069::DEBUG::2014-05-16 17:31:16,147::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54069::DEBUG::2014-05-16 17:31:16,147::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54069::DEBUG::2014-05-16 17:31:16,147::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3167b02d-a973-4335-b95e-b5044f140d23`::Granted request >Thread-54069::DEBUG::2014-05-16 17:31:16,148::task::811::TaskManager.Task::(resourceAcquired) Task=`88fb492f-b60a-4376-a8d4-bafd2b460002`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54069::DEBUG::2014-05-16 17:31:16,148::task::974::TaskManager.Task::(_decref) Task=`88fb492f-b60a-4376-a8d4-bafd2b460002`::ref 1 aborting False >Thread-54069::INFO::2014-05-16 17:31:16,148::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54069::DEBUG::2014-05-16 17:31:16,149::task::1168::TaskManager.Task::(prepare) Task=`88fb492f-b60a-4376-a8d4-bafd2b460002`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54069::DEBUG::2014-05-16 17:31:16,149::task::579::TaskManager.Task::(_updateState) Task=`88fb492f-b60a-4376-a8d4-bafd2b460002`::moving from state preparing -> state finished >Thread-54069::DEBUG::2014-05-16 17:31:16,149::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54069::DEBUG::2014-05-16 17:31:16,149::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54069::DEBUG::2014-05-16 17:31:16,149::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54069::DEBUG::2014-05-16 17:31:16,149::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54069::DEBUG::2014-05-16 17:31:16,150::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54069::DEBUG::2014-05-16 17:31:16,150::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54069::DEBUG::2014-05-16 17:31:16,150::task::974::TaskManager.Task::(_decref) Task=`88fb492f-b60a-4376-a8d4-bafd2b460002`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:31:17,587::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:17,654::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315149 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:19,666::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:19,733::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312115 s, 32.8 MB/s\n'; <rc> = 0 >Thread-54071::DEBUG::2014-05-16 17:31:20,485::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317055.000000 / 8.008146 / 262500000.000000 = 0.205365 >Thread-54071::DEBUG::2014-05-16 17:31:20,486::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053448432958031807, 'statsAge': 1.4570140838623047, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20536493355373636, 'rxDropped': 0} >Thread-54071::DEBUG::2014-05-16 17:31:20,486::task::579::TaskManager.Task::(_updateState) Task=`6203153a-66ef-4ca3-8066-dde9d061bd05`::moving from state init -> state preparing >Thread-54071::INFO::2014-05-16 17:31:20,486::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54071::INFO::2014-05-16 17:31:20,487::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703788', 'lastCheck': '7.0', 'valid': True}} >Thread-54071::DEBUG::2014-05-16 17:31:20,487::task::1168::TaskManager.Task::(prepare) Task=`6203153a-66ef-4ca3-8066-dde9d061bd05`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703788', 'lastCheck': '7.0', 'valid': True}} >Thread-54071::DEBUG::2014-05-16 17:31:20,487::task::579::TaskManager.Task::(_updateState) Task=`6203153a-66ef-4ca3-8066-dde9d061bd05`::moving from state preparing -> state finished >Thread-54071::DEBUG::2014-05-16 17:31:20,487::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54071::DEBUG::2014-05-16 17:31:20,487::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54071::DEBUG::2014-05-16 17:31:20,487::task::974::TaskManager.Task::(_decref) Task=`6203153a-66ef-4ca3-8066-dde9d061bd05`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:31:21,745::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:21,816::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353933 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:31:23,454::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 17:31:23,454::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:31:23,468::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:31:23,477::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000692908 s, 3.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:31:23,477::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000692908 s, 3.0 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 17:31:23,477::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 17:31:23,478::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 17:31:23,478::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:31:23,478::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:31:23,478::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:31:23,478::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:31:23,479::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:31:23,479::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:31:23,480::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:31:23,630::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:31:23,632::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:31:23,632::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 17:31:23,633::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 17:31:23,633::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 17:31:23,633::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 17:31:23,634::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:31:23,777::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:31:23,797::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:31:23,807::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000578465 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:23,828::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:23,897::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340632 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:25,909::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:25,977::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317168 s, 32.3 MB/s\n'; <rc> = 0 >Thread-54074::DEBUG::2014-05-16 17:31:26,184::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54074::DEBUG::2014-05-16 17:31:26,184::task::579::TaskManager.Task::(_updateState) Task=`4b34b68f-dbbe-4570-b2dd-d049eb0cf740`::moving from state init -> state preparing >Thread-54074::INFO::2014-05-16 17:31:26,185::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54074::INFO::2014-05-16 17:31:26,185::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54074::DEBUG::2014-05-16 17:31:26,185::task::1168::TaskManager.Task::(prepare) Task=`4b34b68f-dbbe-4570-b2dd-d049eb0cf740`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54074::DEBUG::2014-05-16 17:31:26,185::task::579::TaskManager.Task::(_updateState) Task=`4b34b68f-dbbe-4570-b2dd-d049eb0cf740`::moving from state preparing -> state finished >Thread-54074::DEBUG::2014-05-16 17:31:26,185::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54074::DEBUG::2014-05-16 17:31:26,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54074::DEBUG::2014-05-16 17:31:26,186::task::974::TaskManager.Task::(_decref) Task=`4b34b68f-dbbe-4570-b2dd-d049eb0cf740`::ref 0 aborting False >Thread-54075::DEBUG::2014-05-16 17:31:26,194::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54075::DEBUG::2014-05-16 17:31:26,194::task::579::TaskManager.Task::(_updateState) Task=`e67a8da7-1e92-486d-9edf-7ce4d99ab3a5`::moving from state init -> state preparing >Thread-54075::INFO::2014-05-16 17:31:26,195::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54075::DEBUG::2014-05-16 17:31:26,195::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`94379798-046c-4e6e-b3e0-023fea1370d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54075::DEBUG::2014-05-16 17:31:26,195::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54075::DEBUG::2014-05-16 17:31:26,195::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54075::DEBUG::2014-05-16 17:31:26,196::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`94379798-046c-4e6e-b3e0-023fea1370d4`::Granted request >Thread-54075::DEBUG::2014-05-16 17:31:26,196::task::811::TaskManager.Task::(resourceAcquired) Task=`e67a8da7-1e92-486d-9edf-7ce4d99ab3a5`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54075::DEBUG::2014-05-16 17:31:26,196::task::974::TaskManager.Task::(_decref) Task=`e67a8da7-1e92-486d-9edf-7ce4d99ab3a5`::ref 1 aborting False >Thread-54075::INFO::2014-05-16 17:31:26,197::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54075::DEBUG::2014-05-16 17:31:26,197::task::1168::TaskManager.Task::(prepare) Task=`e67a8da7-1e92-486d-9edf-7ce4d99ab3a5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54075::DEBUG::2014-05-16 17:31:26,197::task::579::TaskManager.Task::(_updateState) Task=`e67a8da7-1e92-486d-9edf-7ce4d99ab3a5`::moving from state preparing -> state finished >Thread-54075::DEBUG::2014-05-16 17:31:26,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54075::DEBUG::2014-05-16 17:31:26,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54075::DEBUG::2014-05-16 17:31:26,198::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54075::DEBUG::2014-05-16 17:31:26,198::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54075::DEBUG::2014-05-16 17:31:26,198::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54075::DEBUG::2014-05-16 17:31:26,198::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54075::DEBUG::2014-05-16 17:31:26,198::task::974::TaskManager.Task::(_decref) Task=`e67a8da7-1e92-486d-9edf-7ce4d99ab3a5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:31:27,988::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:28,059::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340923 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:30,071::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:30,142::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357492 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:32,154::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:32,221::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307743 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:31:33,843::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:31:33,854::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105163 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:34,233::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:34,304::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350356 s, 29.2 MB/s\n'; <rc> = 0 >Thread-54079::DEBUG::2014-05-16 17:31:35,689::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5412575.000000 / 8.008965 / 262500000.000000 = 0.257453 >Thread-54079::DEBUG::2014-05-16 17:31:35,689::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0063300492335261905, 'statsAge': 0.64355087280273438, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25745315772582672, 'rxDropped': 0} >Thread-54079::DEBUG::2014-05-16 17:31:35,690::task::579::TaskManager.Task::(_updateState) Task=`6b76f5d2-c1f8-4aba-aa7f-5c7c1671418e`::moving from state init -> state preparing >Thread-54079::INFO::2014-05-16 17:31:35,690::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54079::INFO::2014-05-16 17:31:35,690::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105163', 'lastCheck': '1.8', 'valid': True}} >Thread-54079::DEBUG::2014-05-16 17:31:35,690::task::1168::TaskManager.Task::(prepare) Task=`6b76f5d2-c1f8-4aba-aa7f-5c7c1671418e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105163', 'lastCheck': '1.8', 'valid': True}} >Thread-54079::DEBUG::2014-05-16 17:31:35,691::task::579::TaskManager.Task::(_updateState) Task=`6b76f5d2-c1f8-4aba-aa7f-5c7c1671418e`::moving from state preparing -> state finished >Thread-54079::DEBUG::2014-05-16 17:31:35,691::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54079::DEBUG::2014-05-16 17:31:35,691::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54079::DEBUG::2014-05-16 17:31:35,691::task::974::TaskManager.Task::(_decref) Task=`6b76f5d2-c1f8-4aba-aa7f-5c7c1671418e`::ref 0 aborting False >Thread-54081::DEBUG::2014-05-16 17:31:36,270::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54081::DEBUG::2014-05-16 17:31:36,270::task::579::TaskManager.Task::(_updateState) Task=`2f20d97e-344b-41be-9e6b-a742c945532f`::moving from state init -> state preparing >Thread-54081::INFO::2014-05-16 17:31:36,270::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54081::INFO::2014-05-16 17:31:36,270::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54081::DEBUG::2014-05-16 17:31:36,270::task::1168::TaskManager.Task::(prepare) Task=`2f20d97e-344b-41be-9e6b-a742c945532f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54081::DEBUG::2014-05-16 17:31:36,270::task::579::TaskManager.Task::(_updateState) Task=`2f20d97e-344b-41be-9e6b-a742c945532f`::moving from state preparing -> state finished >Thread-54081::DEBUG::2014-05-16 17:31:36,271::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54081::DEBUG::2014-05-16 17:31:36,271::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54081::DEBUG::2014-05-16 17:31:36,271::task::974::TaskManager.Task::(_decref) Task=`2f20d97e-344b-41be-9e6b-a742c945532f`::ref 0 aborting False >Thread-54082::DEBUG::2014-05-16 17:31:36,279::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54082::DEBUG::2014-05-16 17:31:36,280::task::579::TaskManager.Task::(_updateState) Task=`2635b837-e042-48b3-a3a6-2bae829140c8`::moving from state init -> state preparing >Thread-54082::INFO::2014-05-16 17:31:36,280::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54082::DEBUG::2014-05-16 17:31:36,280::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bda76bb7-5d66-443c-95f9-813a9e7960b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54082::DEBUG::2014-05-16 17:31:36,280::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54082::DEBUG::2014-05-16 17:31:36,280::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54082::DEBUG::2014-05-16 17:31:36,281::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bda76bb7-5d66-443c-95f9-813a9e7960b1`::Granted request >Thread-54082::DEBUG::2014-05-16 17:31:36,281::task::811::TaskManager.Task::(resourceAcquired) Task=`2635b837-e042-48b3-a3a6-2bae829140c8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54082::DEBUG::2014-05-16 17:31:36,281::task::974::TaskManager.Task::(_decref) Task=`2635b837-e042-48b3-a3a6-2bae829140c8`::ref 1 aborting False >Thread-54082::INFO::2014-05-16 17:31:36,281::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54082::DEBUG::2014-05-16 17:31:36,282::task::1168::TaskManager.Task::(prepare) Task=`2635b837-e042-48b3-a3a6-2bae829140c8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54082::DEBUG::2014-05-16 17:31:36,282::task::579::TaskManager.Task::(_updateState) Task=`2635b837-e042-48b3-a3a6-2bae829140c8`::moving from state preparing -> state finished >Thread-54082::DEBUG::2014-05-16 17:31:36,282::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54082::DEBUG::2014-05-16 17:31:36,282::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54082::DEBUG::2014-05-16 17:31:36,282::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54082::DEBUG::2014-05-16 17:31:36,282::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54082::DEBUG::2014-05-16 17:31:36,282::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54082::DEBUG::2014-05-16 17:31:36,283::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54082::DEBUG::2014-05-16 17:31:36,283::task::974::TaskManager.Task::(_decref) Task=`2635b837-e042-48b3-a3a6-2bae829140c8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:31:36,316::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:36,383::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314389 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:38,395::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:38,461::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306724 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:40,473::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:40,540::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310712 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:42,551::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:42,622::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349128 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:31:43,888::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:31:43,898::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107286 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:44,634::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:44,706::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357857 s, 28.6 MB/s\n'; <rc> = 0 >Thread-54086::DEBUG::2014-05-16 17:31:46,313::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54086::DEBUG::2014-05-16 17:31:46,313::task::579::TaskManager.Task::(_updateState) Task=`5565664d-6dc6-43dd-b79f-e6e298724823`::moving from state init -> state preparing >Thread-54086::INFO::2014-05-16 17:31:46,313::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54086::INFO::2014-05-16 17:31:46,314::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54086::DEBUG::2014-05-16 17:31:46,314::task::1168::TaskManager.Task::(prepare) Task=`5565664d-6dc6-43dd-b79f-e6e298724823`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54086::DEBUG::2014-05-16 17:31:46,314::task::579::TaskManager.Task::(_updateState) Task=`5565664d-6dc6-43dd-b79f-e6e298724823`::moving from state preparing -> state finished >Thread-54086::DEBUG::2014-05-16 17:31:46,314::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54086::DEBUG::2014-05-16 17:31:46,314::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54086::DEBUG::2014-05-16 17:31:46,314::task::974::TaskManager.Task::(_decref) Task=`5565664d-6dc6-43dd-b79f-e6e298724823`::ref 0 aborting False >Thread-54087::DEBUG::2014-05-16 17:31:46,323::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54087::DEBUG::2014-05-16 17:31:46,324::task::579::TaskManager.Task::(_updateState) Task=`90f36780-bed2-4a85-899d-f098fed0923e`::moving from state init -> state preparing >Thread-54087::INFO::2014-05-16 17:31:46,324::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54087::DEBUG::2014-05-16 17:31:46,324::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f15c5e76-1048-4bc3-b208-60ee422e19a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54087::DEBUG::2014-05-16 17:31:46,324::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54087::DEBUG::2014-05-16 17:31:46,325::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54087::DEBUG::2014-05-16 17:31:46,325::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f15c5e76-1048-4bc3-b208-60ee422e19a8`::Granted request >Thread-54087::DEBUG::2014-05-16 17:31:46,325::task::811::TaskManager.Task::(resourceAcquired) Task=`90f36780-bed2-4a85-899d-f098fed0923e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54087::DEBUG::2014-05-16 17:31:46,325::task::974::TaskManager.Task::(_decref) Task=`90f36780-bed2-4a85-899d-f098fed0923e`::ref 1 aborting False >Thread-54087::INFO::2014-05-16 17:31:46,326::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54087::DEBUG::2014-05-16 17:31:46,326::task::1168::TaskManager.Task::(prepare) Task=`90f36780-bed2-4a85-899d-f098fed0923e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54087::DEBUG::2014-05-16 17:31:46,326::task::579::TaskManager.Task::(_updateState) Task=`90f36780-bed2-4a85-899d-f098fed0923e`::moving from state preparing -> state finished >Thread-54087::DEBUG::2014-05-16 17:31:46,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54087::DEBUG::2014-05-16 17:31:46,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54087::DEBUG::2014-05-16 17:31:46,327::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54087::DEBUG::2014-05-16 17:31:46,327::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54087::DEBUG::2014-05-16 17:31:46,327::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54087::DEBUG::2014-05-16 17:31:46,327::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54087::DEBUG::2014-05-16 17:31:46,327::task::974::TaskManager.Task::(_decref) Task=`90f36780-bed2-4a85-899d-f098fed0923e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:31:46,718::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:46,786::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309281 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:48,798::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:48,869::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034546 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:50,881::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54089::DEBUG::2014-05-16 17:31:50,891::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4338449.000000 / 8.008585 / 262500000.000000 = 0.206371 >Thread-54089::DEBUG::2014-05-16 17:31:50,891::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054352149701550568, 'statsAge': 1.8301610946655273, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20637134788516076, 'rxDropped': 0} >Thread-54089::DEBUG::2014-05-16 17:31:50,891::task::579::TaskManager.Task::(_updateState) Task=`5dcdf513-feea-4cd7-81aa-3adac151d95e`::moving from state init -> state preparing >Thread-54089::INFO::2014-05-16 17:31:50,892::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54089::INFO::2014-05-16 17:31:50,892::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107286', 'lastCheck': '7.0', 'valid': True}} >Thread-54089::DEBUG::2014-05-16 17:31:50,892::task::1168::TaskManager.Task::(prepare) Task=`5dcdf513-feea-4cd7-81aa-3adac151d95e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107286', 'lastCheck': '7.0', 'valid': True}} >Thread-54089::DEBUG::2014-05-16 17:31:50,892::task::579::TaskManager.Task::(_updateState) Task=`5dcdf513-feea-4cd7-81aa-3adac151d95e`::moving from state preparing -> state finished >Thread-54089::DEBUG::2014-05-16 17:31:50,892::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54089::DEBUG::2014-05-16 17:31:50,892::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54089::DEBUG::2014-05-16 17:31:50,892::task::974::TaskManager.Task::(_decref) Task=`5dcdf513-feea-4cd7-81aa-3adac151d95e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:31:50,951::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341917 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:52,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:53,031::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030805 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:31:53,935::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:31:53,945::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000757698 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:55,043::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:55,119::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398317 s, 25.7 MB/s\n'; <rc> = 0 >Thread-54092::DEBUG::2014-05-16 17:31:56,394::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54092::DEBUG::2014-05-16 17:31:56,394::task::579::TaskManager.Task::(_updateState) Task=`3f4a231c-d500-4bed-9226-0764d0063d01`::moving from state init -> state preparing >Thread-54092::INFO::2014-05-16 17:31:56,394::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54092::INFO::2014-05-16 17:31:56,395::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54092::DEBUG::2014-05-16 17:31:56,395::task::1168::TaskManager.Task::(prepare) Task=`3f4a231c-d500-4bed-9226-0764d0063d01`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54092::DEBUG::2014-05-16 17:31:56,395::task::579::TaskManager.Task::(_updateState) Task=`3f4a231c-d500-4bed-9226-0764d0063d01`::moving from state preparing -> state finished >Thread-54092::DEBUG::2014-05-16 17:31:56,395::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54092::DEBUG::2014-05-16 17:31:56,395::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54092::DEBUG::2014-05-16 17:31:56,395::task::974::TaskManager.Task::(_decref) Task=`3f4a231c-d500-4bed-9226-0764d0063d01`::ref 0 aborting False >Thread-54093::DEBUG::2014-05-16 17:31:56,404::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54093::DEBUG::2014-05-16 17:31:56,404::task::579::TaskManager.Task::(_updateState) Task=`a683feb3-08d1-40e7-909f-24790c00408e`::moving from state init -> state preparing >Thread-54093::INFO::2014-05-16 17:31:56,404::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54093::DEBUG::2014-05-16 17:31:56,405::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b9585d4f-d6f5-41d0-be9d-081062f91497`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54093::DEBUG::2014-05-16 17:31:56,405::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54093::DEBUG::2014-05-16 17:31:56,405::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54093::DEBUG::2014-05-16 17:31:56,405::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b9585d4f-d6f5-41d0-be9d-081062f91497`::Granted request >Thread-54093::DEBUG::2014-05-16 17:31:56,406::task::811::TaskManager.Task::(resourceAcquired) Task=`a683feb3-08d1-40e7-909f-24790c00408e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54093::DEBUG::2014-05-16 17:31:56,406::task::974::TaskManager.Task::(_decref) Task=`a683feb3-08d1-40e7-909f-24790c00408e`::ref 1 aborting False >Thread-54093::INFO::2014-05-16 17:31:56,406::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54093::DEBUG::2014-05-16 17:31:56,406::task::1168::TaskManager.Task::(prepare) Task=`a683feb3-08d1-40e7-909f-24790c00408e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54093::DEBUG::2014-05-16 17:31:56,407::task::579::TaskManager.Task::(_updateState) Task=`a683feb3-08d1-40e7-909f-24790c00408e`::moving from state preparing -> state finished >Thread-54093::DEBUG::2014-05-16 17:31:56,407::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54093::DEBUG::2014-05-16 17:31:56,407::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54093::DEBUG::2014-05-16 17:31:56,407::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54093::DEBUG::2014-05-16 17:31:56,407::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54093::DEBUG::2014-05-16 17:31:56,407::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54093::DEBUG::2014-05-16 17:31:56,407::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54093::DEBUG::2014-05-16 17:31:56,408::task::974::TaskManager.Task::(_decref) Task=`a683feb3-08d1-40e7-909f-24790c00408e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:31:57,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:57,198::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306891 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:31:59,209::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:31:59,283::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367852 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:01,295::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:01,366::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350013 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:03,378::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:03,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305764 s, 33.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:32:03,987::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:32:03,998::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000812806 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:05,456::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:05,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313325 s, 32.7 MB/s\n'; <rc> = 0 >Thread-54097::DEBUG::2014-05-16 17:32:06,143::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4307255.000000 / 8.008127 / 262500000.000000 = 0.204899 >Thread-54097::DEBUG::2014-05-16 17:32:06,143::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051306926361299084, 'statsAge': 1.0630600452423096, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.204899229610712, 'rxDropped': 0} >Thread-54097::DEBUG::2014-05-16 17:32:06,143::task::579::TaskManager.Task::(_updateState) Task=`dafb7e95-504d-4e52-97a6-49e1a97a1fa9`::moving from state init -> state preparing >Thread-54097::INFO::2014-05-16 17:32:06,144::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54097::INFO::2014-05-16 17:32:06,144::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000812806', 'lastCheck': '2.1', 'valid': True}} >Thread-54097::DEBUG::2014-05-16 17:32:06,144::task::1168::TaskManager.Task::(prepare) Task=`dafb7e95-504d-4e52-97a6-49e1a97a1fa9`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000812806', 'lastCheck': '2.1', 'valid': True}} >Thread-54097::DEBUG::2014-05-16 17:32:06,144::task::579::TaskManager.Task::(_updateState) Task=`dafb7e95-504d-4e52-97a6-49e1a97a1fa9`::moving from state preparing -> state finished >Thread-54097::DEBUG::2014-05-16 17:32:06,144::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54097::DEBUG::2014-05-16 17:32:06,145::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54097::DEBUG::2014-05-16 17:32:06,145::task::974::TaskManager.Task::(_decref) Task=`dafb7e95-504d-4e52-97a6-49e1a97a1fa9`::ref 0 aborting False >Thread-54099::DEBUG::2014-05-16 17:32:06,445::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54099::DEBUG::2014-05-16 17:32:06,446::task::579::TaskManager.Task::(_updateState) Task=`7ca52e17-f2f8-4d86-8ca8-252da27d5d84`::moving from state init -> state preparing >Thread-54099::INFO::2014-05-16 17:32:06,446::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54099::INFO::2014-05-16 17:32:06,446::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54099::DEBUG::2014-05-16 17:32:06,446::task::1168::TaskManager.Task::(prepare) Task=`7ca52e17-f2f8-4d86-8ca8-252da27d5d84`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54099::DEBUG::2014-05-16 17:32:06,446::task::579::TaskManager.Task::(_updateState) Task=`7ca52e17-f2f8-4d86-8ca8-252da27d5d84`::moving from state preparing -> state finished >Thread-54099::DEBUG::2014-05-16 17:32:06,446::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54099::DEBUG::2014-05-16 17:32:06,447::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54099::DEBUG::2014-05-16 17:32:06,447::task::974::TaskManager.Task::(_decref) Task=`7ca52e17-f2f8-4d86-8ca8-252da27d5d84`::ref 0 aborting False >Thread-54100::DEBUG::2014-05-16 17:32:06,457::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54100::DEBUG::2014-05-16 17:32:06,457::task::579::TaskManager.Task::(_updateState) Task=`3dbe704e-9299-443c-84f6-c6d11fd6ff44`::moving from state init -> state preparing >Thread-54100::INFO::2014-05-16 17:32:06,457::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54100::DEBUG::2014-05-16 17:32:06,458::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ee630a04-82aa-4343-965b-b331231092cc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54100::DEBUG::2014-05-16 17:32:06,458::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54100::DEBUG::2014-05-16 17:32:06,458::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54100::DEBUG::2014-05-16 17:32:06,458::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ee630a04-82aa-4343-965b-b331231092cc`::Granted request >Thread-54100::DEBUG::2014-05-16 17:32:06,458::task::811::TaskManager.Task::(resourceAcquired) Task=`3dbe704e-9299-443c-84f6-c6d11fd6ff44`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54100::DEBUG::2014-05-16 17:32:06,459::task::974::TaskManager.Task::(_decref) Task=`3dbe704e-9299-443c-84f6-c6d11fd6ff44`::ref 1 aborting False >Thread-54100::INFO::2014-05-16 17:32:06,459::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54100::DEBUG::2014-05-16 17:32:06,459::task::1168::TaskManager.Task::(prepare) Task=`3dbe704e-9299-443c-84f6-c6d11fd6ff44`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54100::DEBUG::2014-05-16 17:32:06,460::task::579::TaskManager.Task::(_updateState) Task=`3dbe704e-9299-443c-84f6-c6d11fd6ff44`::moving from state preparing -> state finished >Thread-54100::DEBUG::2014-05-16 17:32:06,460::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54100::DEBUG::2014-05-16 17:32:06,460::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54100::DEBUG::2014-05-16 17:32:06,460::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54100::DEBUG::2014-05-16 17:32:06,460::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54100::DEBUG::2014-05-16 17:32:06,460::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54100::DEBUG::2014-05-16 17:32:06,460::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54100::DEBUG::2014-05-16 17:32:06,461::task::974::TaskManager.Task::(_decref) Task=`3dbe704e-9299-443c-84f6-c6d11fd6ff44`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:32:07,535::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:07,601::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305117 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:09,613::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:09,684::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347079 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:11,695::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:11,761::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307891 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:13,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:13,841::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308408 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:32:14,036::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:32:14,046::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731513 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:15,852::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:15,924::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352927 s, 29.0 MB/s\n'; <rc> = 0 >Thread-54104::DEBUG::2014-05-16 17:32:16,492::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54104::DEBUG::2014-05-16 17:32:16,493::task::579::TaskManager.Task::(_updateState) Task=`68b191d1-f9d3-4e07-b8be-9eba75242f52`::moving from state init -> state preparing >Thread-54104::INFO::2014-05-16 17:32:16,493::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54104::INFO::2014-05-16 17:32:16,493::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54104::DEBUG::2014-05-16 17:32:16,493::task::1168::TaskManager.Task::(prepare) Task=`68b191d1-f9d3-4e07-b8be-9eba75242f52`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54104::DEBUG::2014-05-16 17:32:16,493::task::579::TaskManager.Task::(_updateState) Task=`68b191d1-f9d3-4e07-b8be-9eba75242f52`::moving from state preparing -> state finished >Thread-54104::DEBUG::2014-05-16 17:32:16,494::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54104::DEBUG::2014-05-16 17:32:16,494::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54104::DEBUG::2014-05-16 17:32:16,494::task::974::TaskManager.Task::(_decref) Task=`68b191d1-f9d3-4e07-b8be-9eba75242f52`::ref 0 aborting False >Thread-54105::DEBUG::2014-05-16 17:32:16,503::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54105::DEBUG::2014-05-16 17:32:16,503::task::579::TaskManager.Task::(_updateState) Task=`9d0b8b57-b1ad-4128-b1e3-9a036a4b9ac2`::moving from state init -> state preparing >Thread-54105::INFO::2014-05-16 17:32:16,504::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54105::DEBUG::2014-05-16 17:32:16,504::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9fd65e77-4750-416f-a04f-a23f16c28f01`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54105::DEBUG::2014-05-16 17:32:16,504::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54105::DEBUG::2014-05-16 17:32:16,504::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54105::DEBUG::2014-05-16 17:32:16,504::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9fd65e77-4750-416f-a04f-a23f16c28f01`::Granted request >Thread-54105::DEBUG::2014-05-16 17:32:16,505::task::811::TaskManager.Task::(resourceAcquired) Task=`9d0b8b57-b1ad-4128-b1e3-9a036a4b9ac2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54105::DEBUG::2014-05-16 17:32:16,505::task::974::TaskManager.Task::(_decref) Task=`9d0b8b57-b1ad-4128-b1e3-9a036a4b9ac2`::ref 1 aborting False >Thread-54105::INFO::2014-05-16 17:32:16,505::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54105::DEBUG::2014-05-16 17:32:16,506::task::1168::TaskManager.Task::(prepare) Task=`9d0b8b57-b1ad-4128-b1e3-9a036a4b9ac2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54105::DEBUG::2014-05-16 17:32:16,506::task::579::TaskManager.Task::(_updateState) Task=`9d0b8b57-b1ad-4128-b1e3-9a036a4b9ac2`::moving from state preparing -> state finished >Thread-54105::DEBUG::2014-05-16 17:32:16,506::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54105::DEBUG::2014-05-16 17:32:16,506::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54105::DEBUG::2014-05-16 17:32:16,506::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54105::DEBUG::2014-05-16 17:32:16,506::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54105::DEBUG::2014-05-16 17:32:16,507::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54105::DEBUG::2014-05-16 17:32:16,507::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54105::DEBUG::2014-05-16 17:32:16,507::task::974::TaskManager.Task::(_decref) Task=`9d0b8b57-b1ad-4128-b1e3-9a036a4b9ac2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:32:17,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:18,002::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307841 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:20,013::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:20,083::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319533 s, 32.0 MB/s\n'; <rc> = 0 >Thread-54107::DEBUG::2014-05-16 17:32:21,302::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313860.000000 / 8.008315 / 262500000.000000 = 0.205209 >Thread-54107::DEBUG::2014-05-16 17:32:21,303::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052998247707474857, 'statsAge': 0.20512485504150391, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20520861384354239, 'rxDropped': 0} >Thread-54107::DEBUG::2014-05-16 17:32:21,305::task::579::TaskManager.Task::(_updateState) Task=`fda0edf4-617d-4e10-998b-4dd4be96cb9f`::moving from state init -> state preparing >Thread-54107::INFO::2014-05-16 17:32:21,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54107::INFO::2014-05-16 17:32:21,307::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731513', 'lastCheck': '7.2', 'valid': True}} >Thread-54107::DEBUG::2014-05-16 17:32:21,308::task::1168::TaskManager.Task::(prepare) Task=`fda0edf4-617d-4e10-998b-4dd4be96cb9f`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731513', 'lastCheck': '7.2', 'valid': True}} >Thread-54107::DEBUG::2014-05-16 17:32:21,308::task::579::TaskManager.Task::(_updateState) Task=`fda0edf4-617d-4e10-998b-4dd4be96cb9f`::moving from state preparing -> state finished >Thread-54107::DEBUG::2014-05-16 17:32:21,309::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54107::DEBUG::2014-05-16 17:32:21,310::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54107::DEBUG::2014-05-16 17:32:21,311::task::974::TaskManager.Task::(_decref) Task=`fda0edf4-617d-4e10-998b-4dd4be96cb9f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:32:22,094::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:22,165::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034931 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:32:24,080::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:32:24,090::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000814708 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:24,177::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:24,247::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347844 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:26,259::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:26,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310233 s, 33.0 MB/s\n'; <rc> = 0 >Thread-54110::DEBUG::2014-05-16 17:32:26,571::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54110::DEBUG::2014-05-16 17:32:26,572::task::579::TaskManager.Task::(_updateState) Task=`5fbe65f1-bd96-45fe-a302-600e0b194ba7`::moving from state init -> state preparing >Thread-54110::INFO::2014-05-16 17:32:26,572::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54110::INFO::2014-05-16 17:32:26,572::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54110::DEBUG::2014-05-16 17:32:26,572::task::1168::TaskManager.Task::(prepare) Task=`5fbe65f1-bd96-45fe-a302-600e0b194ba7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54110::DEBUG::2014-05-16 17:32:26,573::task::579::TaskManager.Task::(_updateState) Task=`5fbe65f1-bd96-45fe-a302-600e0b194ba7`::moving from state preparing -> state finished >Thread-54110::DEBUG::2014-05-16 17:32:26,573::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54110::DEBUG::2014-05-16 17:32:26,573::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54110::DEBUG::2014-05-16 17:32:26,573::task::974::TaskManager.Task::(_decref) Task=`5fbe65f1-bd96-45fe-a302-600e0b194ba7`::ref 0 aborting False >Thread-54111::DEBUG::2014-05-16 17:32:26,582::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54111::DEBUG::2014-05-16 17:32:26,582::task::579::TaskManager.Task::(_updateState) Task=`c5583f90-203b-4a7f-81b9-6abb60f48e81`::moving from state init -> state preparing >Thread-54111::INFO::2014-05-16 17:32:26,582::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54111::DEBUG::2014-05-16 17:32:26,583::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`201b53ff-0218-47e8-b671-bffc6acd119a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54111::DEBUG::2014-05-16 17:32:26,583::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54111::DEBUG::2014-05-16 17:32:26,583::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54111::DEBUG::2014-05-16 17:32:26,583::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`201b53ff-0218-47e8-b671-bffc6acd119a`::Granted request >Thread-54111::DEBUG::2014-05-16 17:32:26,584::task::811::TaskManager.Task::(resourceAcquired) Task=`c5583f90-203b-4a7f-81b9-6abb60f48e81`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54111::DEBUG::2014-05-16 17:32:26,584::task::974::TaskManager.Task::(_decref) Task=`c5583f90-203b-4a7f-81b9-6abb60f48e81`::ref 1 aborting False >Thread-54111::INFO::2014-05-16 17:32:26,584::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54111::DEBUG::2014-05-16 17:32:26,585::task::1168::TaskManager.Task::(prepare) Task=`c5583f90-203b-4a7f-81b9-6abb60f48e81`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54111::DEBUG::2014-05-16 17:32:26,585::task::579::TaskManager.Task::(_updateState) Task=`c5583f90-203b-4a7f-81b9-6abb60f48e81`::moving from state preparing -> state finished >Thread-54111::DEBUG::2014-05-16 17:32:26,585::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54111::DEBUG::2014-05-16 17:32:26,585::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54111::DEBUG::2014-05-16 17:32:26,585::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54111::DEBUG::2014-05-16 17:32:26,586::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54111::DEBUG::2014-05-16 17:32:26,586::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54111::DEBUG::2014-05-16 17:32:26,586::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54111::DEBUG::2014-05-16 17:32:26,586::task::974::TaskManager.Task::(_decref) Task=`c5583f90-203b-4a7f-81b9-6abb60f48e81`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:32:28,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:28,407::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347457 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:30,419::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:30,496::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0404367 s, 25.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:32,507::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:32,575::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302904 s, 33.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:32:34,128::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:32:34,138::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737354 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:34,586::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:34,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307779 s, 33.3 MB/s\n'; <rc> = 0 >Thread-54115::DEBUG::2014-05-16 17:32:36,502::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5412660.000000 / 8.008296 / 262500000.000000 = 0.257479 >Thread-54115::DEBUG::2014-05-16 17:32:36,503::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.006401647195838244, 'statsAge': 1.3916981220245361, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25747870845056126, 'rxDropped': 0} >Thread-54115::DEBUG::2014-05-16 17:32:36,503::task::579::TaskManager.Task::(_updateState) Task=`0e1be3ca-b308-40c0-973b-74aebf7205f0`::moving from state init -> state preparing >Thread-54115::INFO::2014-05-16 17:32:36,503::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54115::INFO::2014-05-16 17:32:36,504::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737354', 'lastCheck': '2.3', 'valid': True}} >Thread-54115::DEBUG::2014-05-16 17:32:36,504::task::1168::TaskManager.Task::(prepare) Task=`0e1be3ca-b308-40c0-973b-74aebf7205f0`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737354', 'lastCheck': '2.3', 'valid': True}} >Thread-54115::DEBUG::2014-05-16 17:32:36,504::task::579::TaskManager.Task::(_updateState) Task=`0e1be3ca-b308-40c0-973b-74aebf7205f0`::moving from state preparing -> state finished >Thread-54115::DEBUG::2014-05-16 17:32:36,504::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54115::DEBUG::2014-05-16 17:32:36,504::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54115::DEBUG::2014-05-16 17:32:36,504::task::974::TaskManager.Task::(_decref) Task=`0e1be3ca-b308-40c0-973b-74aebf7205f0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:32:36,664::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54117::DEBUG::2014-05-16 17:32:36,724::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54117::DEBUG::2014-05-16 17:32:36,725::task::579::TaskManager.Task::(_updateState) Task=`748db0be-5777-4d29-9d79-0f46dbf495a5`::moving from state init -> state preparing >Thread-54117::INFO::2014-05-16 17:32:36,726::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54117::INFO::2014-05-16 17:32:36,728::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54117::DEBUG::2014-05-16 17:32:36,729::task::1168::TaskManager.Task::(prepare) Task=`748db0be-5777-4d29-9d79-0f46dbf495a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54117::DEBUG::2014-05-16 17:32:36,730::task::579::TaskManager.Task::(_updateState) Task=`748db0be-5777-4d29-9d79-0f46dbf495a5`::moving from state preparing -> state finished >Thread-54117::DEBUG::2014-05-16 17:32:36,730::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54117::DEBUG::2014-05-16 17:32:36,731::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54117::DEBUG::2014-05-16 17:32:36,732::task::974::TaskManager.Task::(_decref) Task=`748db0be-5777-4d29-9d79-0f46dbf495a5`::ref 0 aborting False >Thread-54118::DEBUG::2014-05-16 17:32:36,744::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54118::DEBUG::2014-05-16 17:32:36,746::task::579::TaskManager.Task::(_updateState) Task=`7d9cb742-8c78-4089-972e-68479c94535f`::moving from state init -> state preparing >Thread-54118::INFO::2014-05-16 17:32:36,747::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54118::DEBUG::2014-05-16 17:32:36,749::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`721c92cb-1647-4e7c-b95f-76eaca5b0c1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54118::DEBUG::2014-05-16 17:32:36,749::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54118::DEBUG::2014-05-16 17:32:36,751::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54118::DEBUG::2014-05-16 17:32:36,752::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`721c92cb-1647-4e7c-b95f-76eaca5b0c1c`::Granted request >Thread-54118::DEBUG::2014-05-16 17:32:36,754::task::811::TaskManager.Task::(resourceAcquired) Task=`7d9cb742-8c78-4089-972e-68479c94535f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54118::DEBUG::2014-05-16 17:32:36,754::task::974::TaskManager.Task::(_decref) Task=`7d9cb742-8c78-4089-972e-68479c94535f`::ref 1 aborting False >Thread-54118::INFO::2014-05-16 17:32:36,758::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54118::DEBUG::2014-05-16 17:32:36,759::task::1168::TaskManager.Task::(prepare) Task=`7d9cb742-8c78-4089-972e-68479c94535f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54118::DEBUG::2014-05-16 17:32:36,760::task::579::TaskManager.Task::(_updateState) Task=`7d9cb742-8c78-4089-972e-68479c94535f`::moving from state preparing -> state finished >Thread-54118::DEBUG::2014-05-16 17:32:36,761::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54118::DEBUG::2014-05-16 17:32:36,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54118::DEBUG::2014-05-16 17:32:36,763::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54118::DEBUG::2014-05-16 17:32:36,764::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54118::DEBUG::2014-05-16 17:32:36,765::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54118::DEBUG::2014-05-16 17:32:36,765::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54118::DEBUG::2014-05-16 17:32:36,767::task::974::TaskManager.Task::(_decref) Task=`7d9cb742-8c78-4089-972e-68479c94535f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:32:36,777::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349636 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:38,789::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:38,856::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314737 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:40,868::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:40,936::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03207 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:42,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:43,025::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035215 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:32:44,171::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:32:44,181::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000779116 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:45,041::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:45,115::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363145 s, 28.2 MB/s\n'; <rc> = 0 >Thread-54122::DEBUG::2014-05-16 17:32:46,802::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54122::DEBUG::2014-05-16 17:32:46,803::task::579::TaskManager.Task::(_updateState) Task=`af58340f-d30a-4c82-be5b-afcb45ee3f34`::moving from state init -> state preparing >Thread-54122::INFO::2014-05-16 17:32:46,803::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54122::INFO::2014-05-16 17:32:46,803::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54122::DEBUG::2014-05-16 17:32:46,803::task::1168::TaskManager.Task::(prepare) Task=`af58340f-d30a-4c82-be5b-afcb45ee3f34`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54122::DEBUG::2014-05-16 17:32:46,804::task::579::TaskManager.Task::(_updateState) Task=`af58340f-d30a-4c82-be5b-afcb45ee3f34`::moving from state preparing -> state finished >Thread-54122::DEBUG::2014-05-16 17:32:46,804::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54122::DEBUG::2014-05-16 17:32:46,804::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54122::DEBUG::2014-05-16 17:32:46,804::task::974::TaskManager.Task::(_decref) Task=`af58340f-d30a-4c82-be5b-afcb45ee3f34`::ref 0 aborting False >Thread-54123::DEBUG::2014-05-16 17:32:46,812::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54123::DEBUG::2014-05-16 17:32:46,812::task::579::TaskManager.Task::(_updateState) Task=`8366580e-3d06-4996-8bdc-f6c0cecbcacd`::moving from state init -> state preparing >Thread-54123::INFO::2014-05-16 17:32:46,813::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54123::DEBUG::2014-05-16 17:32:46,813::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3cc07ccc-6e94-4b1d-bbf3-cc9c0681d7d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54123::DEBUG::2014-05-16 17:32:46,813::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54123::DEBUG::2014-05-16 17:32:46,813::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54123::DEBUG::2014-05-16 17:32:46,813::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3cc07ccc-6e94-4b1d-bbf3-cc9c0681d7d7`::Granted request >Thread-54123::DEBUG::2014-05-16 17:32:46,814::task::811::TaskManager.Task::(resourceAcquired) Task=`8366580e-3d06-4996-8bdc-f6c0cecbcacd`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54123::DEBUG::2014-05-16 17:32:46,814::task::974::TaskManager.Task::(_decref) Task=`8366580e-3d06-4996-8bdc-f6c0cecbcacd`::ref 1 aborting False >Thread-54123::INFO::2014-05-16 17:32:46,814::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54123::DEBUG::2014-05-16 17:32:46,814::task::1168::TaskManager.Task::(prepare) Task=`8366580e-3d06-4996-8bdc-f6c0cecbcacd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54123::DEBUG::2014-05-16 17:32:46,815::task::579::TaskManager.Task::(_updateState) Task=`8366580e-3d06-4996-8bdc-f6c0cecbcacd`::moving from state preparing -> state finished >Thread-54123::DEBUG::2014-05-16 17:32:46,815::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54123::DEBUG::2014-05-16 17:32:46,815::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54123::DEBUG::2014-05-16 17:32:46,815::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54123::DEBUG::2014-05-16 17:32:46,815::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54123::DEBUG::2014-05-16 17:32:46,815::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54123::DEBUG::2014-05-16 17:32:46,815::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54123::DEBUG::2014-05-16 17:32:46,816::task::974::TaskManager.Task::(_decref) Task=`8366580e-3d06-4996-8bdc-f6c0cecbcacd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:32:47,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:47,198::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305304 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:49,209::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:49,281::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355666 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:51,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:51,360::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310413 s, 33.0 MB/s\n'; <rc> = 0 >Thread-54125::DEBUG::2014-05-16 17:32:51,684::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5415548.000000 / 8.010748 / 262500000.000000 = 0.257537 >Thread-54125::DEBUG::2014-05-16 17:32:51,685::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0067319081384844149, 'statsAge': 0.55442690849304199, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25753723972557924, 'rxDropped': 0} >Thread-54125::DEBUG::2014-05-16 17:32:51,685::task::579::TaskManager.Task::(_updateState) Task=`ae46a0cd-b90b-4601-999d-8ef27b67681d`::moving from state init -> state preparing >Thread-54125::INFO::2014-05-16 17:32:51,685::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54125::INFO::2014-05-16 17:32:51,686::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000779116', 'lastCheck': '7.5', 'valid': True}} >Thread-54125::DEBUG::2014-05-16 17:32:51,686::task::1168::TaskManager.Task::(prepare) Task=`ae46a0cd-b90b-4601-999d-8ef27b67681d`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000779116', 'lastCheck': '7.5', 'valid': True}} >Thread-54125::DEBUG::2014-05-16 17:32:51,686::task::579::TaskManager.Task::(_updateState) Task=`ae46a0cd-b90b-4601-999d-8ef27b67681d`::moving from state preparing -> state finished >Thread-54125::DEBUG::2014-05-16 17:32:51,686::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54125::DEBUG::2014-05-16 17:32:51,686::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54125::DEBUG::2014-05-16 17:32:51,686::task::974::TaskManager.Task::(_decref) Task=`ae46a0cd-b90b-4601-999d-8ef27b67681d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:32:53,371::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:53,438::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304421 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:32:54,218::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:32:54,229::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725638 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:55,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:55,518::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352861 s, 29.0 MB/s\n'; <rc> = 0 >Thread-54128::DEBUG::2014-05-16 17:32:56,853::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54128::DEBUG::2014-05-16 17:32:56,853::task::579::TaskManager.Task::(_updateState) Task=`199e0a98-b661-453a-8d8e-c15b62a2ca69`::moving from state init -> state preparing >Thread-54128::INFO::2014-05-16 17:32:56,854::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54128::INFO::2014-05-16 17:32:56,854::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54128::DEBUG::2014-05-16 17:32:56,854::task::1168::TaskManager.Task::(prepare) Task=`199e0a98-b661-453a-8d8e-c15b62a2ca69`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54128::DEBUG::2014-05-16 17:32:56,854::task::579::TaskManager.Task::(_updateState) Task=`199e0a98-b661-453a-8d8e-c15b62a2ca69`::moving from state preparing -> state finished >Thread-54128::DEBUG::2014-05-16 17:32:56,854::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54128::DEBUG::2014-05-16 17:32:56,854::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54128::DEBUG::2014-05-16 17:32:56,855::task::974::TaskManager.Task::(_decref) Task=`199e0a98-b661-453a-8d8e-c15b62a2ca69`::ref 0 aborting False >Thread-54129::DEBUG::2014-05-16 17:32:56,863::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54129::DEBUG::2014-05-16 17:32:56,863::task::579::TaskManager.Task::(_updateState) Task=`5f671fdb-a3a0-406d-8362-72747c884b6d`::moving from state init -> state preparing >Thread-54129::INFO::2014-05-16 17:32:56,863::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54129::DEBUG::2014-05-16 17:32:56,864::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e19300c8-a8ec-42ee-9002-ecb52a014e5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54129::DEBUG::2014-05-16 17:32:56,864::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54129::DEBUG::2014-05-16 17:32:56,864::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54129::DEBUG::2014-05-16 17:32:56,864::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e19300c8-a8ec-42ee-9002-ecb52a014e5e`::Granted request >Thread-54129::DEBUG::2014-05-16 17:32:56,865::task::811::TaskManager.Task::(resourceAcquired) Task=`5f671fdb-a3a0-406d-8362-72747c884b6d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54129::DEBUG::2014-05-16 17:32:56,865::task::974::TaskManager.Task::(_decref) Task=`5f671fdb-a3a0-406d-8362-72747c884b6d`::ref 1 aborting False >Thread-54129::INFO::2014-05-16 17:32:56,865::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54129::DEBUG::2014-05-16 17:32:56,865::task::1168::TaskManager.Task::(prepare) Task=`5f671fdb-a3a0-406d-8362-72747c884b6d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54129::DEBUG::2014-05-16 17:32:56,866::task::579::TaskManager.Task::(_updateState) Task=`5f671fdb-a3a0-406d-8362-72747c884b6d`::moving from state preparing -> state finished >Thread-54129::DEBUG::2014-05-16 17:32:56,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54129::DEBUG::2014-05-16 17:32:56,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54129::DEBUG::2014-05-16 17:32:56,866::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54129::DEBUG::2014-05-16 17:32:56,866::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54129::DEBUG::2014-05-16 17:32:56,866::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54129::DEBUG::2014-05-16 17:32:56,866::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54129::DEBUG::2014-05-16 17:32:56,867::task::974::TaskManager.Task::(_decref) Task=`5f671fdb-a3a0-406d-8362-72747c884b6d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:32:57,525::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:57,592::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303949 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:32:59,603::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:32:59,675::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355194 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:01,687::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:01,755::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317573 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:03,766::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:03,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350621 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:33:04,266::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:33:04,276::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679824 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:05,857::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:05,923::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308933 s, 33.1 MB/s\n'; <rc> = 0 >Thread-54133::DEBUG::2014-05-16 17:33:06,845::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4312815.000000 / 8.008255 / 262500000.000000 = 0.205160 >Thread-54133::DEBUG::2014-05-16 17:33:06,845::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005395289874824535, 'statsAge': 1.7009241580963135, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20516044280000859, 'rxDropped': 0} >Thread-54133::DEBUG::2014-05-16 17:33:06,846::task::579::TaskManager.Task::(_updateState) Task=`35fab1f4-5f17-47e4-a88f-dcd008b573ef`::moving from state init -> state preparing >Thread-54133::INFO::2014-05-16 17:33:06,847::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54133::INFO::2014-05-16 17:33:06,847::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679824', 'lastCheck': '2.6', 'valid': True}} >Thread-54133::DEBUG::2014-05-16 17:33:06,847::task::1168::TaskManager.Task::(prepare) Task=`35fab1f4-5f17-47e4-a88f-dcd008b573ef`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679824', 'lastCheck': '2.6', 'valid': True}} >Thread-54133::DEBUG::2014-05-16 17:33:06,847::task::579::TaskManager.Task::(_updateState) Task=`35fab1f4-5f17-47e4-a88f-dcd008b573ef`::moving from state preparing -> state finished >Thread-54133::DEBUG::2014-05-16 17:33:06,847::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54133::DEBUG::2014-05-16 17:33:06,847::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54133::DEBUG::2014-05-16 17:33:06,848::task::974::TaskManager.Task::(_decref) Task=`35fab1f4-5f17-47e4-a88f-dcd008b573ef`::ref 0 aborting False >Thread-54135::DEBUG::2014-05-16 17:33:06,920::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54135::DEBUG::2014-05-16 17:33:06,921::task::579::TaskManager.Task::(_updateState) Task=`d93b6af9-c7fa-4c73-9cc3-004e58af092e`::moving from state init -> state preparing >Thread-54135::INFO::2014-05-16 17:33:06,921::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54135::INFO::2014-05-16 17:33:06,921::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54135::DEBUG::2014-05-16 17:33:06,921::task::1168::TaskManager.Task::(prepare) Task=`d93b6af9-c7fa-4c73-9cc3-004e58af092e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54135::DEBUG::2014-05-16 17:33:06,921::task::579::TaskManager.Task::(_updateState) Task=`d93b6af9-c7fa-4c73-9cc3-004e58af092e`::moving from state preparing -> state finished >Thread-54135::DEBUG::2014-05-16 17:33:06,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54135::DEBUG::2014-05-16 17:33:06,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54135::DEBUG::2014-05-16 17:33:06,922::task::974::TaskManager.Task::(_decref) Task=`d93b6af9-c7fa-4c73-9cc3-004e58af092e`::ref 0 aborting False >Thread-54136::DEBUG::2014-05-16 17:33:06,947::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54136::DEBUG::2014-05-16 17:33:06,947::task::579::TaskManager.Task::(_updateState) Task=`c55ce7aa-29d2-4dd3-a939-d5fb9a57e5b4`::moving from state init -> state preparing >Thread-54136::INFO::2014-05-16 17:33:06,947::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54136::DEBUG::2014-05-16 17:33:06,948::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fcde7c1a-b19a-4f91-807d-0cb0d82d244b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54136::DEBUG::2014-05-16 17:33:06,948::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54136::DEBUG::2014-05-16 17:33:06,948::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54136::DEBUG::2014-05-16 17:33:06,948::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fcde7c1a-b19a-4f91-807d-0cb0d82d244b`::Granted request >Thread-54136::DEBUG::2014-05-16 17:33:06,950::task::811::TaskManager.Task::(resourceAcquired) Task=`c55ce7aa-29d2-4dd3-a939-d5fb9a57e5b4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54136::DEBUG::2014-05-16 17:33:06,950::task::974::TaskManager.Task::(_decref) Task=`c55ce7aa-29d2-4dd3-a939-d5fb9a57e5b4`::ref 1 aborting False >Thread-54136::INFO::2014-05-16 17:33:06,950::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54136::DEBUG::2014-05-16 17:33:06,950::task::1168::TaskManager.Task::(prepare) Task=`c55ce7aa-29d2-4dd3-a939-d5fb9a57e5b4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54136::DEBUG::2014-05-16 17:33:06,951::task::579::TaskManager.Task::(_updateState) Task=`c55ce7aa-29d2-4dd3-a939-d5fb9a57e5b4`::moving from state preparing -> state finished >Thread-54136::DEBUG::2014-05-16 17:33:06,951::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54136::DEBUG::2014-05-16 17:33:06,951::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54136::DEBUG::2014-05-16 17:33:06,951::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54136::DEBUG::2014-05-16 17:33:06,951::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54136::DEBUG::2014-05-16 17:33:06,952::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54136::DEBUG::2014-05-16 17:33:06,952::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54136::DEBUG::2014-05-16 17:33:06,952::task::974::TaskManager.Task::(_decref) Task=`c55ce7aa-29d2-4dd3-a939-d5fb9a57e5b4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:33:07,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:08,002::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309661 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:10,013::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:10,093::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.043665 s, 23.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:12,104::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:12,172::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312294 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:14,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:14,250::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307943 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:33:14,314::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:33:14,324::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737889 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:16,262::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:16,334::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356342 s, 28.7 MB/s\n'; <rc> = 0 >Thread-54140::DEBUG::2014-05-16 17:33:16,980::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54140::DEBUG::2014-05-16 17:33:16,980::task::579::TaskManager.Task::(_updateState) Task=`b370e7fe-36d8-4d64-82cb-b41d44b7df97`::moving from state init -> state preparing >Thread-54140::INFO::2014-05-16 17:33:16,981::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54140::INFO::2014-05-16 17:33:16,981::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54140::DEBUG::2014-05-16 17:33:16,981::task::1168::TaskManager.Task::(prepare) Task=`b370e7fe-36d8-4d64-82cb-b41d44b7df97`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54140::DEBUG::2014-05-16 17:33:16,981::task::579::TaskManager.Task::(_updateState) Task=`b370e7fe-36d8-4d64-82cb-b41d44b7df97`::moving from state preparing -> state finished >Thread-54140::DEBUG::2014-05-16 17:33:16,981::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54140::DEBUG::2014-05-16 17:33:16,981::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54140::DEBUG::2014-05-16 17:33:16,982::task::974::TaskManager.Task::(_decref) Task=`b370e7fe-36d8-4d64-82cb-b41d44b7df97`::ref 0 aborting False >Thread-54141::DEBUG::2014-05-16 17:33:16,990::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54141::DEBUG::2014-05-16 17:33:16,990::task::579::TaskManager.Task::(_updateState) Task=`d3e2a18f-30e5-4bee-b9df-78541eb088d9`::moving from state init -> state preparing >Thread-54141::INFO::2014-05-16 17:33:16,991::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54141::DEBUG::2014-05-16 17:33:16,991::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5c1649f9-e9b1-4c01-ad9a-3245ca8280fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54141::DEBUG::2014-05-16 17:33:16,991::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54141::DEBUG::2014-05-16 17:33:16,991::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54141::DEBUG::2014-05-16 17:33:16,991::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5c1649f9-e9b1-4c01-ad9a-3245ca8280fd`::Granted request >Thread-54141::DEBUG::2014-05-16 17:33:16,992::task::811::TaskManager.Task::(resourceAcquired) Task=`d3e2a18f-30e5-4bee-b9df-78541eb088d9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54141::DEBUG::2014-05-16 17:33:16,992::task::974::TaskManager.Task::(_decref) Task=`d3e2a18f-30e5-4bee-b9df-78541eb088d9`::ref 1 aborting False >Thread-54141::INFO::2014-05-16 17:33:16,992::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54141::DEBUG::2014-05-16 17:33:16,992::task::1168::TaskManager.Task::(prepare) Task=`d3e2a18f-30e5-4bee-b9df-78541eb088d9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54141::DEBUG::2014-05-16 17:33:16,993::task::579::TaskManager.Task::(_updateState) Task=`d3e2a18f-30e5-4bee-b9df-78541eb088d9`::moving from state preparing -> state finished >Thread-54141::DEBUG::2014-05-16 17:33:16,993::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54141::DEBUG::2014-05-16 17:33:16,993::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54141::DEBUG::2014-05-16 17:33:16,993::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54141::DEBUG::2014-05-16 17:33:16,993::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54141::DEBUG::2014-05-16 17:33:16,993::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54141::DEBUG::2014-05-16 17:33:16,993::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54141::DEBUG::2014-05-16 17:33:16,994::task::974::TaskManager.Task::(_decref) Task=`d3e2a18f-30e5-4bee-b9df-78541eb088d9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:33:18,345::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:18,411::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304249 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:20,423::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:20,490::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316541 s, 32.3 MB/s\n'; <rc> = 0 >Thread-54143::DEBUG::2014-05-16 17:33:22,045::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316822.000000 / 8.008339 / 262500000.000000 = 0.205349 >Thread-54143::DEBUG::2014-05-16 17:33:22,045::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053865756926820786, 'statsAge': 0.88411617279052734, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20534890365992473, 'rxDropped': 0} >Thread-54143::DEBUG::2014-05-16 17:33:22,046::task::579::TaskManager.Task::(_updateState) Task=`7fed29db-3c30-488d-a3fd-cf2336d0bcdd`::moving from state init -> state preparing >Thread-54143::INFO::2014-05-16 17:33:22,046::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54143::INFO::2014-05-16 17:33:22,046::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737889', 'lastCheck': '7.7', 'valid': True}} >Thread-54143::DEBUG::2014-05-16 17:33:22,046::task::1168::TaskManager.Task::(prepare) Task=`7fed29db-3c30-488d-a3fd-cf2336d0bcdd`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737889', 'lastCheck': '7.7', 'valid': True}} >Thread-54143::DEBUG::2014-05-16 17:33:22,047::task::579::TaskManager.Task::(_updateState) Task=`7fed29db-3c30-488d-a3fd-cf2336d0bcdd`::moving from state preparing -> state finished >Thread-54143::DEBUG::2014-05-16 17:33:22,047::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54143::DEBUG::2014-05-16 17:33:22,047::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54143::DEBUG::2014-05-16 17:33:22,047::task::974::TaskManager.Task::(_decref) Task=`7fed29db-3c30-488d-a3fd-cf2336d0bcdd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:33:22,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:22,568::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308117 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:33:24,362::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:33:24,373::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114301 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:24,580::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:24,650::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351084 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:26,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:26,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316825 s, 32.3 MB/s\n'; <rc> = 0 >Thread-54146::DEBUG::2014-05-16 17:33:27,030::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54146::DEBUG::2014-05-16 17:33:27,030::task::579::TaskManager.Task::(_updateState) Task=`2220fbe1-854b-4972-a6f5-39a856859fbd`::moving from state init -> state preparing >Thread-54146::INFO::2014-05-16 17:33:27,031::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54146::INFO::2014-05-16 17:33:27,031::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54146::DEBUG::2014-05-16 17:33:27,031::task::1168::TaskManager.Task::(prepare) Task=`2220fbe1-854b-4972-a6f5-39a856859fbd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54146::DEBUG::2014-05-16 17:33:27,031::task::579::TaskManager.Task::(_updateState) Task=`2220fbe1-854b-4972-a6f5-39a856859fbd`::moving from state preparing -> state finished >Thread-54146::DEBUG::2014-05-16 17:33:27,031::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54146::DEBUG::2014-05-16 17:33:27,032::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54146::DEBUG::2014-05-16 17:33:27,032::task::974::TaskManager.Task::(_decref) Task=`2220fbe1-854b-4972-a6f5-39a856859fbd`::ref 0 aborting False >Thread-54147::DEBUG::2014-05-16 17:33:27,040::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54147::DEBUG::2014-05-16 17:33:27,040::task::579::TaskManager.Task::(_updateState) Task=`75b2f7bb-828e-48bd-943f-8e66c1773732`::moving from state init -> state preparing >Thread-54147::INFO::2014-05-16 17:33:27,040::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54147::DEBUG::2014-05-16 17:33:27,041::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`236aa032-862f-4ff3-ad8e-5e36fd2a0e8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54147::DEBUG::2014-05-16 17:33:27,041::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54147::DEBUG::2014-05-16 17:33:27,041::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54147::DEBUG::2014-05-16 17:33:27,041::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`236aa032-862f-4ff3-ad8e-5e36fd2a0e8a`::Granted request >Thread-54147::DEBUG::2014-05-16 17:33:27,042::task::811::TaskManager.Task::(resourceAcquired) Task=`75b2f7bb-828e-48bd-943f-8e66c1773732`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54147::DEBUG::2014-05-16 17:33:27,042::task::974::TaskManager.Task::(_decref) Task=`75b2f7bb-828e-48bd-943f-8e66c1773732`::ref 1 aborting False >Thread-54147::INFO::2014-05-16 17:33:27,042::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54147::DEBUG::2014-05-16 17:33:27,043::task::1168::TaskManager.Task::(prepare) Task=`75b2f7bb-828e-48bd-943f-8e66c1773732`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54147::DEBUG::2014-05-16 17:33:27,043::task::579::TaskManager.Task::(_updateState) Task=`75b2f7bb-828e-48bd-943f-8e66c1773732`::moving from state preparing -> state finished >Thread-54147::DEBUG::2014-05-16 17:33:27,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54147::DEBUG::2014-05-16 17:33:27,043::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54147::DEBUG::2014-05-16 17:33:27,043::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54147::DEBUG::2014-05-16 17:33:27,043::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54147::DEBUG::2014-05-16 17:33:27,044::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54147::DEBUG::2014-05-16 17:33:27,044::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54147::DEBUG::2014-05-16 17:33:27,044::task::974::TaskManager.Task::(_decref) Task=`75b2f7bb-828e-48bd-943f-8e66c1773732`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:33:28,741::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:28,809::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313554 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:30,821::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:30,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339094 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:32,902::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:32,969::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309083 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:33:34,410::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:33:34,420::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112167 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:34,981::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:35,054::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355553 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:37,065::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54151::DEBUG::2014-05-16 17:33:37,097::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54151::DEBUG::2014-05-16 17:33:37,099::task::579::TaskManager.Task::(_updateState) Task=`5951b9d3-ea74-4399-924d-ac2a84940d9a`::moving from state init -> state preparing >Thread-54151::INFO::2014-05-16 17:33:37,100::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54151::INFO::2014-05-16 17:33:37,101::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54151::DEBUG::2014-05-16 17:33:37,102::task::1168::TaskManager.Task::(prepare) Task=`5951b9d3-ea74-4399-924d-ac2a84940d9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54151::DEBUG::2014-05-16 17:33:37,103::task::579::TaskManager.Task::(_updateState) Task=`5951b9d3-ea74-4399-924d-ac2a84940d9a`::moving from state preparing -> state finished >Thread-54151::DEBUG::2014-05-16 17:33:37,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54151::DEBUG::2014-05-16 17:33:37,105::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54151::DEBUG::2014-05-16 17:33:37,106::task::974::TaskManager.Task::(_decref) Task=`5951b9d3-ea74-4399-924d-ac2a84940d9a`::ref 0 aborting False >Thread-54152::DEBUG::2014-05-16 17:33:37,119::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54152::DEBUG::2014-05-16 17:33:37,120::task::579::TaskManager.Task::(_updateState) Task=`d3483dbe-df36-4bd5-8a94-35834b39cd98`::moving from state init -> state preparing >Thread-54152::INFO::2014-05-16 17:33:37,121::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54152::DEBUG::2014-05-16 17:33:37,124::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ee1a361f-0b8b-4c7b-8cd4-e50dd954e05b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54152::DEBUG::2014-05-16 17:33:37,124::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54152::DEBUG::2014-05-16 17:33:37,126::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54152::DEBUG::2014-05-16 17:33:37,126::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ee1a361f-0b8b-4c7b-8cd4-e50dd954e05b`::Granted request >Thread-54152::DEBUG::2014-05-16 17:33:37,128::task::811::TaskManager.Task::(resourceAcquired) Task=`d3483dbe-df36-4bd5-8a94-35834b39cd98`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54152::DEBUG::2014-05-16 17:33:37,129::task::974::TaskManager.Task::(_decref) Task=`d3483dbe-df36-4bd5-8a94-35834b39cd98`::ref 1 aborting False >Thread-54152::INFO::2014-05-16 17:33:37,133::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54152::DEBUG::2014-05-16 17:33:37,134::task::1168::TaskManager.Task::(prepare) Task=`d3483dbe-df36-4bd5-8a94-35834b39cd98`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54152::DEBUG::2014-05-16 17:33:37,135::task::579::TaskManager.Task::(_updateState) Task=`d3483dbe-df36-4bd5-8a94-35834b39cd98`::moving from state preparing -> state finished >Thread-54152::DEBUG::2014-05-16 17:33:37,135::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54152::DEBUG::2014-05-16 17:33:37,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54152::DEBUG::2014-05-16 17:33:37,138::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54152::DEBUG::2014-05-16 17:33:37,139::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54152::DEBUG::2014-05-16 17:33:37,139::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54152::DEBUG::2014-05-16 17:33:37,140::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54152::DEBUG::2014-05-16 17:33:37,142::task::974::TaskManager.Task::(_decref) Task=`d3483dbe-df36-4bd5-8a94-35834b39cd98`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:33:37,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0748597 s, 13.7 MB/s\n'; <rc> = 0 >Thread-54153::DEBUG::2014-05-16 17:33:37,210::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4340179.000000 / 8.008967 / 262500000.000000 = 0.206444 >Thread-54153::DEBUG::2014-05-16 17:33:37,210::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052902608061868028, 'statsAge': 0.031175136566162109, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20644379478093, 'rxDropped': 0} >Thread-54153::DEBUG::2014-05-16 17:33:37,210::task::579::TaskManager.Task::(_updateState) Task=`83ee6e17-cc66-40ee-9b84-8add86e4f357`::moving from state init -> state preparing >Thread-54153::INFO::2014-05-16 17:33:37,210::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54153::INFO::2014-05-16 17:33:37,210::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112167', 'lastCheck': '2.8', 'valid': True}} >Thread-54153::DEBUG::2014-05-16 17:33:37,211::task::1168::TaskManager.Task::(prepare) Task=`83ee6e17-cc66-40ee-9b84-8add86e4f357`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112167', 'lastCheck': '2.8', 'valid': True}} >Thread-54153::DEBUG::2014-05-16 17:33:37,211::task::579::TaskManager.Task::(_updateState) Task=`83ee6e17-cc66-40ee-9b84-8add86e4f357`::moving from state preparing -> state finished >Thread-54153::DEBUG::2014-05-16 17:33:37,211::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54153::DEBUG::2014-05-16 17:33:37,211::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54153::DEBUG::2014-05-16 17:33:37,211::task::974::TaskManager.Task::(_decref) Task=`83ee6e17-cc66-40ee-9b84-8add86e4f357`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:33:39,196::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:39,264::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315223 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:41,275::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:41,343::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310903 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:43,354::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:43,425::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350118 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:33:44,455::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:33:44,465::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000774525 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:45,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:45,507::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349253 s, 29.3 MB/s\n'; <rc> = 0 >Thread-54158::DEBUG::2014-05-16 17:33:47,180::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54158::DEBUG::2014-05-16 17:33:47,181::task::579::TaskManager.Task::(_updateState) Task=`02af49d1-b5c0-4711-a850-6fa66219d522`::moving from state init -> state preparing >Thread-54158::INFO::2014-05-16 17:33:47,181::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54158::INFO::2014-05-16 17:33:47,181::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54158::DEBUG::2014-05-16 17:33:47,181::task::1168::TaskManager.Task::(prepare) Task=`02af49d1-b5c0-4711-a850-6fa66219d522`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54158::DEBUG::2014-05-16 17:33:47,182::task::579::TaskManager.Task::(_updateState) Task=`02af49d1-b5c0-4711-a850-6fa66219d522`::moving from state preparing -> state finished >Thread-54158::DEBUG::2014-05-16 17:33:47,182::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54158::DEBUG::2014-05-16 17:33:47,182::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54158::DEBUG::2014-05-16 17:33:47,182::task::974::TaskManager.Task::(_decref) Task=`02af49d1-b5c0-4711-a850-6fa66219d522`::ref 0 aborting False >Thread-54159::DEBUG::2014-05-16 17:33:47,191::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54159::DEBUG::2014-05-16 17:33:47,191::task::579::TaskManager.Task::(_updateState) Task=`fa54a364-37b2-42a3-bc2c-c5dea0fc5ff0`::moving from state init -> state preparing >Thread-54159::INFO::2014-05-16 17:33:47,191::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54159::DEBUG::2014-05-16 17:33:47,191::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`06261f61-a83b-47d1-b6e8-dcb0102a7321`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54159::DEBUG::2014-05-16 17:33:47,192::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54159::DEBUG::2014-05-16 17:33:47,192::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54159::DEBUG::2014-05-16 17:33:47,192::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`06261f61-a83b-47d1-b6e8-dcb0102a7321`::Granted request >Thread-54159::DEBUG::2014-05-16 17:33:47,193::task::811::TaskManager.Task::(resourceAcquired) Task=`fa54a364-37b2-42a3-bc2c-c5dea0fc5ff0`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54159::DEBUG::2014-05-16 17:33:47,193::task::974::TaskManager.Task::(_decref) Task=`fa54a364-37b2-42a3-bc2c-c5dea0fc5ff0`::ref 1 aborting False >Thread-54159::INFO::2014-05-16 17:33:47,194::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54159::DEBUG::2014-05-16 17:33:47,194::task::1168::TaskManager.Task::(prepare) Task=`fa54a364-37b2-42a3-bc2c-c5dea0fc5ff0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54159::DEBUG::2014-05-16 17:33:47,194::task::579::TaskManager.Task::(_updateState) Task=`fa54a364-37b2-42a3-bc2c-c5dea0fc5ff0`::moving from state preparing -> state finished >Thread-54159::DEBUG::2014-05-16 17:33:47,194::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54159::DEBUG::2014-05-16 17:33:47,194::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54159::DEBUG::2014-05-16 17:33:47,195::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54159::DEBUG::2014-05-16 17:33:47,195::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54159::DEBUG::2014-05-16 17:33:47,195::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54159::DEBUG::2014-05-16 17:33:47,195::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54159::DEBUG::2014-05-16 17:33:47,196::task::974::TaskManager.Task::(_decref) Task=`fa54a364-37b2-42a3-bc2c-c5dea0fc5ff0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:33:47,519::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:47,587::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312347 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:49,598::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:49,675::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03938 s, 26.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:51,687::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:51,757::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341896 s, 30.0 MB/s\n'; <rc> = 0 >Thread-54161::DEBUG::2014-05-16 17:33:52,375::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313700.000000 / 8.012590 / 262500000.000000 = 0.205092 >Thread-54161::DEBUG::2014-05-16 17:33:52,375::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053558569802306102, 'statsAge': 1.1750588417053223, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20509152468371758, 'rxDropped': 0} >Thread-54161::DEBUG::2014-05-16 17:33:52,376::task::579::TaskManager.Task::(_updateState) Task=`386e5a23-76a8-45cc-84a9-bd62d655289e`::moving from state init -> state preparing >Thread-54161::INFO::2014-05-16 17:33:52,376::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54161::INFO::2014-05-16 17:33:52,376::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774525', 'lastCheck': '7.9', 'valid': True}} >Thread-54161::DEBUG::2014-05-16 17:33:52,376::task::1168::TaskManager.Task::(prepare) Task=`386e5a23-76a8-45cc-84a9-bd62d655289e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774525', 'lastCheck': '7.9', 'valid': True}} >Thread-54161::DEBUG::2014-05-16 17:33:52,377::task::579::TaskManager.Task::(_updateState) Task=`386e5a23-76a8-45cc-84a9-bd62d655289e`::moving from state preparing -> state finished >Thread-54161::DEBUG::2014-05-16 17:33:52,377::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54161::DEBUG::2014-05-16 17:33:52,377::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54161::DEBUG::2014-05-16 17:33:52,377::task::974::TaskManager.Task::(_decref) Task=`386e5a23-76a8-45cc-84a9-bd62d655289e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:33:53,769::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:53,835::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309701 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:33:54,502::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:33:54,512::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740495 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:33:55,847::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:55,914::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312277 s, 32.8 MB/s\n'; <rc> = 0 >Thread-54164::DEBUG::2014-05-16 17:33:57,254::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54164::DEBUG::2014-05-16 17:33:57,255::task::579::TaskManager.Task::(_updateState) Task=`239bbec1-fd4a-4b59-b159-e64a72701f54`::moving from state init -> state preparing >Thread-54164::INFO::2014-05-16 17:33:57,255::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54164::INFO::2014-05-16 17:33:57,255::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54164::DEBUG::2014-05-16 17:33:57,255::task::1168::TaskManager.Task::(prepare) Task=`239bbec1-fd4a-4b59-b159-e64a72701f54`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54164::DEBUG::2014-05-16 17:33:57,256::task::579::TaskManager.Task::(_updateState) Task=`239bbec1-fd4a-4b59-b159-e64a72701f54`::moving from state preparing -> state finished >Thread-54164::DEBUG::2014-05-16 17:33:57,256::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54164::DEBUG::2014-05-16 17:33:57,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54164::DEBUG::2014-05-16 17:33:57,256::task::974::TaskManager.Task::(_decref) Task=`239bbec1-fd4a-4b59-b159-e64a72701f54`::ref 0 aborting False >Thread-54165::DEBUG::2014-05-16 17:33:57,264::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54165::DEBUG::2014-05-16 17:33:57,265::task::579::TaskManager.Task::(_updateState) Task=`efac8bec-c3bf-4315-b68f-b6c1126963a5`::moving from state init -> state preparing >Thread-54165::INFO::2014-05-16 17:33:57,265::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54165::DEBUG::2014-05-16 17:33:57,265::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dd10c760-acdf-430f-a76a-20c7f81c0827`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54165::DEBUG::2014-05-16 17:33:57,265::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54165::DEBUG::2014-05-16 17:33:57,266::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54165::DEBUG::2014-05-16 17:33:57,267::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dd10c760-acdf-430f-a76a-20c7f81c0827`::Granted request >Thread-54165::DEBUG::2014-05-16 17:33:57,267::task::811::TaskManager.Task::(resourceAcquired) Task=`efac8bec-c3bf-4315-b68f-b6c1126963a5`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54165::DEBUG::2014-05-16 17:33:57,267::task::974::TaskManager.Task::(_decref) Task=`efac8bec-c3bf-4315-b68f-b6c1126963a5`::ref 1 aborting False >Thread-54165::INFO::2014-05-16 17:33:57,268::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54165::DEBUG::2014-05-16 17:33:57,268::task::1168::TaskManager.Task::(prepare) Task=`efac8bec-c3bf-4315-b68f-b6c1126963a5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54165::DEBUG::2014-05-16 17:33:57,268::task::579::TaskManager.Task::(_updateState) Task=`efac8bec-c3bf-4315-b68f-b6c1126963a5`::moving from state preparing -> state finished >Thread-54165::DEBUG::2014-05-16 17:33:57,268::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54165::DEBUG::2014-05-16 17:33:57,268::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54165::DEBUG::2014-05-16 17:33:57,269::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54165::DEBUG::2014-05-16 17:33:57,269::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54165::DEBUG::2014-05-16 17:33:57,269::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54165::DEBUG::2014-05-16 17:33:57,269::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54165::DEBUG::2014-05-16 17:33:57,269::task::974::TaskManager.Task::(_decref) Task=`efac8bec-c3bf-4315-b68f-b6c1126963a5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:33:57,926::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:33:57,996::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347248 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:00,008::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:00,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372538 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:02,093::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:02,159::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310174 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:04,171::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:04,241::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343742 s, 29.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:34:04,547::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:34:04,558::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000772502 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:06,253::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:06,324::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351296 s, 29.1 MB/s\n'; <rc> = 0 >Thread-54169::DEBUG::2014-05-16 17:34:07,330::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54169::DEBUG::2014-05-16 17:34:07,330::task::579::TaskManager.Task::(_updateState) Task=`cce713d2-636d-4d2b-9aff-4f1a65263193`::moving from state init -> state preparing >Thread-54169::INFO::2014-05-16 17:34:07,331::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54169::INFO::2014-05-16 17:34:07,331::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54169::DEBUG::2014-05-16 17:34:07,331::task::1168::TaskManager.Task::(prepare) Task=`cce713d2-636d-4d2b-9aff-4f1a65263193`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54169::DEBUG::2014-05-16 17:34:07,331::task::579::TaskManager.Task::(_updateState) Task=`cce713d2-636d-4d2b-9aff-4f1a65263193`::moving from state preparing -> state finished >Thread-54169::DEBUG::2014-05-16 17:34:07,331::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54169::DEBUG::2014-05-16 17:34:07,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54169::DEBUG::2014-05-16 17:34:07,332::task::974::TaskManager.Task::(_decref) Task=`cce713d2-636d-4d2b-9aff-4f1a65263193`::ref 0 aborting False >Thread-54170::DEBUG::2014-05-16 17:34:07,340::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54170::DEBUG::2014-05-16 17:34:07,340::task::579::TaskManager.Task::(_updateState) Task=`0151de77-ec9b-4372-a533-71a15361c975`::moving from state init -> state preparing >Thread-54170::INFO::2014-05-16 17:34:07,340::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54170::DEBUG::2014-05-16 17:34:07,341::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1c4e7d44-d40f-44a7-8e30-278660107220`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54170::DEBUG::2014-05-16 17:34:07,341::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54170::DEBUG::2014-05-16 17:34:07,341::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54170::DEBUG::2014-05-16 17:34:07,341::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1c4e7d44-d40f-44a7-8e30-278660107220`::Granted request >Thread-54170::DEBUG::2014-05-16 17:34:07,342::task::811::TaskManager.Task::(resourceAcquired) Task=`0151de77-ec9b-4372-a533-71a15361c975`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54170::DEBUG::2014-05-16 17:34:07,342::task::974::TaskManager.Task::(_decref) Task=`0151de77-ec9b-4372-a533-71a15361c975`::ref 1 aborting False >Thread-54170::INFO::2014-05-16 17:34:07,342::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54170::DEBUG::2014-05-16 17:34:07,343::task::1168::TaskManager.Task::(prepare) Task=`0151de77-ec9b-4372-a533-71a15361c975`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54170::DEBUG::2014-05-16 17:34:07,343::task::579::TaskManager.Task::(_updateState) Task=`0151de77-ec9b-4372-a533-71a15361c975`::moving from state preparing -> state finished >Thread-54170::DEBUG::2014-05-16 17:34:07,343::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54170::DEBUG::2014-05-16 17:34:07,343::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54170::DEBUG::2014-05-16 17:34:07,343::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54170::DEBUG::2014-05-16 17:34:07,344::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54170::DEBUG::2014-05-16 17:34:07,344::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54170::DEBUG::2014-05-16 17:34:07,344::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54170::DEBUG::2014-05-16 17:34:07,344::task::974::TaskManager.Task::(_decref) Task=`0151de77-ec9b-4372-a533-71a15361c975`::ref 0 aborting False >Thread-54171::DEBUG::2014-05-16 17:34:07,528::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4309071.000000 / 8.008423 / 262500000.000000 = 0.204978 >Thread-54171::DEBUG::2014-05-16 17:34:07,529::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0050404073101749242, 'statsAge': 0.31181883811950684, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20497803858496386, 'rxDropped': 0} >Thread-54171::DEBUG::2014-05-16 17:34:07,529::task::579::TaskManager.Task::(_updateState) Task=`0220ffca-a6b4-469c-87a4-2d9cdbd21654`::moving from state init -> state preparing >Thread-54171::INFO::2014-05-16 17:34:07,529::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54171::INFO::2014-05-16 17:34:07,529::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000772502', 'lastCheck': '3.0', 'valid': True}} >Thread-54171::DEBUG::2014-05-16 17:34:07,529::task::1168::TaskManager.Task::(prepare) Task=`0220ffca-a6b4-469c-87a4-2d9cdbd21654`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000772502', 'lastCheck': '3.0', 'valid': True}} >Thread-54171::DEBUG::2014-05-16 17:34:07,530::task::579::TaskManager.Task::(_updateState) Task=`0220ffca-a6b4-469c-87a4-2d9cdbd21654`::moving from state preparing -> state finished >Thread-54171::DEBUG::2014-05-16 17:34:07,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54171::DEBUG::2014-05-16 17:34:07,530::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54171::DEBUG::2014-05-16 17:34:07,530::task::974::TaskManager.Task::(_decref) Task=`0220ffca-a6b4-469c-87a4-2d9cdbd21654`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:34:08,335::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:08,402::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307705 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:10,413::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:10,484::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349999 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:12,495::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:12,561::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299929 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:14,573::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 17:34:14,602::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:34:14,626::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000738688 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:14,776::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.162236 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:16,787::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:16,855::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313239 s, 32.7 MB/s\n'; <rc> = 0 >Thread-54176::DEBUG::2014-05-16 17:34:17,381::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54176::DEBUG::2014-05-16 17:34:17,381::task::579::TaskManager.Task::(_updateState) Task=`f012ca6f-1ad6-4e25-b59a-235fb133af35`::moving from state init -> state preparing >Thread-54176::INFO::2014-05-16 17:34:17,382::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54176::INFO::2014-05-16 17:34:17,382::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54176::DEBUG::2014-05-16 17:34:17,382::task::1168::TaskManager.Task::(prepare) Task=`f012ca6f-1ad6-4e25-b59a-235fb133af35`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54176::DEBUG::2014-05-16 17:34:17,382::task::579::TaskManager.Task::(_updateState) Task=`f012ca6f-1ad6-4e25-b59a-235fb133af35`::moving from state preparing -> state finished >Thread-54176::DEBUG::2014-05-16 17:34:17,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54176::DEBUG::2014-05-16 17:34:17,383::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54176::DEBUG::2014-05-16 17:34:17,383::task::974::TaskManager.Task::(_decref) Task=`f012ca6f-1ad6-4e25-b59a-235fb133af35`::ref 0 aborting False >Thread-54177::DEBUG::2014-05-16 17:34:17,391::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54177::DEBUG::2014-05-16 17:34:17,391::task::579::TaskManager.Task::(_updateState) Task=`322bde00-ef28-40c7-a870-d38d7a7e6f98`::moving from state init -> state preparing >Thread-54177::INFO::2014-05-16 17:34:17,391::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54177::DEBUG::2014-05-16 17:34:17,391::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`08a946ac-fe8e-4b37-9bc1-02f3fe4ea768`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54177::DEBUG::2014-05-16 17:34:17,392::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54177::DEBUG::2014-05-16 17:34:17,392::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54177::DEBUG::2014-05-16 17:34:17,392::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`08a946ac-fe8e-4b37-9bc1-02f3fe4ea768`::Granted request >Thread-54177::DEBUG::2014-05-16 17:34:17,392::task::811::TaskManager.Task::(resourceAcquired) Task=`322bde00-ef28-40c7-a870-d38d7a7e6f98`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54177::DEBUG::2014-05-16 17:34:17,393::task::974::TaskManager.Task::(_decref) Task=`322bde00-ef28-40c7-a870-d38d7a7e6f98`::ref 1 aborting False >Thread-54177::INFO::2014-05-16 17:34:17,393::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54177::DEBUG::2014-05-16 17:34:17,393::task::1168::TaskManager.Task::(prepare) Task=`322bde00-ef28-40c7-a870-d38d7a7e6f98`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54177::DEBUG::2014-05-16 17:34:17,394::task::579::TaskManager.Task::(_updateState) Task=`322bde00-ef28-40c7-a870-d38d7a7e6f98`::moving from state preparing -> state finished >Thread-54177::DEBUG::2014-05-16 17:34:17,394::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54177::DEBUG::2014-05-16 17:34:17,394::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54177::DEBUG::2014-05-16 17:34:17,394::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54177::DEBUG::2014-05-16 17:34:17,394::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54177::DEBUG::2014-05-16 17:34:17,394::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54177::DEBUG::2014-05-16 17:34:17,395::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54177::DEBUG::2014-05-16 17:34:17,395::task::974::TaskManager.Task::(_decref) Task=`322bde00-ef28-40c7-a870-d38d7a7e6f98`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:34:18,866::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:18,937::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348517 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:20,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:21,020::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353481 s, 29.0 MB/s\n'; <rc> = 0 >Thread-54179::DEBUG::2014-05-16 17:34:22,678::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3244042.000000 / 8.008646 / 262500000.000000 = 0.154311 >Thread-54179::DEBUG::2014-05-16 17:34:22,678::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041628343442084879, 'statsAge': 1.4467778205871582, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15431141819200117, 'rxDropped': 0} >Thread-54179::DEBUG::2014-05-16 17:34:22,679::task::579::TaskManager.Task::(_updateState) Task=`c408fc1a-759c-434d-80db-f9904e2b8633`::moving from state init -> state preparing >Thread-54179::INFO::2014-05-16 17:34:22,679::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54179::INFO::2014-05-16 17:34:22,679::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738688', 'lastCheck': '8.0', 'valid': True}} >Thread-54179::DEBUG::2014-05-16 17:34:22,679::task::1168::TaskManager.Task::(prepare) Task=`c408fc1a-759c-434d-80db-f9904e2b8633`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738688', 'lastCheck': '8.0', 'valid': True}} >Thread-54179::DEBUG::2014-05-16 17:34:22,680::task::579::TaskManager.Task::(_updateState) Task=`c408fc1a-759c-434d-80db-f9904e2b8633`::moving from state preparing -> state finished >Thread-54179::DEBUG::2014-05-16 17:34:22,680::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54179::DEBUG::2014-05-16 17:34:22,680::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54179::DEBUG::2014-05-16 17:34:22,680::task::974::TaskManager.Task::(_decref) Task=`c408fc1a-759c-434d-80db-f9904e2b8633`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:34:23,032::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:23,098::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303168 s, 33.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:34:24,747::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:34:24,758::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010849 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:25,110::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:25,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358604 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:27,193::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:27,265::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309148 s, 33.1 MB/s\n'; <rc> = 0 >Thread-54182::DEBUG::2014-05-16 17:34:27,428::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54182::DEBUG::2014-05-16 17:34:27,428::task::579::TaskManager.Task::(_updateState) Task=`94649a31-0f46-4a0d-836e-64a1f0bd84f7`::moving from state init -> state preparing >Thread-54182::INFO::2014-05-16 17:34:27,428::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54182::INFO::2014-05-16 17:34:27,429::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54182::DEBUG::2014-05-16 17:34:27,429::task::1168::TaskManager.Task::(prepare) Task=`94649a31-0f46-4a0d-836e-64a1f0bd84f7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54182::DEBUG::2014-05-16 17:34:27,429::task::579::TaskManager.Task::(_updateState) Task=`94649a31-0f46-4a0d-836e-64a1f0bd84f7`::moving from state preparing -> state finished >Thread-54182::DEBUG::2014-05-16 17:34:27,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54182::DEBUG::2014-05-16 17:34:27,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54182::DEBUG::2014-05-16 17:34:27,430::task::974::TaskManager.Task::(_decref) Task=`94649a31-0f46-4a0d-836e-64a1f0bd84f7`::ref 0 aborting False >Thread-54183::DEBUG::2014-05-16 17:34:27,438::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54183::DEBUG::2014-05-16 17:34:27,438::task::579::TaskManager.Task::(_updateState) Task=`8eab307a-aec4-4c3f-95d2-c5e5f495e30f`::moving from state init -> state preparing >Thread-54183::INFO::2014-05-16 17:34:27,438::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54183::DEBUG::2014-05-16 17:34:27,438::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7b69eba8-ca4b-4fd0-a418-535556117425`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54183::DEBUG::2014-05-16 17:34:27,439::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54183::DEBUG::2014-05-16 17:34:27,439::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54183::DEBUG::2014-05-16 17:34:27,439::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7b69eba8-ca4b-4fd0-a418-535556117425`::Granted request >Thread-54183::DEBUG::2014-05-16 17:34:27,439::task::811::TaskManager.Task::(resourceAcquired) Task=`8eab307a-aec4-4c3f-95d2-c5e5f495e30f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54183::DEBUG::2014-05-16 17:34:27,439::task::974::TaskManager.Task::(_decref) Task=`8eab307a-aec4-4c3f-95d2-c5e5f495e30f`::ref 1 aborting False >Thread-54183::INFO::2014-05-16 17:34:27,440::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54183::DEBUG::2014-05-16 17:34:27,440::task::1168::TaskManager.Task::(prepare) Task=`8eab307a-aec4-4c3f-95d2-c5e5f495e30f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54183::DEBUG::2014-05-16 17:34:27,440::task::579::TaskManager.Task::(_updateState) Task=`8eab307a-aec4-4c3f-95d2-c5e5f495e30f`::moving from state preparing -> state finished >Thread-54183::DEBUG::2014-05-16 17:34:27,441::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54183::DEBUG::2014-05-16 17:34:27,441::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54183::DEBUG::2014-05-16 17:34:27,441::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54183::DEBUG::2014-05-16 17:34:27,441::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54183::DEBUG::2014-05-16 17:34:27,441::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54183::DEBUG::2014-05-16 17:34:27,442::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54183::DEBUG::2014-05-16 17:34:27,442::task::974::TaskManager.Task::(_decref) Task=`8eab307a-aec4-4c3f-95d2-c5e5f495e30f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:34:29,277::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:29,343::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303248 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:31,355::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:31,426::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350773 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:33,437::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:33,504::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304078 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:34:34,798::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:34:34,808::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00074302 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:35,515::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:35,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362395 s, 28.3 MB/s\n'; <rc> = 0 >Thread-54187::DEBUG::2014-05-16 17:34:37,479::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [62fee17b] >Thread-54187::DEBUG::2014-05-16 17:34:37,480::task::579::TaskManager.Task::(_updateState) Task=`0fcbca5c-cffd-414f-9068-9b42511e7b7f`::moving from state init -> state preparing >Thread-54187::INFO::2014-05-16 17:34:37,480::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54187::INFO::2014-05-16 17:34:37,480::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54187::DEBUG::2014-05-16 17:34:37,480::task::1168::TaskManager.Task::(prepare) Task=`0fcbca5c-cffd-414f-9068-9b42511e7b7f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54187::DEBUG::2014-05-16 17:34:37,480::task::579::TaskManager.Task::(_updateState) Task=`0fcbca5c-cffd-414f-9068-9b42511e7b7f`::moving from state preparing -> state finished >Thread-54187::DEBUG::2014-05-16 17:34:37,481::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54187::DEBUG::2014-05-16 17:34:37,481::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54187::DEBUG::2014-05-16 17:34:37,481::task::974::TaskManager.Task::(_decref) Task=`0fcbca5c-cffd-414f-9068-9b42511e7b7f`::ref 0 aborting False >Thread-54188::DEBUG::2014-05-16 17:34:37,489::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [62fee17b] >Thread-54188::DEBUG::2014-05-16 17:34:37,489::task::579::TaskManager.Task::(_updateState) Task=`dd3c2727-05ca-4493-8484-9c42a3170c05`::moving from state init -> state preparing >Thread-54188::INFO::2014-05-16 17:34:37,489::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54188::DEBUG::2014-05-16 17:34:37,490::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`633d9b36-c5a3-44e1-bbe3-708e0093fb77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54188::DEBUG::2014-05-16 17:34:37,490::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54188::DEBUG::2014-05-16 17:34:37,490::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54188::DEBUG::2014-05-16 17:34:37,490::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`633d9b36-c5a3-44e1-bbe3-708e0093fb77`::Granted request >Thread-54188::DEBUG::2014-05-16 17:34:37,491::task::811::TaskManager.Task::(resourceAcquired) Task=`dd3c2727-05ca-4493-8484-9c42a3170c05`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54188::DEBUG::2014-05-16 17:34:37,491::task::974::TaskManager.Task::(_decref) Task=`dd3c2727-05ca-4493-8484-9c42a3170c05`::ref 1 aborting False >Thread-54188::INFO::2014-05-16 17:34:37,492::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54188::DEBUG::2014-05-16 17:34:37,492::task::1168::TaskManager.Task::(prepare) Task=`dd3c2727-05ca-4493-8484-9c42a3170c05`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54188::DEBUG::2014-05-16 17:34:37,492::task::579::TaskManager.Task::(_updateState) Task=`dd3c2727-05ca-4493-8484-9c42a3170c05`::moving from state preparing -> state finished >Thread-54188::DEBUG::2014-05-16 17:34:37,492::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54188::DEBUG::2014-05-16 17:34:37,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54188::DEBUG::2014-05-16 17:34:37,492::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54188::DEBUG::2014-05-16 17:34:37,493::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54188::DEBUG::2014-05-16 17:34:37,493::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54188::DEBUG::2014-05-16 17:34:37,493::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54188::DEBUG::2014-05-16 17:34:37,493::task::974::TaskManager.Task::(_decref) Task=`dd3c2727-05ca-4493-8484-9c42a3170c05`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:34:37,600::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:37,667::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309572 s, 33.1 MB/s\n'; <rc> = 0 >Thread-54189::DEBUG::2014-05-16 17:34:37,864::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5410393.000000 / 8.008371 / 262500000.000000 = 0.257368 >Thread-54189::DEBUG::2014-05-16 17:34:37,864::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.006403299655490996, 'statsAge': 0.61261296272277832, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25736845429738425, 'rxDropped': 0} >Thread-54189::DEBUG::2014-05-16 17:34:37,865::task::579::TaskManager.Task::(_updateState) Task=`84c92a78-c59f-4a9b-95cb-54621b26c98d`::moving from state init -> state preparing >Thread-54189::INFO::2014-05-16 17:34:37,865::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54189::INFO::2014-05-16 17:34:37,865::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074302', 'lastCheck': '3.0', 'valid': True}} >Thread-54189::DEBUG::2014-05-16 17:34:37,865::task::1168::TaskManager.Task::(prepare) Task=`84c92a78-c59f-4a9b-95cb-54621b26c98d`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074302', 'lastCheck': '3.0', 'valid': True}} >Thread-54189::DEBUG::2014-05-16 17:34:37,865::task::579::TaskManager.Task::(_updateState) Task=`84c92a78-c59f-4a9b-95cb-54621b26c98d`::moving from state preparing -> state finished >Thread-54189::DEBUG::2014-05-16 17:34:37,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54189::DEBUG::2014-05-16 17:34:37,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54189::DEBUG::2014-05-16 17:34:37,866::task::974::TaskManager.Task::(_decref) Task=`84c92a78-c59f-4a9b-95cb-54621b26c98d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:34:39,678::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:39,748::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351164 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:41,760::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:41,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306532 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:43,838::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:43,906::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031141 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:34:44,854::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:34:44,871::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718598 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:45,917::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:45,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362665 s, 28.2 MB/s\n'; <rc> = 0 >Thread-54194::DEBUG::2014-05-16 17:34:47,523::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54194::DEBUG::2014-05-16 17:34:47,523::task::579::TaskManager.Task::(_updateState) Task=`7383c444-2786-4953-aa27-3a4975019d47`::moving from state init -> state preparing >Thread-54194::INFO::2014-05-16 17:34:47,523::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54194::INFO::2014-05-16 17:34:47,524::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54194::DEBUG::2014-05-16 17:34:47,524::task::1168::TaskManager.Task::(prepare) Task=`7383c444-2786-4953-aa27-3a4975019d47`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54194::DEBUG::2014-05-16 17:34:47,524::task::579::TaskManager.Task::(_updateState) Task=`7383c444-2786-4953-aa27-3a4975019d47`::moving from state preparing -> state finished >Thread-54194::DEBUG::2014-05-16 17:34:47,524::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54194::DEBUG::2014-05-16 17:34:47,524::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54194::DEBUG::2014-05-16 17:34:47,524::task::974::TaskManager.Task::(_decref) Task=`7383c444-2786-4953-aa27-3a4975019d47`::ref 0 aborting False >Thread-54195::DEBUG::2014-05-16 17:34:47,532::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54195::DEBUG::2014-05-16 17:34:47,533::task::579::TaskManager.Task::(_updateState) Task=`d71a4688-55b1-4c14-83a2-e70089c30421`::moving from state init -> state preparing >Thread-54195::INFO::2014-05-16 17:34:47,533::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54195::DEBUG::2014-05-16 17:34:47,533::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5df5c0ed-00fa-4fed-828a-02eefb6408f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54195::DEBUG::2014-05-16 17:34:47,533::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54195::DEBUG::2014-05-16 17:34:47,534::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54195::DEBUG::2014-05-16 17:34:47,534::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5df5c0ed-00fa-4fed-828a-02eefb6408f0`::Granted request >Thread-54195::DEBUG::2014-05-16 17:34:47,535::task::811::TaskManager.Task::(resourceAcquired) Task=`d71a4688-55b1-4c14-83a2-e70089c30421`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54195::DEBUG::2014-05-16 17:34:47,535::task::974::TaskManager.Task::(_decref) Task=`d71a4688-55b1-4c14-83a2-e70089c30421`::ref 1 aborting False >Thread-54195::INFO::2014-05-16 17:34:47,535::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54195::DEBUG::2014-05-16 17:34:47,536::task::1168::TaskManager.Task::(prepare) Task=`d71a4688-55b1-4c14-83a2-e70089c30421`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54195::DEBUG::2014-05-16 17:34:47,536::task::579::TaskManager.Task::(_updateState) Task=`d71a4688-55b1-4c14-83a2-e70089c30421`::moving from state preparing -> state finished >Thread-54195::DEBUG::2014-05-16 17:34:47,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54195::DEBUG::2014-05-16 17:34:47,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54195::DEBUG::2014-05-16 17:34:47,536::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54195::DEBUG::2014-05-16 17:34:47,536::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54195::DEBUG::2014-05-16 17:34:47,536::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54195::DEBUG::2014-05-16 17:34:47,537::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54195::DEBUG::2014-05-16 17:34:47,537::task::974::TaskManager.Task::(_decref) Task=`d71a4688-55b1-4c14-83a2-e70089c30421`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:34:48,001::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:48,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310828 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:50,080::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:50,151::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355236 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:52,163::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:52,234::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355015 s, 28.8 MB/s\n'; <rc> = 0 >Thread-54197::DEBUG::2014-05-16 17:34:53,023::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316634.000000 / 8.008565 / 262500000.000000 = 0.205334 >Thread-54197::DEBUG::2014-05-16 17:34:53,023::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005361593111864211, 'statsAge': 1.7568671703338623, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20533416541724062, 'rxDropped': 0} >Thread-54197::DEBUG::2014-05-16 17:34:53,024::task::579::TaskManager.Task::(_updateState) Task=`f77b7c06-92ba-477e-adfe-91b1f9c604dd`::moving from state init -> state preparing >Thread-54197::INFO::2014-05-16 17:34:53,024::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54197::INFO::2014-05-16 17:34:53,024::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718598', 'lastCheck': '8.1', 'valid': True}} >Thread-54197::DEBUG::2014-05-16 17:34:53,024::task::1168::TaskManager.Task::(prepare) Task=`f77b7c06-92ba-477e-adfe-91b1f9c604dd`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718598', 'lastCheck': '8.1', 'valid': True}} >Thread-54197::DEBUG::2014-05-16 17:34:53,025::task::579::TaskManager.Task::(_updateState) Task=`f77b7c06-92ba-477e-adfe-91b1f9c604dd`::moving from state preparing -> state finished >Thread-54197::DEBUG::2014-05-16 17:34:53,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54197::DEBUG::2014-05-16 17:34:53,025::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54197::DEBUG::2014-05-16 17:34:53,025::task::974::TaskManager.Task::(_decref) Task=`f77b7c06-92ba-477e-adfe-91b1f9c604dd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:34:54,246::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:54,312::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03052 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:34:54,916::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:34:54,927::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000766218 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:34:56,324::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:56,392::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311465 s, 32.9 MB/s\n'; <rc> = 0 >Thread-54200::DEBUG::2014-05-16 17:34:57,575::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54200::DEBUG::2014-05-16 17:34:57,575::task::579::TaskManager.Task::(_updateState) Task=`12a6c64c-00c9-4af8-b82a-f554717657f0`::moving from state init -> state preparing >Thread-54200::INFO::2014-05-16 17:34:57,575::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54200::INFO::2014-05-16 17:34:57,576::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54200::DEBUG::2014-05-16 17:34:57,576::task::1168::TaskManager.Task::(prepare) Task=`12a6c64c-00c9-4af8-b82a-f554717657f0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54200::DEBUG::2014-05-16 17:34:57,576::task::579::TaskManager.Task::(_updateState) Task=`12a6c64c-00c9-4af8-b82a-f554717657f0`::moving from state preparing -> state finished >Thread-54200::DEBUG::2014-05-16 17:34:57,576::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54200::DEBUG::2014-05-16 17:34:57,576::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54200::DEBUG::2014-05-16 17:34:57,576::task::974::TaskManager.Task::(_decref) Task=`12a6c64c-00c9-4af8-b82a-f554717657f0`::ref 0 aborting False >Thread-54201::DEBUG::2014-05-16 17:34:57,586::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54201::DEBUG::2014-05-16 17:34:57,587::task::579::TaskManager.Task::(_updateState) Task=`7a988823-15a2-4c87-a906-da9da783763b`::moving from state init -> state preparing >Thread-54201::INFO::2014-05-16 17:34:57,587::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54201::DEBUG::2014-05-16 17:34:57,587::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9892cafe-38ca-415e-98ff-2db5770b2e2c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54201::DEBUG::2014-05-16 17:34:57,587::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54201::DEBUG::2014-05-16 17:34:57,588::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54201::DEBUG::2014-05-16 17:34:57,588::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9892cafe-38ca-415e-98ff-2db5770b2e2c`::Granted request >Thread-54201::DEBUG::2014-05-16 17:34:57,588::task::811::TaskManager.Task::(resourceAcquired) Task=`7a988823-15a2-4c87-a906-da9da783763b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54201::DEBUG::2014-05-16 17:34:57,588::task::974::TaskManager.Task::(_decref) Task=`7a988823-15a2-4c87-a906-da9da783763b`::ref 1 aborting False >Thread-54201::INFO::2014-05-16 17:34:57,589::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54201::DEBUG::2014-05-16 17:34:57,589::task::1168::TaskManager.Task::(prepare) Task=`7a988823-15a2-4c87-a906-da9da783763b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54201::DEBUG::2014-05-16 17:34:57,589::task::579::TaskManager.Task::(_updateState) Task=`7a988823-15a2-4c87-a906-da9da783763b`::moving from state preparing -> state finished >Thread-54201::DEBUG::2014-05-16 17:34:57,589::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54201::DEBUG::2014-05-16 17:34:57,590::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54201::DEBUG::2014-05-16 17:34:57,590::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54201::DEBUG::2014-05-16 17:34:57,590::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54201::DEBUG::2014-05-16 17:34:57,590::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54201::DEBUG::2014-05-16 17:34:57,590::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54201::DEBUG::2014-05-16 17:34:57,590::task::974::TaskManager.Task::(_decref) Task=`7a988823-15a2-4c87-a906-da9da783763b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:34:58,404::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:34:58,474::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352073 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:00,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:00,559::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358583 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:02,571::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:02,638::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308916 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:04,650::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:04,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312274 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:35:04,972::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:35:04,982::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000738264 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:06,728::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:06,799::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350061 s, 29.3 MB/s\n'; <rc> = 0 >Thread-54205::DEBUG::2014-05-16 17:35:07,624::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54205::DEBUG::2014-05-16 17:35:07,624::task::579::TaskManager.Task::(_updateState) Task=`10b3eadc-f780-40e3-8e5c-3d2420d1a122`::moving from state init -> state preparing >Thread-54205::INFO::2014-05-16 17:35:07,624::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54205::INFO::2014-05-16 17:35:07,625::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54205::DEBUG::2014-05-16 17:35:07,625::task::1168::TaskManager.Task::(prepare) Task=`10b3eadc-f780-40e3-8e5c-3d2420d1a122`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54205::DEBUG::2014-05-16 17:35:07,625::task::579::TaskManager.Task::(_updateState) Task=`10b3eadc-f780-40e3-8e5c-3d2420d1a122`::moving from state preparing -> state finished >Thread-54205::DEBUG::2014-05-16 17:35:07,625::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54205::DEBUG::2014-05-16 17:35:07,625::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54205::DEBUG::2014-05-16 17:35:07,625::task::974::TaskManager.Task::(_decref) Task=`10b3eadc-f780-40e3-8e5c-3d2420d1a122`::ref 0 aborting False >Thread-54206::DEBUG::2014-05-16 17:35:07,634::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54206::DEBUG::2014-05-16 17:35:07,634::task::579::TaskManager.Task::(_updateState) Task=`62dcfaa8-5a25-4db0-b97a-3f2348d1d2e7`::moving from state init -> state preparing >Thread-54206::INFO::2014-05-16 17:35:07,634::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54206::DEBUG::2014-05-16 17:35:07,634::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b9922aab-6a5b-4224-8bc9-d4fc22b8540e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54206::DEBUG::2014-05-16 17:35:07,635::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54206::DEBUG::2014-05-16 17:35:07,635::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54206::DEBUG::2014-05-16 17:35:07,635::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b9922aab-6a5b-4224-8bc9-d4fc22b8540e`::Granted request >Thread-54206::DEBUG::2014-05-16 17:35:07,635::task::811::TaskManager.Task::(resourceAcquired) Task=`62dcfaa8-5a25-4db0-b97a-3f2348d1d2e7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54206::DEBUG::2014-05-16 17:35:07,635::task::974::TaskManager.Task::(_decref) Task=`62dcfaa8-5a25-4db0-b97a-3f2348d1d2e7`::ref 1 aborting False >Thread-54206::INFO::2014-05-16 17:35:07,636::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54206::DEBUG::2014-05-16 17:35:07,636::task::1168::TaskManager.Task::(prepare) Task=`62dcfaa8-5a25-4db0-b97a-3f2348d1d2e7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54206::DEBUG::2014-05-16 17:35:07,636::task::579::TaskManager.Task::(_updateState) Task=`62dcfaa8-5a25-4db0-b97a-3f2348d1d2e7`::moving from state preparing -> state finished >Thread-54206::DEBUG::2014-05-16 17:35:07,636::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54206::DEBUG::2014-05-16 17:35:07,637::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54206::DEBUG::2014-05-16 17:35:07,637::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54206::DEBUG::2014-05-16 17:35:07,637::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54206::DEBUG::2014-05-16 17:35:07,637::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54206::DEBUG::2014-05-16 17:35:07,637::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54206::DEBUG::2014-05-16 17:35:07,637::task::974::TaskManager.Task::(_decref) Task=`62dcfaa8-5a25-4db0-b97a-3f2348d1d2e7`::ref 0 aborting False >Thread-54207::DEBUG::2014-05-16 17:35:08,183::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4311747.000000 / 8.008378 / 262500000.000000 = 0.205106 >Thread-54207::DEBUG::2014-05-16 17:35:08,183::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051185443478651508, 'statsAge': 0.900054931640625, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20510648720539135, 'rxDropped': 0} >Thread-54207::DEBUG::2014-05-16 17:35:08,183::task::579::TaskManager.Task::(_updateState) Task=`ecfce133-5168-4555-b0cd-a679cfad6b11`::moving from state init -> state preparing >Thread-54207::INFO::2014-05-16 17:35:08,183::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54207::INFO::2014-05-16 17:35:08,184::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738264', 'lastCheck': '3.2', 'valid': True}} >Thread-54207::DEBUG::2014-05-16 17:35:08,184::task::1168::TaskManager.Task::(prepare) Task=`ecfce133-5168-4555-b0cd-a679cfad6b11`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738264', 'lastCheck': '3.2', 'valid': True}} >Thread-54207::DEBUG::2014-05-16 17:35:08,184::task::579::TaskManager.Task::(_updateState) Task=`ecfce133-5168-4555-b0cd-a679cfad6b11`::moving from state preparing -> state finished >Thread-54207::DEBUG::2014-05-16 17:35:08,184::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54207::DEBUG::2014-05-16 17:35:08,184::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54207::DEBUG::2014-05-16 17:35:08,184::task::974::TaskManager.Task::(_decref) Task=`ecfce133-5168-4555-b0cd-a679cfad6b11`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:35:08,811::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:08,878::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310001 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:10,890::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:10,959::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321079 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:12,971::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:13,044::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357749 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:35:15,021::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:35:15,031::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000870421 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:15,055::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:15,125::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349518 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:17,137::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:17,204::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310581 s, 33.0 MB/s\n'; <rc> = 0 >Thread-54212::DEBUG::2014-05-16 17:35:17,667::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54212::DEBUG::2014-05-16 17:35:17,667::task::579::TaskManager.Task::(_updateState) Task=`b5049766-db65-4c97-839b-8a180d639323`::moving from state init -> state preparing >Thread-54212::INFO::2014-05-16 17:35:17,668::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54212::INFO::2014-05-16 17:35:17,668::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54212::DEBUG::2014-05-16 17:35:17,668::task::1168::TaskManager.Task::(prepare) Task=`b5049766-db65-4c97-839b-8a180d639323`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54212::DEBUG::2014-05-16 17:35:17,668::task::579::TaskManager.Task::(_updateState) Task=`b5049766-db65-4c97-839b-8a180d639323`::moving from state preparing -> state finished >Thread-54212::DEBUG::2014-05-16 17:35:17,668::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54212::DEBUG::2014-05-16 17:35:17,668::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54212::DEBUG::2014-05-16 17:35:17,669::task::974::TaskManager.Task::(_decref) Task=`b5049766-db65-4c97-839b-8a180d639323`::ref 0 aborting False >Thread-54213::DEBUG::2014-05-16 17:35:17,679::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54213::DEBUG::2014-05-16 17:35:17,679::task::579::TaskManager.Task::(_updateState) Task=`ab8ce31c-feee-4f2e-9ab1-d28d04d04ff8`::moving from state init -> state preparing >Thread-54213::INFO::2014-05-16 17:35:17,680::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54213::DEBUG::2014-05-16 17:35:17,680::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`28df6801-587a-46fe-98eb-e3f51e609d44`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54213::DEBUG::2014-05-16 17:35:17,680::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54213::DEBUG::2014-05-16 17:35:17,680::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54213::DEBUG::2014-05-16 17:35:17,681::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`28df6801-587a-46fe-98eb-e3f51e609d44`::Granted request >Thread-54213::DEBUG::2014-05-16 17:35:17,681::task::811::TaskManager.Task::(resourceAcquired) Task=`ab8ce31c-feee-4f2e-9ab1-d28d04d04ff8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54213::DEBUG::2014-05-16 17:35:17,681::task::974::TaskManager.Task::(_decref) Task=`ab8ce31c-feee-4f2e-9ab1-d28d04d04ff8`::ref 1 aborting False >Thread-54213::INFO::2014-05-16 17:35:17,682::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54213::DEBUG::2014-05-16 17:35:17,682::task::1168::TaskManager.Task::(prepare) Task=`ab8ce31c-feee-4f2e-9ab1-d28d04d04ff8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54213::DEBUG::2014-05-16 17:35:17,682::task::579::TaskManager.Task::(_updateState) Task=`ab8ce31c-feee-4f2e-9ab1-d28d04d04ff8`::moving from state preparing -> state finished >Thread-54213::DEBUG::2014-05-16 17:35:17,682::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54213::DEBUG::2014-05-16 17:35:17,682::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54213::DEBUG::2014-05-16 17:35:17,683::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54213::DEBUG::2014-05-16 17:35:17,683::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54213::DEBUG::2014-05-16 17:35:17,683::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54213::DEBUG::2014-05-16 17:35:17,683::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54213::DEBUG::2014-05-16 17:35:17,683::task::974::TaskManager.Task::(_decref) Task=`ab8ce31c-feee-4f2e-9ab1-d28d04d04ff8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:35:19,216::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:19,287::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350086 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:21,299::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:21,371::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035362 s, 29.0 MB/s\n'; <rc> = 0 >Thread-54215::DEBUG::2014-05-16 17:35:23,327::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313394.000000 / 8.017900 / 262500000.000000 = 0.204941 >Thread-54215::DEBUG::2014-05-16 17:35:23,327::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052635561330113545, 'statsAge': 0.017400026321411133, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20494115869721052, 'rxDropped': 0} >Thread-54215::DEBUG::2014-05-16 17:35:23,328::task::579::TaskManager.Task::(_updateState) Task=`42a730b8-0d73-4d2d-9149-fc07e033a777`::moving from state init -> state preparing >Thread-54215::INFO::2014-05-16 17:35:23,328::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54215::INFO::2014-05-16 17:35:23,328::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000870421', 'lastCheck': '8.3', 'valid': True}} >Thread-54215::DEBUG::2014-05-16 17:35:23,328::task::1168::TaskManager.Task::(prepare) Task=`42a730b8-0d73-4d2d-9149-fc07e033a777`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000870421', 'lastCheck': '8.3', 'valid': True}} >Thread-54215::DEBUG::2014-05-16 17:35:23,328::task::579::TaskManager.Task::(_updateState) Task=`42a730b8-0d73-4d2d-9149-fc07e033a777`::moving from state preparing -> state finished >Thread-54215::DEBUG::2014-05-16 17:35:23,328::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54215::DEBUG::2014-05-16 17:35:23,329::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54215::DEBUG::2014-05-16 17:35:23,329::task::974::TaskManager.Task::(_decref) Task=`42a730b8-0d73-4d2d-9149-fc07e033a777`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:35:23,382::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:23,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308663 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:35:25,071::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:35:25,082::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000996881 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:25,460::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:25,532::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356846 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:27,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:27,611::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310876 s, 32.9 MB/s\n'; <rc> = 0 >Thread-54218::DEBUG::2014-05-16 17:35:27,739::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54218::DEBUG::2014-05-16 17:35:27,739::task::579::TaskManager.Task::(_updateState) Task=`a668a942-6a16-4566-b1be-396e33257469`::moving from state init -> state preparing >Thread-54218::INFO::2014-05-16 17:35:27,739::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54218::INFO::2014-05-16 17:35:27,740::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54218::DEBUG::2014-05-16 17:35:27,740::task::1168::TaskManager.Task::(prepare) Task=`a668a942-6a16-4566-b1be-396e33257469`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54218::DEBUG::2014-05-16 17:35:27,740::task::579::TaskManager.Task::(_updateState) Task=`a668a942-6a16-4566-b1be-396e33257469`::moving from state preparing -> state finished >Thread-54218::DEBUG::2014-05-16 17:35:27,740::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54218::DEBUG::2014-05-16 17:35:27,740::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54218::DEBUG::2014-05-16 17:35:27,741::task::974::TaskManager.Task::(_decref) Task=`a668a942-6a16-4566-b1be-396e33257469`::ref 0 aborting False >Thread-54219::DEBUG::2014-05-16 17:35:27,749::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54219::DEBUG::2014-05-16 17:35:27,749::task::579::TaskManager.Task::(_updateState) Task=`b08bc2d5-6c83-44a6-a8fa-c794f3360c2a`::moving from state init -> state preparing >Thread-54219::INFO::2014-05-16 17:35:27,749::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54219::DEBUG::2014-05-16 17:35:27,750::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`39effef3-e89e-4d28-8356-93ecb1fa48c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54219::DEBUG::2014-05-16 17:35:27,750::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54219::DEBUG::2014-05-16 17:35:27,750::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54219::DEBUG::2014-05-16 17:35:27,750::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`39effef3-e89e-4d28-8356-93ecb1fa48c5`::Granted request >Thread-54219::DEBUG::2014-05-16 17:35:27,751::task::811::TaskManager.Task::(resourceAcquired) Task=`b08bc2d5-6c83-44a6-a8fa-c794f3360c2a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54219::DEBUG::2014-05-16 17:35:27,751::task::974::TaskManager.Task::(_decref) Task=`b08bc2d5-6c83-44a6-a8fa-c794f3360c2a`::ref 1 aborting False >Thread-54219::INFO::2014-05-16 17:35:27,752::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54219::DEBUG::2014-05-16 17:35:27,752::task::1168::TaskManager.Task::(prepare) Task=`b08bc2d5-6c83-44a6-a8fa-c794f3360c2a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54219::DEBUG::2014-05-16 17:35:27,752::task::579::TaskManager.Task::(_updateState) Task=`b08bc2d5-6c83-44a6-a8fa-c794f3360c2a`::moving from state preparing -> state finished >Thread-54219::DEBUG::2014-05-16 17:35:27,752::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54219::DEBUG::2014-05-16 17:35:27,752::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54219::DEBUG::2014-05-16 17:35:27,752::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54219::DEBUG::2014-05-16 17:35:27,753::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54219::DEBUG::2014-05-16 17:35:27,753::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54219::DEBUG::2014-05-16 17:35:27,753::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54219::DEBUG::2014-05-16 17:35:27,753::task::974::TaskManager.Task::(_decref) Task=`b08bc2d5-6c83-44a6-a8fa-c794f3360c2a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:35:29,623::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:29,690::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312838 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:31,702::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:31,769::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306692 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:33,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:33,850::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340557 s, 30.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:35:35,119::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:35:35,129::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000751445 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:35,862::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:35,933::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357417 s, 28.6 MB/s\n'; <rc> = 0 >Thread-54223::DEBUG::2014-05-16 17:35:37,791::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54223::DEBUG::2014-05-16 17:35:37,791::task::579::TaskManager.Task::(_updateState) Task=`8dd02129-dc45-4724-ad49-6ae6ee948f23`::moving from state init -> state preparing >Thread-54223::INFO::2014-05-16 17:35:37,791::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54223::INFO::2014-05-16 17:35:37,792::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54223::DEBUG::2014-05-16 17:35:37,792::task::1168::TaskManager.Task::(prepare) Task=`8dd02129-dc45-4724-ad49-6ae6ee948f23`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54223::DEBUG::2014-05-16 17:35:37,792::task::579::TaskManager.Task::(_updateState) Task=`8dd02129-dc45-4724-ad49-6ae6ee948f23`::moving from state preparing -> state finished >Thread-54223::DEBUG::2014-05-16 17:35:37,792::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54223::DEBUG::2014-05-16 17:35:37,792::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54223::DEBUG::2014-05-16 17:35:37,792::task::974::TaskManager.Task::(_decref) Task=`8dd02129-dc45-4724-ad49-6ae6ee948f23`::ref 0 aborting False >Thread-54224::DEBUG::2014-05-16 17:35:37,801::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54224::DEBUG::2014-05-16 17:35:37,801::task::579::TaskManager.Task::(_updateState) Task=`9e51f086-e02b-42b0-89f0-0b2e07e09b29`::moving from state init -> state preparing >Thread-54224::INFO::2014-05-16 17:35:37,802::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54224::DEBUG::2014-05-16 17:35:37,802::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5255bf02-b3f8-412a-a3d7-ce92d5290ff6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54224::DEBUG::2014-05-16 17:35:37,802::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54224::DEBUG::2014-05-16 17:35:37,802::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54224::DEBUG::2014-05-16 17:35:37,802::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5255bf02-b3f8-412a-a3d7-ce92d5290ff6`::Granted request >Thread-54224::DEBUG::2014-05-16 17:35:37,803::task::811::TaskManager.Task::(resourceAcquired) Task=`9e51f086-e02b-42b0-89f0-0b2e07e09b29`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54224::DEBUG::2014-05-16 17:35:37,804::task::974::TaskManager.Task::(_decref) Task=`9e51f086-e02b-42b0-89f0-0b2e07e09b29`::ref 1 aborting False >Thread-54224::INFO::2014-05-16 17:35:37,804::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54224::DEBUG::2014-05-16 17:35:37,804::task::1168::TaskManager.Task::(prepare) Task=`9e51f086-e02b-42b0-89f0-0b2e07e09b29`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54224::DEBUG::2014-05-16 17:35:37,804::task::579::TaskManager.Task::(_updateState) Task=`9e51f086-e02b-42b0-89f0-0b2e07e09b29`::moving from state preparing -> state finished >Thread-54224::DEBUG::2014-05-16 17:35:37,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54224::DEBUG::2014-05-16 17:35:37,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54224::DEBUG::2014-05-16 17:35:37,805::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54224::DEBUG::2014-05-16 17:35:37,805::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54224::DEBUG::2014-05-16 17:35:37,805::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54224::DEBUG::2014-05-16 17:35:37,805::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54224::DEBUG::2014-05-16 17:35:37,805::task::974::TaskManager.Task::(_decref) Task=`9e51f086-e02b-42b0-89f0-0b2e07e09b29`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:35:37,945::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:38,012::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309928 s, 33.0 MB/s\n'; <rc> = 0 >Thread-54225::DEBUG::2014-05-16 17:35:38,486::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413405.000000 / 8.008334 / 262500000.000000 = 0.257513 >Thread-54225::DEBUG::2014-05-16 17:35:38,486::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066259546197051551, 'statsAge': 1.1622469425201416, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25751292891151539, 'rxDropped': 0} >Thread-54225::DEBUG::2014-05-16 17:35:38,487::task::579::TaskManager.Task::(_updateState) Task=`dc930d80-8d6f-4c64-8df6-753850236c29`::moving from state init -> state preparing >Thread-54225::INFO::2014-05-16 17:35:38,487::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54225::INFO::2014-05-16 17:35:38,488::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000751445', 'lastCheck': '3.3', 'valid': True}} >Thread-54225::DEBUG::2014-05-16 17:35:38,488::task::1168::TaskManager.Task::(prepare) Task=`dc930d80-8d6f-4c64-8df6-753850236c29`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000751445', 'lastCheck': '3.3', 'valid': True}} >Thread-54225::DEBUG::2014-05-16 17:35:38,488::task::579::TaskManager.Task::(_updateState) Task=`dc930d80-8d6f-4c64-8df6-753850236c29`::moving from state preparing -> state finished >Thread-54225::DEBUG::2014-05-16 17:35:38,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54225::DEBUG::2014-05-16 17:35:38,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54225::DEBUG::2014-05-16 17:35:38,488::task::974::TaskManager.Task::(_decref) Task=`dc930d80-8d6f-4c64-8df6-753850236c29`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:35:40,023::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:40,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360982 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:42,113::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:42,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311741 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:44,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:44,261::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319735 s, 32.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:35:45,168::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:35:45,178::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000736395 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:46,273::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:46,345::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358453 s, 28.6 MB/s\n'; <rc> = 0 >Thread-54230::DEBUG::2014-05-16 17:35:47,847::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54230::DEBUG::2014-05-16 17:35:47,847::task::579::TaskManager.Task::(_updateState) Task=`4ccbd010-b372-4d74-9482-30ee86ef9998`::moving from state init -> state preparing >Thread-54230::INFO::2014-05-16 17:35:47,847::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54230::INFO::2014-05-16 17:35:47,848::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54230::DEBUG::2014-05-16 17:35:47,848::task::1168::TaskManager.Task::(prepare) Task=`4ccbd010-b372-4d74-9482-30ee86ef9998`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54230::DEBUG::2014-05-16 17:35:47,848::task::579::TaskManager.Task::(_updateState) Task=`4ccbd010-b372-4d74-9482-30ee86ef9998`::moving from state preparing -> state finished >Thread-54230::DEBUG::2014-05-16 17:35:47,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54230::DEBUG::2014-05-16 17:35:47,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54230::DEBUG::2014-05-16 17:35:47,848::task::974::TaskManager.Task::(_decref) Task=`4ccbd010-b372-4d74-9482-30ee86ef9998`::ref 0 aborting False >Thread-54231::DEBUG::2014-05-16 17:35:47,856::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54231::DEBUG::2014-05-16 17:35:47,857::task::579::TaskManager.Task::(_updateState) Task=`8a048855-39ce-4233-9c10-17ed949bfe86`::moving from state init -> state preparing >Thread-54231::INFO::2014-05-16 17:35:47,857::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54231::DEBUG::2014-05-16 17:35:47,857::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5d365bff-7bd0-4cd9-98ca-bf9b036eecc9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54231::DEBUG::2014-05-16 17:35:47,857::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54231::DEBUG::2014-05-16 17:35:47,858::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54231::DEBUG::2014-05-16 17:35:47,858::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5d365bff-7bd0-4cd9-98ca-bf9b036eecc9`::Granted request >Thread-54231::DEBUG::2014-05-16 17:35:47,858::task::811::TaskManager.Task::(resourceAcquired) Task=`8a048855-39ce-4233-9c10-17ed949bfe86`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54231::DEBUG::2014-05-16 17:35:47,858::task::974::TaskManager.Task::(_decref) Task=`8a048855-39ce-4233-9c10-17ed949bfe86`::ref 1 aborting False >Thread-54231::INFO::2014-05-16 17:35:47,859::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54231::DEBUG::2014-05-16 17:35:47,859::task::1168::TaskManager.Task::(prepare) Task=`8a048855-39ce-4233-9c10-17ed949bfe86`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54231::DEBUG::2014-05-16 17:35:47,859::task::579::TaskManager.Task::(_updateState) Task=`8a048855-39ce-4233-9c10-17ed949bfe86`::moving from state preparing -> state finished >Thread-54231::DEBUG::2014-05-16 17:35:47,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54231::DEBUG::2014-05-16 17:35:47,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54231::DEBUG::2014-05-16 17:35:47,859::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54231::DEBUG::2014-05-16 17:35:47,860::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54231::DEBUG::2014-05-16 17:35:47,860::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54231::DEBUG::2014-05-16 17:35:47,860::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54231::DEBUG::2014-05-16 17:35:47,860::task::974::TaskManager.Task::(_decref) Task=`8a048855-39ce-4233-9c10-17ed949bfe86`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:35:48,357::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:48,423::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309095 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:50,435::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:50,506::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352428 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:52,518::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:52,585::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353834 s, 28.9 MB/s\n'; <rc> = 0 >Thread-54233::DEBUG::2014-05-16 17:35:53,710::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315804.000000 / 8.008442 / 262500000.000000 = 0.205298 >Thread-54233::DEBUG::2014-05-16 17:35:53,710::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052751951472924151, 'statsAge': 0.36908984184265137, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20529783145889119, 'rxDropped': 0} >Thread-54233::DEBUG::2014-05-16 17:35:53,711::task::579::TaskManager.Task::(_updateState) Task=`3d9ce29c-74a3-45f0-ad1a-98b69ddaebed`::moving from state init -> state preparing >Thread-54233::INFO::2014-05-16 17:35:53,711::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54233::INFO::2014-05-16 17:35:53,711::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000736395', 'lastCheck': '8.5', 'valid': True}} >Thread-54233::DEBUG::2014-05-16 17:35:53,711::task::1168::TaskManager.Task::(prepare) Task=`3d9ce29c-74a3-45f0-ad1a-98b69ddaebed`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000736395', 'lastCheck': '8.5', 'valid': True}} >Thread-54233::DEBUG::2014-05-16 17:35:53,711::task::579::TaskManager.Task::(_updateState) Task=`3d9ce29c-74a3-45f0-ad1a-98b69ddaebed`::moving from state preparing -> state finished >Thread-54233::DEBUG::2014-05-16 17:35:53,711::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54233::DEBUG::2014-05-16 17:35:53,712::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54233::DEBUG::2014-05-16 17:35:53,712::task::974::TaskManager.Task::(_decref) Task=`3d9ce29c-74a3-45f0-ad1a-98b69ddaebed`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:35:54,592::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:54,658::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297103 s, 34.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:35:55,216::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:35:55,226::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756501 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:35:56,670::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:56,737::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320955 s, 31.9 MB/s\n'; <rc> = 0 >Thread-54236::DEBUG::2014-05-16 17:35:57,906::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54236::DEBUG::2014-05-16 17:35:57,906::task::579::TaskManager.Task::(_updateState) Task=`19e74bb0-d106-45af-b6e5-7a5eaa9a320b`::moving from state init -> state preparing >Thread-54236::INFO::2014-05-16 17:35:57,907::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54236::INFO::2014-05-16 17:35:57,907::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54236::DEBUG::2014-05-16 17:35:57,907::task::1168::TaskManager.Task::(prepare) Task=`19e74bb0-d106-45af-b6e5-7a5eaa9a320b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54236::DEBUG::2014-05-16 17:35:57,907::task::579::TaskManager.Task::(_updateState) Task=`19e74bb0-d106-45af-b6e5-7a5eaa9a320b`::moving from state preparing -> state finished >Thread-54236::DEBUG::2014-05-16 17:35:57,907::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54236::DEBUG::2014-05-16 17:35:57,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54236::DEBUG::2014-05-16 17:35:57,908::task::974::TaskManager.Task::(_decref) Task=`19e74bb0-d106-45af-b6e5-7a5eaa9a320b`::ref 0 aborting False >Thread-54237::DEBUG::2014-05-16 17:35:57,916::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54237::DEBUG::2014-05-16 17:35:57,917::task::579::TaskManager.Task::(_updateState) Task=`74bd4065-6fd7-4aa4-bfbe-d583317b6c5c`::moving from state init -> state preparing >Thread-54237::INFO::2014-05-16 17:35:57,917::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54237::DEBUG::2014-05-16 17:35:57,917::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fa95b25f-e24b-4745-aa65-1359b56c86cc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54237::DEBUG::2014-05-16 17:35:57,917::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54237::DEBUG::2014-05-16 17:35:57,918::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54237::DEBUG::2014-05-16 17:35:57,918::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fa95b25f-e24b-4745-aa65-1359b56c86cc`::Granted request >Thread-54237::DEBUG::2014-05-16 17:35:57,918::task::811::TaskManager.Task::(resourceAcquired) Task=`74bd4065-6fd7-4aa4-bfbe-d583317b6c5c`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54237::DEBUG::2014-05-16 17:35:57,918::task::974::TaskManager.Task::(_decref) Task=`74bd4065-6fd7-4aa4-bfbe-d583317b6c5c`::ref 1 aborting False >Thread-54237::INFO::2014-05-16 17:35:57,919::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54237::DEBUG::2014-05-16 17:35:57,919::task::1168::TaskManager.Task::(prepare) Task=`74bd4065-6fd7-4aa4-bfbe-d583317b6c5c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54237::DEBUG::2014-05-16 17:35:57,919::task::579::TaskManager.Task::(_updateState) Task=`74bd4065-6fd7-4aa4-bfbe-d583317b6c5c`::moving from state preparing -> state finished >Thread-54237::DEBUG::2014-05-16 17:35:57,919::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54237::DEBUG::2014-05-16 17:35:57,919::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54237::DEBUG::2014-05-16 17:35:57,920::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54237::DEBUG::2014-05-16 17:35:57,920::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54237::DEBUG::2014-05-16 17:35:57,920::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54237::DEBUG::2014-05-16 17:35:57,920::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54237::DEBUG::2014-05-16 17:35:57,920::task::974::TaskManager.Task::(_decref) Task=`74bd4065-6fd7-4aa4-bfbe-d583317b6c5c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:35:58,749::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:35:58,817::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032083 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:00,829::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:00,901::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359279 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:02,912::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:02,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306742 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:04,991::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:05,059::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316253 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:36:05,264::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:36:05,275::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000817747 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:07,071::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:07,143::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352226 s, 29.1 MB/s\n'; <rc> = 0 >Thread-54241::DEBUG::2014-05-16 17:36:07,958::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54241::DEBUG::2014-05-16 17:36:07,959::task::579::TaskManager.Task::(_updateState) Task=`a51917ca-4e34-4d51-9d8b-569ae00dfd8d`::moving from state init -> state preparing >Thread-54241::INFO::2014-05-16 17:36:07,959::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54241::INFO::2014-05-16 17:36:07,959::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54241::DEBUG::2014-05-16 17:36:07,959::task::1168::TaskManager.Task::(prepare) Task=`a51917ca-4e34-4d51-9d8b-569ae00dfd8d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54241::DEBUG::2014-05-16 17:36:07,959::task::579::TaskManager.Task::(_updateState) Task=`a51917ca-4e34-4d51-9d8b-569ae00dfd8d`::moving from state preparing -> state finished >Thread-54241::DEBUG::2014-05-16 17:36:07,959::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54241::DEBUG::2014-05-16 17:36:07,960::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54241::DEBUG::2014-05-16 17:36:07,960::task::974::TaskManager.Task::(_decref) Task=`a51917ca-4e34-4d51-9d8b-569ae00dfd8d`::ref 0 aborting False >Thread-54242::DEBUG::2014-05-16 17:36:07,970::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54242::DEBUG::2014-05-16 17:36:07,970::task::579::TaskManager.Task::(_updateState) Task=`9ff821e2-7fbe-4fba-b58e-c843c275beb8`::moving from state init -> state preparing >Thread-54242::INFO::2014-05-16 17:36:07,970::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54242::DEBUG::2014-05-16 17:36:07,970::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`eabb613f-3653-4276-afe6-feeba2a055fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54242::DEBUG::2014-05-16 17:36:07,970::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54242::DEBUG::2014-05-16 17:36:07,971::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54242::DEBUG::2014-05-16 17:36:07,971::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`eabb613f-3653-4276-afe6-feeba2a055fd`::Granted request >Thread-54242::DEBUG::2014-05-16 17:36:07,971::task::811::TaskManager.Task::(resourceAcquired) Task=`9ff821e2-7fbe-4fba-b58e-c843c275beb8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54242::DEBUG::2014-05-16 17:36:07,971::task::974::TaskManager.Task::(_decref) Task=`9ff821e2-7fbe-4fba-b58e-c843c275beb8`::ref 1 aborting False >Thread-54242::INFO::2014-05-16 17:36:07,972::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54242::DEBUG::2014-05-16 17:36:07,972::task::1168::TaskManager.Task::(prepare) Task=`9ff821e2-7fbe-4fba-b58e-c843c275beb8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54242::DEBUG::2014-05-16 17:36:07,972::task::579::TaskManager.Task::(_updateState) Task=`9ff821e2-7fbe-4fba-b58e-c843c275beb8`::moving from state preparing -> state finished >Thread-54242::DEBUG::2014-05-16 17:36:07,972::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54242::DEBUG::2014-05-16 17:36:07,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54242::DEBUG::2014-05-16 17:36:07,973::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54242::DEBUG::2014-05-16 17:36:07,973::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54242::DEBUG::2014-05-16 17:36:07,973::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54242::DEBUG::2014-05-16 17:36:07,973::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54242::DEBUG::2014-05-16 17:36:07,973::task::974::TaskManager.Task::(_decref) Task=`9ff821e2-7fbe-4fba-b58e-c843c275beb8`::ref 0 aborting False >Thread-54243::DEBUG::2014-05-16 17:36:08,852::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4056779.000000 / 8.008475 / 262500000.000000 = 0.192976 >Thread-54243::DEBUG::2014-05-16 17:36:08,852::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0048198463169597328, 'statsAge': 1.4962799549102783, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.19297551736873383, 'rxDropped': 0} >Thread-54243::DEBUG::2014-05-16 17:36:08,853::task::579::TaskManager.Task::(_updateState) Task=`507cf362-77db-476e-bcf1-c0356032fea0`::moving from state init -> state preparing >Thread-54243::INFO::2014-05-16 17:36:08,853::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54243::INFO::2014-05-16 17:36:08,853::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000817747', 'lastCheck': '3.6', 'valid': True}} >Thread-54243::DEBUG::2014-05-16 17:36:08,853::task::1168::TaskManager.Task::(prepare) Task=`507cf362-77db-476e-bcf1-c0356032fea0`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000817747', 'lastCheck': '3.6', 'valid': True}} >Thread-54243::DEBUG::2014-05-16 17:36:08,853::task::579::TaskManager.Task::(_updateState) Task=`507cf362-77db-476e-bcf1-c0356032fea0`::moving from state preparing -> state finished >Thread-54243::DEBUG::2014-05-16 17:36:08,853::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54243::DEBUG::2014-05-16 17:36:08,853::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54243::DEBUG::2014-05-16 17:36:08,854::task::974::TaskManager.Task::(_decref) Task=`507cf362-77db-476e-bcf1-c0356032fea0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:36:09,154::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:09,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322357 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:11,233::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:11,301::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318337 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:13,313::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:13,390::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353323 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:36:15,311::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:36:15,321::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597939 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:15,401::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:15,471::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343182 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:17,483::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:17,549::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305961 s, 33.5 MB/s\n'; <rc> = 0 >Thread-54248::DEBUG::2014-05-16 17:36:18,010::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54248::DEBUG::2014-05-16 17:36:18,011::task::579::TaskManager.Task::(_updateState) Task=`bb7dc227-ca6e-4316-9747-de36a16f997d`::moving from state init -> state preparing >Thread-54248::INFO::2014-05-16 17:36:18,011::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54248::INFO::2014-05-16 17:36:18,011::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54248::DEBUG::2014-05-16 17:36:18,012::task::1168::TaskManager.Task::(prepare) Task=`bb7dc227-ca6e-4316-9747-de36a16f997d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54248::DEBUG::2014-05-16 17:36:18,012::task::579::TaskManager.Task::(_updateState) Task=`bb7dc227-ca6e-4316-9747-de36a16f997d`::moving from state preparing -> state finished >Thread-54248::DEBUG::2014-05-16 17:36:18,012::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54248::DEBUG::2014-05-16 17:36:18,012::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54248::DEBUG::2014-05-16 17:36:18,012::task::974::TaskManager.Task::(_decref) Task=`bb7dc227-ca6e-4316-9747-de36a16f997d`::ref 0 aborting False >Thread-54249::DEBUG::2014-05-16 17:36:18,020::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54249::DEBUG::2014-05-16 17:36:18,020::task::579::TaskManager.Task::(_updateState) Task=`55fddded-9657-483d-aeff-727e371c9124`::moving from state init -> state preparing >Thread-54249::INFO::2014-05-16 17:36:18,020::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54249::DEBUG::2014-05-16 17:36:18,021::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c00edbc2-430e-4029-8110-dd3985f175a4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54249::DEBUG::2014-05-16 17:36:18,021::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54249::DEBUG::2014-05-16 17:36:18,021::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54249::DEBUG::2014-05-16 17:36:18,021::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c00edbc2-430e-4029-8110-dd3985f175a4`::Granted request >Thread-54249::DEBUG::2014-05-16 17:36:18,022::task::811::TaskManager.Task::(resourceAcquired) Task=`55fddded-9657-483d-aeff-727e371c9124`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54249::DEBUG::2014-05-16 17:36:18,022::task::974::TaskManager.Task::(_decref) Task=`55fddded-9657-483d-aeff-727e371c9124`::ref 1 aborting False >Thread-54249::INFO::2014-05-16 17:36:18,022::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54249::DEBUG::2014-05-16 17:36:18,023::task::1168::TaskManager.Task::(prepare) Task=`55fddded-9657-483d-aeff-727e371c9124`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54249::DEBUG::2014-05-16 17:36:18,023::task::579::TaskManager.Task::(_updateState) Task=`55fddded-9657-483d-aeff-727e371c9124`::moving from state preparing -> state finished >Thread-54249::DEBUG::2014-05-16 17:36:18,023::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54249::DEBUG::2014-05-16 17:36:18,023::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54249::DEBUG::2014-05-16 17:36:18,023::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54249::DEBUG::2014-05-16 17:36:18,023::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54249::DEBUG::2014-05-16 17:36:18,024::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54249::DEBUG::2014-05-16 17:36:18,024::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54249::DEBUG::2014-05-16 17:36:18,024::task::974::TaskManager.Task::(_decref) Task=`55fddded-9657-483d-aeff-727e371c9124`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:36:19,561::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:19,629::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03127 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:21,640::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:21,711::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349703 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:23,722::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:23,790::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311 s, 32.9 MB/s\n'; <rc> = 0 >Thread-54251::DEBUG::2014-05-16 17:36:24,022::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314588.000000 / 8.008297 / 262500000.000000 = 0.205244 >Thread-54251::DEBUG::2014-05-16 17:36:24,022::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054009699701720731, 'statsAge': 0.64651703834533691, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20524370890507834, 'rxDropped': 0} >Thread-54251::DEBUG::2014-05-16 17:36:24,023::task::579::TaskManager.Task::(_updateState) Task=`70744489-a6de-4bbe-8cde-24d158d8baea`::moving from state init -> state preparing >Thread-54251::INFO::2014-05-16 17:36:24,023::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54251::INFO::2014-05-16 17:36:24,023::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597939', 'lastCheck': '8.7', 'valid': True}} >Thread-54251::DEBUG::2014-05-16 17:36:24,023::task::1168::TaskManager.Task::(prepare) Task=`70744489-a6de-4bbe-8cde-24d158d8baea`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597939', 'lastCheck': '8.7', 'valid': True}} >Thread-54251::DEBUG::2014-05-16 17:36:24,023::task::579::TaskManager.Task::(_updateState) Task=`70744489-a6de-4bbe-8cde-24d158d8baea`::moving from state preparing -> state finished >Thread-54251::DEBUG::2014-05-16 17:36:24,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54251::DEBUG::2014-05-16 17:36:24,024::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54251::DEBUG::2014-05-16 17:36:24,024::task::974::TaskManager.Task::(_decref) Task=`70744489-a6de-4bbe-8cde-24d158d8baea`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:36:25,341::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 17:36:25,342::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:36:25,360::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:36:25,368::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000805363 s, 2.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:36:25,368::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000805363 s, 2.5 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 17:36:25,369::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 17:36:25,369::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 17:36:25,369::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:36:25,369::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:36:25,369::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:36:25,370::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:36:25,370::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:36:25,370::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:36:25,371::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:36:25,522::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:36:25,524::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:36:25,525::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 17:36:25,526::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 17:36:25,526::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 17:36:25,526::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 17:36:25,526::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:36:25,668::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:36:25,688::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:36:25,698::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581158 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:25,802::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:25,873::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349176 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:27,885::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:27,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359473 s, 28.5 MB/s\n'; <rc> = 0 >Thread-54254::DEBUG::2014-05-16 17:36:28,069::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54254::DEBUG::2014-05-16 17:36:28,069::task::579::TaskManager.Task::(_updateState) Task=`01809658-3d38-4453-868c-3ebf4a0db11c`::moving from state init -> state preparing >Thread-54254::INFO::2014-05-16 17:36:28,070::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54254::INFO::2014-05-16 17:36:28,070::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54254::DEBUG::2014-05-16 17:36:28,070::task::1168::TaskManager.Task::(prepare) Task=`01809658-3d38-4453-868c-3ebf4a0db11c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54254::DEBUG::2014-05-16 17:36:28,070::task::579::TaskManager.Task::(_updateState) Task=`01809658-3d38-4453-868c-3ebf4a0db11c`::moving from state preparing -> state finished >Thread-54254::DEBUG::2014-05-16 17:36:28,070::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54254::DEBUG::2014-05-16 17:36:28,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54254::DEBUG::2014-05-16 17:36:28,071::task::974::TaskManager.Task::(_decref) Task=`01809658-3d38-4453-868c-3ebf4a0db11c`::ref 0 aborting False >Thread-54255::DEBUG::2014-05-16 17:36:28,079::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54255::DEBUG::2014-05-16 17:36:28,079::task::579::TaskManager.Task::(_updateState) Task=`a96343e5-934c-43d1-9360-0d445b3e10fa`::moving from state init -> state preparing >Thread-54255::INFO::2014-05-16 17:36:28,080::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54255::DEBUG::2014-05-16 17:36:28,080::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`927cb7ba-5a48-4824-85b7-a22bdfe43add`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54255::DEBUG::2014-05-16 17:36:28,080::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54255::DEBUG::2014-05-16 17:36:28,080::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54255::DEBUG::2014-05-16 17:36:28,080::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`927cb7ba-5a48-4824-85b7-a22bdfe43add`::Granted request >Thread-54255::DEBUG::2014-05-16 17:36:28,081::task::811::TaskManager.Task::(resourceAcquired) Task=`a96343e5-934c-43d1-9360-0d445b3e10fa`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54255::DEBUG::2014-05-16 17:36:28,081::task::974::TaskManager.Task::(_decref) Task=`a96343e5-934c-43d1-9360-0d445b3e10fa`::ref 1 aborting False >Thread-54255::INFO::2014-05-16 17:36:28,082::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54255::DEBUG::2014-05-16 17:36:28,082::task::1168::TaskManager.Task::(prepare) Task=`a96343e5-934c-43d1-9360-0d445b3e10fa`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54255::DEBUG::2014-05-16 17:36:28,082::task::579::TaskManager.Task::(_updateState) Task=`a96343e5-934c-43d1-9360-0d445b3e10fa`::moving from state preparing -> state finished >Thread-54255::DEBUG::2014-05-16 17:36:28,082::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54255::DEBUG::2014-05-16 17:36:28,082::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54255::DEBUG::2014-05-16 17:36:28,083::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54255::DEBUG::2014-05-16 17:36:28,083::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54255::DEBUG::2014-05-16 17:36:28,083::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54255::DEBUG::2014-05-16 17:36:28,083::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54255::DEBUG::2014-05-16 17:36:28,083::task::974::TaskManager.Task::(_decref) Task=`a96343e5-934c-43d1-9360-0d445b3e10fa`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:36:29,968::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:30,036::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313995 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:32,048::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:32,117::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310608 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:34,129::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:34,200::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349075 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:36:35,735::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:36:35,745::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000577028 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:36,211::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:36,281::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340548 s, 30.1 MB/s\n'; <rc> = 0 >Thread-54259::DEBUG::2014-05-16 17:36:38,110::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54259::DEBUG::2014-05-16 17:36:38,111::task::579::TaskManager.Task::(_updateState) Task=`ee72deb1-1f1a-450c-8b0c-4953b540a293`::moving from state init -> state preparing >Thread-54259::INFO::2014-05-16 17:36:38,111::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54259::INFO::2014-05-16 17:36:38,111::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54259::DEBUG::2014-05-16 17:36:38,111::task::1168::TaskManager.Task::(prepare) Task=`ee72deb1-1f1a-450c-8b0c-4953b540a293`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54259::DEBUG::2014-05-16 17:36:38,112::task::579::TaskManager.Task::(_updateState) Task=`ee72deb1-1f1a-450c-8b0c-4953b540a293`::moving from state preparing -> state finished >Thread-54259::DEBUG::2014-05-16 17:36:38,112::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54259::DEBUG::2014-05-16 17:36:38,112::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54259::DEBUG::2014-05-16 17:36:38,112::task::974::TaskManager.Task::(_decref) Task=`ee72deb1-1f1a-450c-8b0c-4953b540a293`::ref 0 aborting False >Thread-54260::DEBUG::2014-05-16 17:36:38,122::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54260::DEBUG::2014-05-16 17:36:38,122::task::579::TaskManager.Task::(_updateState) Task=`3dd294c9-9e4d-404b-8d65-8436662d822a`::moving from state init -> state preparing >Thread-54260::INFO::2014-05-16 17:36:38,122::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54260::DEBUG::2014-05-16 17:36:38,122::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9d15d907-405b-48ea-906d-889dc3b1cd7b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54260::DEBUG::2014-05-16 17:36:38,123::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54260::DEBUG::2014-05-16 17:36:38,123::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54260::DEBUG::2014-05-16 17:36:38,123::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9d15d907-405b-48ea-906d-889dc3b1cd7b`::Granted request >Thread-54260::DEBUG::2014-05-16 17:36:38,123::task::811::TaskManager.Task::(resourceAcquired) Task=`3dd294c9-9e4d-404b-8d65-8436662d822a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54260::DEBUG::2014-05-16 17:36:38,123::task::974::TaskManager.Task::(_decref) Task=`3dd294c9-9e4d-404b-8d65-8436662d822a`::ref 1 aborting False >Thread-54260::INFO::2014-05-16 17:36:38,124::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54260::DEBUG::2014-05-16 17:36:38,124::task::1168::TaskManager.Task::(prepare) Task=`3dd294c9-9e4d-404b-8d65-8436662d822a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54260::DEBUG::2014-05-16 17:36:38,124::task::579::TaskManager.Task::(_updateState) Task=`3dd294c9-9e4d-404b-8d65-8436662d822a`::moving from state preparing -> state finished >Thread-54260::DEBUG::2014-05-16 17:36:38,124::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54260::DEBUG::2014-05-16 17:36:38,124::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54260::DEBUG::2014-05-16 17:36:38,125::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54260::DEBUG::2014-05-16 17:36:38,125::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54260::DEBUG::2014-05-16 17:36:38,125::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54260::DEBUG::2014-05-16 17:36:38,125::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54260::DEBUG::2014-05-16 17:36:38,125::task::974::TaskManager.Task::(_decref) Task=`3dd294c9-9e4d-404b-8d65-8436662d822a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:36:38,292::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:38,359::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311507 s, 32.9 MB/s\n'; <rc> = 0 >Thread-54261::DEBUG::2014-05-16 17:36:39,176::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5408833.000000 / 8.008400 / 262500000.000000 = 0.257293 >Thread-54261::DEBUG::2014-05-16 17:36:39,176::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0063925257819176283, 'statsAge': 1.7837238311767578, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25729331172302411, 'rxDropped': 0} >Thread-54261::DEBUG::2014-05-16 17:36:39,177::task::579::TaskManager.Task::(_updateState) Task=`541eb5cf-3274-47a1-b2a1-18428bab674b`::moving from state init -> state preparing >Thread-54261::INFO::2014-05-16 17:36:39,177::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54261::INFO::2014-05-16 17:36:39,177::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577028', 'lastCheck': '3.4', 'valid': True}} >Thread-54261::DEBUG::2014-05-16 17:36:39,177::task::1168::TaskManager.Task::(prepare) Task=`541eb5cf-3274-47a1-b2a1-18428bab674b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577028', 'lastCheck': '3.4', 'valid': True}} >Thread-54261::DEBUG::2014-05-16 17:36:39,178::task::579::TaskManager.Task::(_updateState) Task=`541eb5cf-3274-47a1-b2a1-18428bab674b`::moving from state preparing -> state finished >Thread-54261::DEBUG::2014-05-16 17:36:39,178::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54261::DEBUG::2014-05-16 17:36:39,178::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54261::DEBUG::2014-05-16 17:36:39,178::task::974::TaskManager.Task::(_decref) Task=`541eb5cf-3274-47a1-b2a1-18428bab674b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:36:40,371::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:40,442::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355876 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:42,454::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:42,520::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303273 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:44,532::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:44,601::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315542 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:36:45,782::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:36:45,793::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000831303 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:46,612::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:46,679::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310969 s, 32.9 MB/s\n'; <rc> = 0 >Thread-54265::DEBUG::2014-05-16 17:36:48,167::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54265::DEBUG::2014-05-16 17:36:48,168::task::579::TaskManager.Task::(_updateState) Task=`32b51e93-624d-4ce6-9ebc-4f7232b436f6`::moving from state init -> state preparing >Thread-54265::INFO::2014-05-16 17:36:48,168::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54265::INFO::2014-05-16 17:36:48,168::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54265::DEBUG::2014-05-16 17:36:48,168::task::1168::TaskManager.Task::(prepare) Task=`32b51e93-624d-4ce6-9ebc-4f7232b436f6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54265::DEBUG::2014-05-16 17:36:48,168::task::579::TaskManager.Task::(_updateState) Task=`32b51e93-624d-4ce6-9ebc-4f7232b436f6`::moving from state preparing -> state finished >Thread-54265::DEBUG::2014-05-16 17:36:48,169::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54265::DEBUG::2014-05-16 17:36:48,169::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54265::DEBUG::2014-05-16 17:36:48,169::task::974::TaskManager.Task::(_decref) Task=`32b51e93-624d-4ce6-9ebc-4f7232b436f6`::ref 0 aborting False >Thread-54266::DEBUG::2014-05-16 17:36:48,178::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54266::DEBUG::2014-05-16 17:36:48,179::task::579::TaskManager.Task::(_updateState) Task=`92f4ab3b-5d8c-404f-b53d-29cf207165c9`::moving from state init -> state preparing >Thread-54266::INFO::2014-05-16 17:36:48,179::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54266::DEBUG::2014-05-16 17:36:48,179::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`05713d42-8b6d-498a-b49d-7d7b6146ee6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54266::DEBUG::2014-05-16 17:36:48,179::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54266::DEBUG::2014-05-16 17:36:48,180::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54266::DEBUG::2014-05-16 17:36:48,180::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`05713d42-8b6d-498a-b49d-7d7b6146ee6c`::Granted request >Thread-54266::DEBUG::2014-05-16 17:36:48,180::task::811::TaskManager.Task::(resourceAcquired) Task=`92f4ab3b-5d8c-404f-b53d-29cf207165c9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54266::DEBUG::2014-05-16 17:36:48,180::task::974::TaskManager.Task::(_decref) Task=`92f4ab3b-5d8c-404f-b53d-29cf207165c9`::ref 1 aborting False >Thread-54266::INFO::2014-05-16 17:36:48,181::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54266::DEBUG::2014-05-16 17:36:48,182::task::1168::TaskManager.Task::(prepare) Task=`92f4ab3b-5d8c-404f-b53d-29cf207165c9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54266::DEBUG::2014-05-16 17:36:48,182::task::579::TaskManager.Task::(_updateState) Task=`92f4ab3b-5d8c-404f-b53d-29cf207165c9`::moving from state preparing -> state finished >Thread-54266::DEBUG::2014-05-16 17:36:48,182::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54266::DEBUG::2014-05-16 17:36:48,182::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54266::DEBUG::2014-05-16 17:36:48,182::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54266::DEBUG::2014-05-16 17:36:48,182::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54266::DEBUG::2014-05-16 17:36:48,183::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54266::DEBUG::2014-05-16 17:36:48,183::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54266::DEBUG::2014-05-16 17:36:48,183::task::974::TaskManager.Task::(_decref) Task=`92f4ab3b-5d8c-404f-b53d-29cf207165c9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:36:48,691::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:48,762::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351579 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:50,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:50,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356402 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:52,856::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:52,923::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307953 s, 33.3 MB/s\n'; <rc> = 0 >Thread-54269::DEBUG::2014-05-16 17:36:54,379::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3239830.000000 / 8.008443 / 262500000.000000 = 0.154115 >Thread-54269::DEBUG::2014-05-16 17:36:54,379::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.004163035071400068, 'statsAge': 0.96956610679626465, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15411497229505555, 'rxDropped': 0} >Thread-54269::DEBUG::2014-05-16 17:36:54,380::task::579::TaskManager.Task::(_updateState) Task=`db250c77-07eb-422e-a22f-91ef61d489b4`::moving from state init -> state preparing >Thread-54269::INFO::2014-05-16 17:36:54,380::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54269::INFO::2014-05-16 17:36:54,380::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000831303', 'lastCheck': '8.6', 'valid': True}} >Thread-54269::DEBUG::2014-05-16 17:36:54,380::task::1168::TaskManager.Task::(prepare) Task=`db250c77-07eb-422e-a22f-91ef61d489b4`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000831303', 'lastCheck': '8.6', 'valid': True}} >Thread-54269::DEBUG::2014-05-16 17:36:54,380::task::579::TaskManager.Task::(_updateState) Task=`db250c77-07eb-422e-a22f-91ef61d489b4`::moving from state preparing -> state finished >Thread-54269::DEBUG::2014-05-16 17:36:54,381::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54269::DEBUG::2014-05-16 17:36:54,381::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54269::DEBUG::2014-05-16 17:36:54,381::task::974::TaskManager.Task::(_decref) Task=`db250c77-07eb-422e-a22f-91ef61d489b4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:36:54,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:55,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035648 s, 28.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:36:55,827::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:36:55,837::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579748 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:36:57,018::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:57,090::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349219 s, 29.3 MB/s\n'; <rc> = 0 >Thread-54272::DEBUG::2014-05-16 17:36:58,224::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54272::DEBUG::2014-05-16 17:36:58,225::task::579::TaskManager.Task::(_updateState) Task=`446e9dcc-22b1-4626-93bf-622f00137470`::moving from state init -> state preparing >Thread-54272::INFO::2014-05-16 17:36:58,225::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54272::INFO::2014-05-16 17:36:58,225::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54272::DEBUG::2014-05-16 17:36:58,226::task::1168::TaskManager.Task::(prepare) Task=`446e9dcc-22b1-4626-93bf-622f00137470`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54272::DEBUG::2014-05-16 17:36:58,226::task::579::TaskManager.Task::(_updateState) Task=`446e9dcc-22b1-4626-93bf-622f00137470`::moving from state preparing -> state finished >Thread-54272::DEBUG::2014-05-16 17:36:58,226::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54272::DEBUG::2014-05-16 17:36:58,226::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54272::DEBUG::2014-05-16 17:36:58,226::task::974::TaskManager.Task::(_decref) Task=`446e9dcc-22b1-4626-93bf-622f00137470`::ref 0 aborting False >Thread-54273::DEBUG::2014-05-16 17:36:58,234::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54273::DEBUG::2014-05-16 17:36:58,235::task::579::TaskManager.Task::(_updateState) Task=`bfb4c08b-c8c0-4043-bbe0-0025bbe96ddb`::moving from state init -> state preparing >Thread-54273::INFO::2014-05-16 17:36:58,235::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54273::DEBUG::2014-05-16 17:36:58,235::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`509c2c1a-c75a-45d1-884b-020e79adab79`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54273::DEBUG::2014-05-16 17:36:58,235::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54273::DEBUG::2014-05-16 17:36:58,236::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54273::DEBUG::2014-05-16 17:36:58,236::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`509c2c1a-c75a-45d1-884b-020e79adab79`::Granted request >Thread-54273::DEBUG::2014-05-16 17:36:58,236::task::811::TaskManager.Task::(resourceAcquired) Task=`bfb4c08b-c8c0-4043-bbe0-0025bbe96ddb`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54273::DEBUG::2014-05-16 17:36:58,236::task::974::TaskManager.Task::(_decref) Task=`bfb4c08b-c8c0-4043-bbe0-0025bbe96ddb`::ref 1 aborting False >Thread-54273::INFO::2014-05-16 17:36:58,237::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54273::DEBUG::2014-05-16 17:36:58,237::task::1168::TaskManager.Task::(prepare) Task=`bfb4c08b-c8c0-4043-bbe0-0025bbe96ddb`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54273::DEBUG::2014-05-16 17:36:58,237::task::579::TaskManager.Task::(_updateState) Task=`bfb4c08b-c8c0-4043-bbe0-0025bbe96ddb`::moving from state preparing -> state finished >Thread-54273::DEBUG::2014-05-16 17:36:58,238::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54273::DEBUG::2014-05-16 17:36:58,238::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54273::DEBUG::2014-05-16 17:36:58,238::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54273::DEBUG::2014-05-16 17:36:58,238::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54273::DEBUG::2014-05-16 17:36:58,238::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54273::DEBUG::2014-05-16 17:36:58,238::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54273::DEBUG::2014-05-16 17:36:58,239::task::974::TaskManager.Task::(_decref) Task=`bfb4c08b-c8c0-4043-bbe0-0025bbe96ddb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:36:59,102::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:36:59,169::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309356 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:01,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:01,253::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353409 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:03,264::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:03,332::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308251 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:05,344::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:05,411::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315838 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:37:05,875::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:37:05,885::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0007936 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:07,423::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:07,494::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348588 s, 29.4 MB/s\n'; <rc> = 0 >Thread-54277::DEBUG::2014-05-16 17:37:08,277::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54277::DEBUG::2014-05-16 17:37:08,278::task::579::TaskManager.Task::(_updateState) Task=`ae61ce8c-1ded-43d4-a468-a74cf4619211`::moving from state init -> state preparing >Thread-54277::INFO::2014-05-16 17:37:08,278::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54277::INFO::2014-05-16 17:37:08,278::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54277::DEBUG::2014-05-16 17:37:08,279::task::1168::TaskManager.Task::(prepare) Task=`ae61ce8c-1ded-43d4-a468-a74cf4619211`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54277::DEBUG::2014-05-16 17:37:08,279::task::579::TaskManager.Task::(_updateState) Task=`ae61ce8c-1ded-43d4-a468-a74cf4619211`::moving from state preparing -> state finished >Thread-54277::DEBUG::2014-05-16 17:37:08,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54277::DEBUG::2014-05-16 17:37:08,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54277::DEBUG::2014-05-16 17:37:08,279::task::974::TaskManager.Task::(_decref) Task=`ae61ce8c-1ded-43d4-a468-a74cf4619211`::ref 0 aborting False >Thread-54278::DEBUG::2014-05-16 17:37:08,288::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54278::DEBUG::2014-05-16 17:37:08,288::task::579::TaskManager.Task::(_updateState) Task=`9609fb70-bf10-4d0e-8023-1e7b7f350910`::moving from state init -> state preparing >Thread-54278::INFO::2014-05-16 17:37:08,288::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54278::DEBUG::2014-05-16 17:37:08,289::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8957cdb3-a689-4ece-a9d3-51c11af986c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54278::DEBUG::2014-05-16 17:37:08,289::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54278::DEBUG::2014-05-16 17:37:08,289::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54278::DEBUG::2014-05-16 17:37:08,289::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8957cdb3-a689-4ece-a9d3-51c11af986c9`::Granted request >Thread-54278::DEBUG::2014-05-16 17:37:08,289::task::811::TaskManager.Task::(resourceAcquired) Task=`9609fb70-bf10-4d0e-8023-1e7b7f350910`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54278::DEBUG::2014-05-16 17:37:08,289::task::974::TaskManager.Task::(_decref) Task=`9609fb70-bf10-4d0e-8023-1e7b7f350910`::ref 1 aborting False >Thread-54278::INFO::2014-05-16 17:37:08,290::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54278::DEBUG::2014-05-16 17:37:08,290::task::1168::TaskManager.Task::(prepare) Task=`9609fb70-bf10-4d0e-8023-1e7b7f350910`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54278::DEBUG::2014-05-16 17:37:08,290::task::579::TaskManager.Task::(_updateState) Task=`9609fb70-bf10-4d0e-8023-1e7b7f350910`::moving from state preparing -> state finished >Thread-54278::DEBUG::2014-05-16 17:37:08,290::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54278::DEBUG::2014-05-16 17:37:08,291::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54278::DEBUG::2014-05-16 17:37:08,291::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54278::DEBUG::2014-05-16 17:37:08,291::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54278::DEBUG::2014-05-16 17:37:08,291::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54278::DEBUG::2014-05-16 17:37:08,291::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54278::DEBUG::2014-05-16 17:37:08,291::task::974::TaskManager.Task::(_decref) Task=`9609fb70-bf10-4d0e-8023-1e7b7f350910`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:37:09,506::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54279::DEBUG::2014-05-16 17:37:09,528::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313155.000000 / 8.015649 / 262500000.000000 = 0.204987 >Thread-54279::DEBUG::2014-05-16 17:37:09,529::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052803377703261435, 'statsAge': 0.095056056976318359, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20498735649275507, 'rxDropped': 0} >Thread-54279::DEBUG::2014-05-16 17:37:09,529::task::579::TaskManager.Task::(_updateState) Task=`3c3dadca-359a-4b9c-8e4a-03bf778d8d48`::moving from state init -> state preparing >Thread-54279::INFO::2014-05-16 17:37:09,530::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54279::INFO::2014-05-16 17:37:09,530::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0007936', 'lastCheck': '3.6', 'valid': True}} >Thread-54279::DEBUG::2014-05-16 17:37:09,530::task::1168::TaskManager.Task::(prepare) Task=`3c3dadca-359a-4b9c-8e4a-03bf778d8d48`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0007936', 'lastCheck': '3.6', 'valid': True}} >Thread-54279::DEBUG::2014-05-16 17:37:09,530::task::579::TaskManager.Task::(_updateState) Task=`3c3dadca-359a-4b9c-8e4a-03bf778d8d48`::moving from state preparing -> state finished >Thread-54279::DEBUG::2014-05-16 17:37:09,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54279::DEBUG::2014-05-16 17:37:09,531::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54279::DEBUG::2014-05-16 17:37:09,531::task::974::TaskManager.Task::(_decref) Task=`3c3dadca-359a-4b9c-8e4a-03bf778d8d48`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:37:09,583::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391932 s, 26.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:11,594::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:11,661::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304656 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:13,673::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:13,739::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309058 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:15,751::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:15,823::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359332 s, 28.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:37:15,923::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:37:15,933::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000802482 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:17,834::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:17,902::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306526 s, 33.4 MB/s\n'; <rc> = 0 >Thread-54283::DEBUG::2014-05-16 17:37:18,320::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54283::DEBUG::2014-05-16 17:37:18,321::task::579::TaskManager.Task::(_updateState) Task=`52097130-e921-4ed2-b8f3-53ca3b2fee83`::moving from state init -> state preparing >Thread-54283::INFO::2014-05-16 17:37:18,322::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54283::INFO::2014-05-16 17:37:18,322::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54283::DEBUG::2014-05-16 17:37:18,322::task::1168::TaskManager.Task::(prepare) Task=`52097130-e921-4ed2-b8f3-53ca3b2fee83`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54283::DEBUG::2014-05-16 17:37:18,322::task::579::TaskManager.Task::(_updateState) Task=`52097130-e921-4ed2-b8f3-53ca3b2fee83`::moving from state preparing -> state finished >Thread-54283::DEBUG::2014-05-16 17:37:18,322::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54283::DEBUG::2014-05-16 17:37:18,322::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54283::DEBUG::2014-05-16 17:37:18,323::task::974::TaskManager.Task::(_decref) Task=`52097130-e921-4ed2-b8f3-53ca3b2fee83`::ref 0 aborting False >Thread-54284::DEBUG::2014-05-16 17:37:18,331::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54284::DEBUG::2014-05-16 17:37:18,331::task::579::TaskManager.Task::(_updateState) Task=`1c25649b-d0c2-42b5-a7fc-7db60e509e7b`::moving from state init -> state preparing >Thread-54284::INFO::2014-05-16 17:37:18,331::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54284::DEBUG::2014-05-16 17:37:18,332::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0fd2ff1c-f633-4ed4-b763-e80bbd17cbbc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54284::DEBUG::2014-05-16 17:37:18,332::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54284::DEBUG::2014-05-16 17:37:18,332::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54284::DEBUG::2014-05-16 17:37:18,332::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0fd2ff1c-f633-4ed4-b763-e80bbd17cbbc`::Granted request >Thread-54284::DEBUG::2014-05-16 17:37:18,333::task::811::TaskManager.Task::(resourceAcquired) Task=`1c25649b-d0c2-42b5-a7fc-7db60e509e7b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54284::DEBUG::2014-05-16 17:37:18,333::task::974::TaskManager.Task::(_decref) Task=`1c25649b-d0c2-42b5-a7fc-7db60e509e7b`::ref 1 aborting False >Thread-54284::INFO::2014-05-16 17:37:18,334::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54284::DEBUG::2014-05-16 17:37:18,334::task::1168::TaskManager.Task::(prepare) Task=`1c25649b-d0c2-42b5-a7fc-7db60e509e7b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54284::DEBUG::2014-05-16 17:37:18,334::task::579::TaskManager.Task::(_updateState) Task=`1c25649b-d0c2-42b5-a7fc-7db60e509e7b`::moving from state preparing -> state finished >Thread-54284::DEBUG::2014-05-16 17:37:18,334::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54284::DEBUG::2014-05-16 17:37:18,334::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54284::DEBUG::2014-05-16 17:37:18,334::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54284::DEBUG::2014-05-16 17:37:18,335::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54284::DEBUG::2014-05-16 17:37:18,335::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54284::DEBUG::2014-05-16 17:37:18,335::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54284::DEBUG::2014-05-16 17:37:18,335::task::974::TaskManager.Task::(_decref) Task=`1c25649b-d0c2-42b5-a7fc-7db60e509e7b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:37:19,914::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:19,983::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321316 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:21,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:22,152::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352419 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:24,231::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:24,297::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301318 s, 34.0 MB/s\n'; <rc> = 0 >Thread-54287::DEBUG::2014-05-16 17:37:24,725::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413430.000000 / 8.008276 / 262500000.000000 = 0.257516 >Thread-54287::DEBUG::2014-05-16 17:37:24,725::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0067448320071395408, 'statsAge': 1.2775352001190186, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25751598112964008, 'rxDropped': 0} >Thread-54287::DEBUG::2014-05-16 17:37:24,726::task::579::TaskManager.Task::(_updateState) Task=`4902b3b1-4b83-4f3c-aa1d-3b5a24a43661`::moving from state init -> state preparing >Thread-54287::INFO::2014-05-16 17:37:24,726::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54287::INFO::2014-05-16 17:37:24,726::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000802482', 'lastCheck': '8.8', 'valid': True}} >Thread-54287::DEBUG::2014-05-16 17:37:24,727::task::1168::TaskManager.Task::(prepare) Task=`4902b3b1-4b83-4f3c-aa1d-3b5a24a43661`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000802482', 'lastCheck': '8.8', 'valid': True}} >Thread-54287::DEBUG::2014-05-16 17:37:24,727::task::579::TaskManager.Task::(_updateState) Task=`4902b3b1-4b83-4f3c-aa1d-3b5a24a43661`::moving from state preparing -> state finished >Thread-54287::DEBUG::2014-05-16 17:37:24,727::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54287::DEBUG::2014-05-16 17:37:24,727::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54287::DEBUG::2014-05-16 17:37:24,727::task::974::TaskManager.Task::(_decref) Task=`4902b3b1-4b83-4f3c-aa1d-3b5a24a43661`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:37:25,968::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:37:25,979::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104825 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:26,309::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:26,380::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355317 s, 28.8 MB/s\n'; <rc> = 0 >Thread-54290::DEBUG::2014-05-16 17:37:28,380::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54290::DEBUG::2014-05-16 17:37:28,380::task::579::TaskManager.Task::(_updateState) Task=`c983a0d2-9ebc-4e74-85e2-b43f3fb533c8`::moving from state init -> state preparing >Thread-54290::INFO::2014-05-16 17:37:28,380::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54290::INFO::2014-05-16 17:37:28,381::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54290::DEBUG::2014-05-16 17:37:28,381::task::1168::TaskManager.Task::(prepare) Task=`c983a0d2-9ebc-4e74-85e2-b43f3fb533c8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54290::DEBUG::2014-05-16 17:37:28,381::task::579::TaskManager.Task::(_updateState) Task=`c983a0d2-9ebc-4e74-85e2-b43f3fb533c8`::moving from state preparing -> state finished >Thread-54290::DEBUG::2014-05-16 17:37:28,381::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54290::DEBUG::2014-05-16 17:37:28,381::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54290::DEBUG::2014-05-16 17:37:28,382::task::974::TaskManager.Task::(_decref) Task=`c983a0d2-9ebc-4e74-85e2-b43f3fb533c8`::ref 0 aborting False >Thread-54291::DEBUG::2014-05-16 17:37:28,390::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54291::DEBUG::2014-05-16 17:37:28,390::task::579::TaskManager.Task::(_updateState) Task=`8cacbbfb-5b62-4921-b838-b0cc7ec80a02`::moving from state init -> state preparing >Thread-54291::INFO::2014-05-16 17:37:28,391::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54291::DEBUG::2014-05-16 17:37:28,391::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3a7f4f95-4cff-446b-bd4b-614b93c8e422`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54291::DEBUG::2014-05-16 17:37:28,391::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54291::DEBUG::2014-05-16 17:37:28,391::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54291::DEBUG::2014-05-16 17:37:28,392::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3a7f4f95-4cff-446b-bd4b-614b93c8e422`::Granted request >Thread-54291::DEBUG::2014-05-16 17:37:28,393::task::811::TaskManager.Task::(resourceAcquired) Task=`8cacbbfb-5b62-4921-b838-b0cc7ec80a02`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Dummy-51::DEBUG::2014-05-16 17:37:28,393::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54291::DEBUG::2014-05-16 17:37:28,393::task::974::TaskManager.Task::(_decref) Task=`8cacbbfb-5b62-4921-b838-b0cc7ec80a02`::ref 1 aborting False >Thread-54291::INFO::2014-05-16 17:37:28,403::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54291::DEBUG::2014-05-16 17:37:28,403::task::1168::TaskManager.Task::(prepare) Task=`8cacbbfb-5b62-4921-b838-b0cc7ec80a02`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54291::DEBUG::2014-05-16 17:37:28,403::task::579::TaskManager.Task::(_updateState) Task=`8cacbbfb-5b62-4921-b838-b0cc7ec80a02`::moving from state preparing -> state finished >Thread-54291::DEBUG::2014-05-16 17:37:28,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54291::DEBUG::2014-05-16 17:37:28,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54291::DEBUG::2014-05-16 17:37:28,404::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54291::DEBUG::2014-05-16 17:37:28,404::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54291::DEBUG::2014-05-16 17:37:28,404::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54291::DEBUG::2014-05-16 17:37:28,405::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54291::DEBUG::2014-05-16 17:37:28,405::task::974::TaskManager.Task::(_decref) Task=`8cacbbfb-5b62-4921-b838-b0cc7ec80a02`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:37:28,465::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035267 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:30,477::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:30,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312424 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:32,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:32,625::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307215 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:34,637::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:34,703::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308303 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:37:36,015::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:37:36,026::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112121 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:36,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:36,794::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0432318 s, 23.7 MB/s\n'; <rc> = 0 >Thread-54295::DEBUG::2014-05-16 17:37:38,444::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [db6c4f8] >Thread-54295::DEBUG::2014-05-16 17:37:38,444::task::579::TaskManager.Task::(_updateState) Task=`279ebc4e-d088-433c-b9cc-aa4f0ef993d7`::moving from state init -> state preparing >Thread-54295::INFO::2014-05-16 17:37:38,444::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54295::INFO::2014-05-16 17:37:38,445::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54295::DEBUG::2014-05-16 17:37:38,445::task::1168::TaskManager.Task::(prepare) Task=`279ebc4e-d088-433c-b9cc-aa4f0ef993d7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54295::DEBUG::2014-05-16 17:37:38,445::task::579::TaskManager.Task::(_updateState) Task=`279ebc4e-d088-433c-b9cc-aa4f0ef993d7`::moving from state preparing -> state finished >Thread-54295::DEBUG::2014-05-16 17:37:38,445::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54295::DEBUG::2014-05-16 17:37:38,445::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54295::DEBUG::2014-05-16 17:37:38,445::task::974::TaskManager.Task::(_decref) Task=`279ebc4e-d088-433c-b9cc-aa4f0ef993d7`::ref 0 aborting False >Thread-54296::DEBUG::2014-05-16 17:37:38,459::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [db6c4f8] >Thread-54296::DEBUG::2014-05-16 17:37:38,459::task::579::TaskManager.Task::(_updateState) Task=`4a16b872-775a-411a-b0ce-92d1c0e5ee7d`::moving from state init -> state preparing >Thread-54296::INFO::2014-05-16 17:37:38,460::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54296::DEBUG::2014-05-16 17:37:38,460::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`613bcbb9-2114-48b5-993b-b1f5e1c03c01`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54296::DEBUG::2014-05-16 17:37:38,460::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54296::DEBUG::2014-05-16 17:37:38,460::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54296::DEBUG::2014-05-16 17:37:38,460::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`613bcbb9-2114-48b5-993b-b1f5e1c03c01`::Granted request >Thread-54296::DEBUG::2014-05-16 17:37:38,461::task::811::TaskManager.Task::(resourceAcquired) Task=`4a16b872-775a-411a-b0ce-92d1c0e5ee7d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54296::DEBUG::2014-05-16 17:37:38,461::task::974::TaskManager.Task::(_decref) Task=`4a16b872-775a-411a-b0ce-92d1c0e5ee7d`::ref 1 aborting False >Thread-54296::INFO::2014-05-16 17:37:38,461::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54296::DEBUG::2014-05-16 17:37:38,462::task::1168::TaskManager.Task::(prepare) Task=`4a16b872-775a-411a-b0ce-92d1c0e5ee7d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54296::DEBUG::2014-05-16 17:37:38,462::task::579::TaskManager.Task::(_updateState) Task=`4a16b872-775a-411a-b0ce-92d1c0e5ee7d`::moving from state preparing -> state finished >Thread-54296::DEBUG::2014-05-16 17:37:38,462::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54296::DEBUG::2014-05-16 17:37:38,462::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54296::DEBUG::2014-05-16 17:37:38,462::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54296::DEBUG::2014-05-16 17:37:38,462::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54296::DEBUG::2014-05-16 17:37:38,463::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54296::DEBUG::2014-05-16 17:37:38,463::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54296::DEBUG::2014-05-16 17:37:38,463::task::974::TaskManager.Task::(_decref) Task=`4a16b872-775a-411a-b0ce-92d1c0e5ee7d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:37:38,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:38,873::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309514 s, 33.1 MB/s\n'; <rc> = 0 >Thread-54297::DEBUG::2014-05-16 17:37:39,920::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4339458.000000 / 8.008453 / 262500000.000000 = 0.206423 >Thread-54297::DEBUG::2014-05-16 17:37:39,920::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054043847417584489, 'statsAge': 0.45544886589050293, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20642274233973201, 'rxDropped': 0} >Thread-54297::DEBUG::2014-05-16 17:37:39,920::task::579::TaskManager.Task::(_updateState) Task=`42c56aed-32f2-47c8-829d-7901b2871c50`::moving from state init -> state preparing >Thread-54297::INFO::2014-05-16 17:37:39,921::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54297::INFO::2014-05-16 17:37:39,921::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112121', 'lastCheck': '3.9', 'valid': True}} >Thread-54297::DEBUG::2014-05-16 17:37:39,921::task::1168::TaskManager.Task::(prepare) Task=`42c56aed-32f2-47c8-829d-7901b2871c50`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112121', 'lastCheck': '3.9', 'valid': True}} >Thread-54297::DEBUG::2014-05-16 17:37:39,921::task::579::TaskManager.Task::(_updateState) Task=`42c56aed-32f2-47c8-829d-7901b2871c50`::moving from state preparing -> state finished >Thread-54297::DEBUG::2014-05-16 17:37:39,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54297::DEBUG::2014-05-16 17:37:39,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54297::DEBUG::2014-05-16 17:37:39,922::task::974::TaskManager.Task::(_decref) Task=`42c56aed-32f2-47c8-829d-7901b2871c50`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:37:40,884::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:40,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353041 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:42,969::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:43,048::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349921 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:45,060::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:45,128::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314275 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:37:46,064::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:37:46,074::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607664 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:47,139::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:47,206::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304838 s, 33.6 MB/s\n'; <rc> = 0 >Thread-54301::DEBUG::2014-05-16 17:37:48,506::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54301::DEBUG::2014-05-16 17:37:48,506::task::579::TaskManager.Task::(_updateState) Task=`aa613f25-f129-4f72-a9e9-688c48e67389`::moving from state init -> state preparing >Thread-54301::INFO::2014-05-16 17:37:48,507::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54301::INFO::2014-05-16 17:37:48,507::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54301::DEBUG::2014-05-16 17:37:48,507::task::1168::TaskManager.Task::(prepare) Task=`aa613f25-f129-4f72-a9e9-688c48e67389`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54301::DEBUG::2014-05-16 17:37:48,507::task::579::TaskManager.Task::(_updateState) Task=`aa613f25-f129-4f72-a9e9-688c48e67389`::moving from state preparing -> state finished >Thread-54301::DEBUG::2014-05-16 17:37:48,507::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54301::DEBUG::2014-05-16 17:37:48,507::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54301::DEBUG::2014-05-16 17:37:48,508::task::974::TaskManager.Task::(_decref) Task=`aa613f25-f129-4f72-a9e9-688c48e67389`::ref 0 aborting False >Thread-54302::DEBUG::2014-05-16 17:37:48,517::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54302::DEBUG::2014-05-16 17:37:48,517::task::579::TaskManager.Task::(_updateState) Task=`0c9e664c-ce25-4ab2-ac0e-7b860b435d57`::moving from state init -> state preparing >Thread-54302::INFO::2014-05-16 17:37:48,518::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54302::DEBUG::2014-05-16 17:37:48,518::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`747227dd-8f0f-4ec3-adca-a769d9614e67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54302::DEBUG::2014-05-16 17:37:48,518::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54302::DEBUG::2014-05-16 17:37:48,518::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54302::DEBUG::2014-05-16 17:37:48,519::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`747227dd-8f0f-4ec3-adca-a769d9614e67`::Granted request >Thread-54302::DEBUG::2014-05-16 17:37:48,519::task::811::TaskManager.Task::(resourceAcquired) Task=`0c9e664c-ce25-4ab2-ac0e-7b860b435d57`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54302::DEBUG::2014-05-16 17:37:48,519::task::974::TaskManager.Task::(_decref) Task=`0c9e664c-ce25-4ab2-ac0e-7b860b435d57`::ref 1 aborting False >Thread-54302::INFO::2014-05-16 17:37:48,520::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54302::DEBUG::2014-05-16 17:37:48,520::task::1168::TaskManager.Task::(prepare) Task=`0c9e664c-ce25-4ab2-ac0e-7b860b435d57`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54302::DEBUG::2014-05-16 17:37:48,520::task::579::TaskManager.Task::(_updateState) Task=`0c9e664c-ce25-4ab2-ac0e-7b860b435d57`::moving from state preparing -> state finished >Thread-54302::DEBUG::2014-05-16 17:37:48,520::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54302::DEBUG::2014-05-16 17:37:48,520::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54302::DEBUG::2014-05-16 17:37:48,521::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54302::DEBUG::2014-05-16 17:37:48,521::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54302::DEBUG::2014-05-16 17:37:48,521::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54302::DEBUG::2014-05-16 17:37:48,521::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54302::DEBUG::2014-05-16 17:37:48,521::task::974::TaskManager.Task::(_decref) Task=`0c9e664c-ce25-4ab2-ac0e-7b860b435d57`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:37:49,218::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:49,289::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351206 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:51,300::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:51,372::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360097 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:53,384::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:53,450::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308968 s, 33.1 MB/s\n'; <rc> = 0 >Thread-54305::DEBUG::2014-05-16 17:37:55,086::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4312746.000000 / 8.008440 / 262500000.000000 = 0.205152 >Thread-54305::DEBUG::2014-05-16 17:37:55,086::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053686218064017532, 'statsAge': 1.6068611145019531, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20515242088491883, 'rxDropped': 0} >Thread-54305::DEBUG::2014-05-16 17:37:55,087::task::579::TaskManager.Task::(_updateState) Task=`69748ef0-4e3e-468c-9dd9-a11aa21f11a1`::moving from state init -> state preparing >Thread-54305::INFO::2014-05-16 17:37:55,087::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54305::INFO::2014-05-16 17:37:55,087::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607664', 'lastCheck': '9.0', 'valid': True}} >Thread-54305::DEBUG::2014-05-16 17:37:55,087::task::1168::TaskManager.Task::(prepare) Task=`69748ef0-4e3e-468c-9dd9-a11aa21f11a1`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607664', 'lastCheck': '9.0', 'valid': True}} >Thread-54305::DEBUG::2014-05-16 17:37:55,088::task::579::TaskManager.Task::(_updateState) Task=`69748ef0-4e3e-468c-9dd9-a11aa21f11a1`::moving from state preparing -> state finished >Thread-54305::DEBUG::2014-05-16 17:37:55,088::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54305::DEBUG::2014-05-16 17:37:55,088::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54305::DEBUG::2014-05-16 17:37:55,088::task::974::TaskManager.Task::(_decref) Task=`69748ef0-4e3e-468c-9dd9-a11aa21f11a1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:37:55,462::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:55,537::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394291 s, 26.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:37:56,111::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:37:56,121::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00077078 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:37:57,549::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:57,619::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340585 s, 30.1 MB/s\n'; <rc> = 0 >Thread-54308::DEBUG::2014-05-16 17:37:58,673::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54308::DEBUG::2014-05-16 17:37:58,673::task::579::TaskManager.Task::(_updateState) Task=`73c107cd-ae09-47c8-8b95-500b410b3a76`::moving from state init -> state preparing >Thread-54308::INFO::2014-05-16 17:37:58,673::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54308::INFO::2014-05-16 17:37:58,674::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54308::DEBUG::2014-05-16 17:37:58,674::task::1168::TaskManager.Task::(prepare) Task=`73c107cd-ae09-47c8-8b95-500b410b3a76`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54308::DEBUG::2014-05-16 17:37:58,674::task::579::TaskManager.Task::(_updateState) Task=`73c107cd-ae09-47c8-8b95-500b410b3a76`::moving from state preparing -> state finished >Thread-54308::DEBUG::2014-05-16 17:37:58,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54308::DEBUG::2014-05-16 17:37:58,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54308::DEBUG::2014-05-16 17:37:58,674::task::974::TaskManager.Task::(_decref) Task=`73c107cd-ae09-47c8-8b95-500b410b3a76`::ref 0 aborting False >Thread-54309::DEBUG::2014-05-16 17:37:58,683::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54309::DEBUG::2014-05-16 17:37:58,683::task::579::TaskManager.Task::(_updateState) Task=`ed8f9cdb-4c8c-4564-9841-40718f7e9813`::moving from state init -> state preparing >Thread-54309::INFO::2014-05-16 17:37:58,683::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54309::DEBUG::2014-05-16 17:37:58,684::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f5989087-6c99-4719-a360-377c21887493`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54309::DEBUG::2014-05-16 17:37:58,684::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54309::DEBUG::2014-05-16 17:37:58,684::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54309::DEBUG::2014-05-16 17:37:58,684::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f5989087-6c99-4719-a360-377c21887493`::Granted request >Thread-54309::DEBUG::2014-05-16 17:37:58,684::task::811::TaskManager.Task::(resourceAcquired) Task=`ed8f9cdb-4c8c-4564-9841-40718f7e9813`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54309::DEBUG::2014-05-16 17:37:58,685::task::974::TaskManager.Task::(_decref) Task=`ed8f9cdb-4c8c-4564-9841-40718f7e9813`::ref 1 aborting False >Thread-54309::INFO::2014-05-16 17:37:58,685::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54309::DEBUG::2014-05-16 17:37:58,685::task::1168::TaskManager.Task::(prepare) Task=`ed8f9cdb-4c8c-4564-9841-40718f7e9813`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54309::DEBUG::2014-05-16 17:37:58,685::task::579::TaskManager.Task::(_updateState) Task=`ed8f9cdb-4c8c-4564-9841-40718f7e9813`::moving from state preparing -> state finished >Thread-54309::DEBUG::2014-05-16 17:37:58,686::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54309::DEBUG::2014-05-16 17:37:58,686::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54309::DEBUG::2014-05-16 17:37:58,686::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54309::DEBUG::2014-05-16 17:37:58,686::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54309::DEBUG::2014-05-16 17:37:58,686::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54309::DEBUG::2014-05-16 17:37:58,686::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54309::DEBUG::2014-05-16 17:37:58,687::task::974::TaskManager.Task::(_decref) Task=`ed8f9cdb-4c8c-4564-9841-40718f7e9813`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:37:59,631::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:37:59,699::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314811 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:01,710::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:01,777::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304403 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:03,788::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:03,859::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347657 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:05,870::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:05,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036402 s, 28.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:38:06,159::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:38:06,169::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000804038 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:07,955::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:08,023::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320693 s, 31.9 MB/s\n'; <rc> = 0 >Thread-54313::DEBUG::2014-05-16 17:38:08,724::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54313::DEBUG::2014-05-16 17:38:08,725::task::579::TaskManager.Task::(_updateState) Task=`2ef63626-53d1-4389-a05f-a240b3ca30f5`::moving from state init -> state preparing >Thread-54313::INFO::2014-05-16 17:38:08,726::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54313::INFO::2014-05-16 17:38:08,726::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54313::DEBUG::2014-05-16 17:38:08,726::task::1168::TaskManager.Task::(prepare) Task=`2ef63626-53d1-4389-a05f-a240b3ca30f5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54313::DEBUG::2014-05-16 17:38:08,726::task::579::TaskManager.Task::(_updateState) Task=`2ef63626-53d1-4389-a05f-a240b3ca30f5`::moving from state preparing -> state finished >Thread-54313::DEBUG::2014-05-16 17:38:08,726::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54313::DEBUG::2014-05-16 17:38:08,727::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54313::DEBUG::2014-05-16 17:38:08,727::task::974::TaskManager.Task::(_decref) Task=`2ef63626-53d1-4389-a05f-a240b3ca30f5`::ref 0 aborting False >Thread-54314::DEBUG::2014-05-16 17:38:08,735::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54314::DEBUG::2014-05-16 17:38:08,735::task::579::TaskManager.Task::(_updateState) Task=`3664d284-6c11-4064-b19c-1cf8dc070fa9`::moving from state init -> state preparing >Thread-54314::INFO::2014-05-16 17:38:08,735::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54314::DEBUG::2014-05-16 17:38:08,736::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6fe7898b-05f8-4a13-a560-38213940eb7b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54314::DEBUG::2014-05-16 17:38:08,736::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54314::DEBUG::2014-05-16 17:38:08,736::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54314::DEBUG::2014-05-16 17:38:08,736::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6fe7898b-05f8-4a13-a560-38213940eb7b`::Granted request >Thread-54314::DEBUG::2014-05-16 17:38:08,736::task::811::TaskManager.Task::(resourceAcquired) Task=`3664d284-6c11-4064-b19c-1cf8dc070fa9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54314::DEBUG::2014-05-16 17:38:08,737::task::974::TaskManager.Task::(_decref) Task=`3664d284-6c11-4064-b19c-1cf8dc070fa9`::ref 1 aborting False >Thread-54314::INFO::2014-05-16 17:38:08,737::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54314::DEBUG::2014-05-16 17:38:08,737::task::1168::TaskManager.Task::(prepare) Task=`3664d284-6c11-4064-b19c-1cf8dc070fa9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54314::DEBUG::2014-05-16 17:38:08,738::task::579::TaskManager.Task::(_updateState) Task=`3664d284-6c11-4064-b19c-1cf8dc070fa9`::moving from state preparing -> state finished >Thread-54314::DEBUG::2014-05-16 17:38:08,738::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54314::DEBUG::2014-05-16 17:38:08,738::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54314::DEBUG::2014-05-16 17:38:08,738::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54314::DEBUG::2014-05-16 17:38:08,738::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54314::DEBUG::2014-05-16 17:38:08,738::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54314::DEBUG::2014-05-16 17:38:08,739::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54314::DEBUG::2014-05-16 17:38:08,739::task::974::TaskManager.Task::(_decref) Task=`3664d284-6c11-4064-b19c-1cf8dc070fa9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:38:10,035::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:10,107::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357183 s, 28.7 MB/s\n'; <rc> = 0 >Thread-54315::DEBUG::2014-05-16 17:38:10,255::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313833.000000 / 8.008253 / 262500000.000000 = 0.205209 >Thread-54315::DEBUG::2014-05-16 17:38:10,255::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053691278347174701, 'statsAge': 0.75644302368164062, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20520892400523416, 'rxDropped': 0} >Thread-54315::DEBUG::2014-05-16 17:38:10,256::task::579::TaskManager.Task::(_updateState) Task=`d9291ec2-1736-4812-adf8-e790a56654b6`::moving from state init -> state preparing >Thread-54315::INFO::2014-05-16 17:38:10,256::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54315::INFO::2014-05-16 17:38:10,256::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000804038', 'lastCheck': '4.1', 'valid': True}} >Thread-54315::DEBUG::2014-05-16 17:38:10,256::task::1168::TaskManager.Task::(prepare) Task=`d9291ec2-1736-4812-adf8-e790a56654b6`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000804038', 'lastCheck': '4.1', 'valid': True}} >Thread-54315::DEBUG::2014-05-16 17:38:10,257::task::579::TaskManager.Task::(_updateState) Task=`d9291ec2-1736-4812-adf8-e790a56654b6`::moving from state preparing -> state finished >Thread-54315::DEBUG::2014-05-16 17:38:10,257::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54315::DEBUG::2014-05-16 17:38:10,257::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54315::DEBUG::2014-05-16 17:38:10,257::task::974::TaskManager.Task::(_decref) Task=`d9291ec2-1736-4812-adf8-e790a56654b6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:38:12,119::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:12,190::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348887 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:14,202::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:14,269::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314284 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:38:16,206::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:38:16,217::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106339 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:16,281::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:16,352::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350307 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:18,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:18,432::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303037 s, 33.8 MB/s\n'; <rc> = 0 >Thread-54319::DEBUG::2014-05-16 17:38:18,785::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54319::DEBUG::2014-05-16 17:38:18,785::task::579::TaskManager.Task::(_updateState) Task=`1e4e484c-ec97-4ce0-ac7f-6dc71874f25c`::moving from state init -> state preparing >Thread-54319::INFO::2014-05-16 17:38:18,786::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54319::INFO::2014-05-16 17:38:18,786::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54319::DEBUG::2014-05-16 17:38:18,786::task::1168::TaskManager.Task::(prepare) Task=`1e4e484c-ec97-4ce0-ac7f-6dc71874f25c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54319::DEBUG::2014-05-16 17:38:18,786::task::579::TaskManager.Task::(_updateState) Task=`1e4e484c-ec97-4ce0-ac7f-6dc71874f25c`::moving from state preparing -> state finished >Thread-54319::DEBUG::2014-05-16 17:38:18,786::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54319::DEBUG::2014-05-16 17:38:18,787::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54319::DEBUG::2014-05-16 17:38:18,787::task::974::TaskManager.Task::(_decref) Task=`1e4e484c-ec97-4ce0-ac7f-6dc71874f25c`::ref 0 aborting False >Thread-54320::DEBUG::2014-05-16 17:38:18,795::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54320::DEBUG::2014-05-16 17:38:18,795::task::579::TaskManager.Task::(_updateState) Task=`94f8f9ce-4f4c-492a-b00d-5c8d2f8bb37b`::moving from state init -> state preparing >Thread-54320::INFO::2014-05-16 17:38:18,796::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54320::DEBUG::2014-05-16 17:38:18,796::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`235ce526-9b47-4ae2-8995-e4d693756221`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54320::DEBUG::2014-05-16 17:38:18,796::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54320::DEBUG::2014-05-16 17:38:18,796::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54320::DEBUG::2014-05-16 17:38:18,797::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`235ce526-9b47-4ae2-8995-e4d693756221`::Granted request >Thread-54320::DEBUG::2014-05-16 17:38:18,797::task::811::TaskManager.Task::(resourceAcquired) Task=`94f8f9ce-4f4c-492a-b00d-5c8d2f8bb37b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54320::DEBUG::2014-05-16 17:38:18,797::task::974::TaskManager.Task::(_decref) Task=`94f8f9ce-4f4c-492a-b00d-5c8d2f8bb37b`::ref 1 aborting False >Thread-54320::INFO::2014-05-16 17:38:18,798::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54320::DEBUG::2014-05-16 17:38:18,798::task::1168::TaskManager.Task::(prepare) Task=`94f8f9ce-4f4c-492a-b00d-5c8d2f8bb37b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54320::DEBUG::2014-05-16 17:38:18,798::task::579::TaskManager.Task::(_updateState) Task=`94f8f9ce-4f4c-492a-b00d-5c8d2f8bb37b`::moving from state preparing -> state finished >Thread-54320::DEBUG::2014-05-16 17:38:18,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54320::DEBUG::2014-05-16 17:38:18,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54320::DEBUG::2014-05-16 17:38:18,799::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54320::DEBUG::2014-05-16 17:38:18,799::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54320::DEBUG::2014-05-16 17:38:18,799::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54320::DEBUG::2014-05-16 17:38:18,799::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54320::DEBUG::2014-05-16 17:38:18,799::task::974::TaskManager.Task::(_decref) Task=`94f8f9ce-4f4c-492a-b00d-5c8d2f8bb37b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:38:20,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:20,511::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315482 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:22,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:22,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038914 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:24,609::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:24,675::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309075 s, 33.1 MB/s\n'; <rc> = 0 >Thread-54323::DEBUG::2014-05-16 17:38:25,462::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413538.000000 / 8.008357 / 262500000.000000 = 0.257519 >Thread-54323::DEBUG::2014-05-16 17:38:25,462::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066659888822913965, 'statsAge': 1.9481830596923828, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25751851198771164, 'rxDropped': 0} >Thread-54323::DEBUG::2014-05-16 17:38:25,462::task::579::TaskManager.Task::(_updateState) Task=`fa9264e4-5a70-4841-ac70-030c201aa31c`::moving from state init -> state preparing >Thread-54323::INFO::2014-05-16 17:38:25,463::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54323::INFO::2014-05-16 17:38:25,463::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106339', 'lastCheck': '9.2', 'valid': True}} >Thread-54323::DEBUG::2014-05-16 17:38:25,463::task::1168::TaskManager.Task::(prepare) Task=`fa9264e4-5a70-4841-ac70-030c201aa31c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106339', 'lastCheck': '9.2', 'valid': True}} >Thread-54323::DEBUG::2014-05-16 17:38:25,463::task::579::TaskManager.Task::(_updateState) Task=`fa9264e4-5a70-4841-ac70-030c201aa31c`::moving from state preparing -> state finished >Thread-54323::DEBUG::2014-05-16 17:38:25,463::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54323::DEBUG::2014-05-16 17:38:25,463::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54323::DEBUG::2014-05-16 17:38:25,464::task::974::TaskManager.Task::(_decref) Task=`fa9264e4-5a70-4841-ac70-030c201aa31c`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:38:26,254::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:38:26,264::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102795 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:26,686::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:26,757::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352612 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:28,769::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:28,837::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310926 s, 32.9 MB/s\n'; <rc> = 0 >Thread-54326::DEBUG::2014-05-16 17:38:28,842::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54326::DEBUG::2014-05-16 17:38:28,843::task::579::TaskManager.Task::(_updateState) Task=`ee8267ee-afbc-4992-9eff-a23368d77719`::moving from state init -> state preparing >Thread-54326::INFO::2014-05-16 17:38:28,844::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54326::INFO::2014-05-16 17:38:28,846::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54326::DEBUG::2014-05-16 17:38:28,846::task::1168::TaskManager.Task::(prepare) Task=`ee8267ee-afbc-4992-9eff-a23368d77719`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54326::DEBUG::2014-05-16 17:38:28,847::task::579::TaskManager.Task::(_updateState) Task=`ee8267ee-afbc-4992-9eff-a23368d77719`::moving from state preparing -> state finished >Thread-54326::DEBUG::2014-05-16 17:38:28,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54326::DEBUG::2014-05-16 17:38:28,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54326::DEBUG::2014-05-16 17:38:28,849::task::974::TaskManager.Task::(_decref) Task=`ee8267ee-afbc-4992-9eff-a23368d77719`::ref 0 aborting False >Thread-54327::DEBUG::2014-05-16 17:38:28,861::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54327::DEBUG::2014-05-16 17:38:28,862::task::579::TaskManager.Task::(_updateState) Task=`7537eaf3-968e-410f-b287-e1f41883a789`::moving from state init -> state preparing >Thread-54327::INFO::2014-05-16 17:38:28,863::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54327::DEBUG::2014-05-16 17:38:28,865::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d80c89ae-5fe3-4837-a191-5b23c0f6038e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54327::DEBUG::2014-05-16 17:38:28,865::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54327::DEBUG::2014-05-16 17:38:28,866::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54327::DEBUG::2014-05-16 17:38:28,867::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d80c89ae-5fe3-4837-a191-5b23c0f6038e`::Granted request >Thread-54327::DEBUG::2014-05-16 17:38:28,869::task::811::TaskManager.Task::(resourceAcquired) Task=`7537eaf3-968e-410f-b287-e1f41883a789`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54327::DEBUG::2014-05-16 17:38:28,869::task::974::TaskManager.Task::(_decref) Task=`7537eaf3-968e-410f-b287-e1f41883a789`::ref 1 aborting False >Thread-54327::INFO::2014-05-16 17:38:28,870::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54327::DEBUG::2014-05-16 17:38:28,870::task::1168::TaskManager.Task::(prepare) Task=`7537eaf3-968e-410f-b287-e1f41883a789`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54327::DEBUG::2014-05-16 17:38:28,870::task::579::TaskManager.Task::(_updateState) Task=`7537eaf3-968e-410f-b287-e1f41883a789`::moving from state preparing -> state finished >Thread-54327::DEBUG::2014-05-16 17:38:28,870::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54327::DEBUG::2014-05-16 17:38:28,870::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54327::DEBUG::2014-05-16 17:38:28,871::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54327::DEBUG::2014-05-16 17:38:28,871::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54327::DEBUG::2014-05-16 17:38:28,871::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54327::DEBUG::2014-05-16 17:38:28,871::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54327::DEBUG::2014-05-16 17:38:28,871::task::974::TaskManager.Task::(_decref) Task=`7537eaf3-968e-410f-b287-e1f41883a789`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:38:30,871::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:30,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358708 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:32,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:33,021::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304828 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:35,033::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:35,102::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324162 s, 31.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:38:36,301::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:38:36,312::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108829 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:37,113::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:37,184::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351891 s, 29.1 MB/s\n'; <rc> = 0 >Thread-54331::DEBUG::2014-05-16 17:38:38,901::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54331::DEBUG::2014-05-16 17:38:38,901::task::579::TaskManager.Task::(_updateState) Task=`918dee96-875a-4e4f-850f-d78342ba661b`::moving from state init -> state preparing >Thread-54331::INFO::2014-05-16 17:38:38,902::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54331::INFO::2014-05-16 17:38:38,902::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54331::DEBUG::2014-05-16 17:38:38,902::task::1168::TaskManager.Task::(prepare) Task=`918dee96-875a-4e4f-850f-d78342ba661b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54331::DEBUG::2014-05-16 17:38:38,902::task::579::TaskManager.Task::(_updateState) Task=`918dee96-875a-4e4f-850f-d78342ba661b`::moving from state preparing -> state finished >Thread-54331::DEBUG::2014-05-16 17:38:38,902::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54331::DEBUG::2014-05-16 17:38:38,902::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54331::DEBUG::2014-05-16 17:38:38,902::task::974::TaskManager.Task::(_decref) Task=`918dee96-875a-4e4f-850f-d78342ba661b`::ref 0 aborting False >Thread-54332::DEBUG::2014-05-16 17:38:38,912::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54332::DEBUG::2014-05-16 17:38:38,912::task::579::TaskManager.Task::(_updateState) Task=`6c2c5095-b7d1-49ad-b8e6-71cc072545cd`::moving from state init -> state preparing >Thread-54332::INFO::2014-05-16 17:38:38,912::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54332::DEBUG::2014-05-16 17:38:38,912::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`772ec9ae-01bc-49af-98db-481aa2b6c255`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54332::DEBUG::2014-05-16 17:38:38,913::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54332::DEBUG::2014-05-16 17:38:38,913::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54332::DEBUG::2014-05-16 17:38:38,913::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`772ec9ae-01bc-49af-98db-481aa2b6c255`::Granted request >Thread-54332::DEBUG::2014-05-16 17:38:38,913::task::811::TaskManager.Task::(resourceAcquired) Task=`6c2c5095-b7d1-49ad-b8e6-71cc072545cd`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54332::DEBUG::2014-05-16 17:38:38,913::task::974::TaskManager.Task::(_decref) Task=`6c2c5095-b7d1-49ad-b8e6-71cc072545cd`::ref 1 aborting False >Thread-54332::INFO::2014-05-16 17:38:38,914::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54332::DEBUG::2014-05-16 17:38:38,914::task::1168::TaskManager.Task::(prepare) Task=`6c2c5095-b7d1-49ad-b8e6-71cc072545cd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54332::DEBUG::2014-05-16 17:38:38,914::task::579::TaskManager.Task::(_updateState) Task=`6c2c5095-b7d1-49ad-b8e6-71cc072545cd`::moving from state preparing -> state finished >Thread-54332::DEBUG::2014-05-16 17:38:38,914::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54332::DEBUG::2014-05-16 17:38:38,914::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54332::DEBUG::2014-05-16 17:38:38,915::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54332::DEBUG::2014-05-16 17:38:38,915::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54332::DEBUG::2014-05-16 17:38:38,915::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54332::DEBUG::2014-05-16 17:38:38,915::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54332::DEBUG::2014-05-16 17:38:38,915::task::974::TaskManager.Task::(_decref) Task=`6c2c5095-b7d1-49ad-b8e6-71cc072545cd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:38:39,196::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:39,262::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303072 s, 33.8 MB/s\n'; <rc> = 0 >Thread-54333::DEBUG::2014-05-16 17:38:40,614::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5408153.000000 / 8.008617 / 262500000.000000 = 0.257254 >Thread-54333::DEBUG::2014-05-16 17:38:40,615::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.006380365704214408, 'statsAge': 1.0839929580688477, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25725400295488221, 'rxDropped': 0} >Thread-54333::DEBUG::2014-05-16 17:38:40,615::task::579::TaskManager.Task::(_updateState) Task=`009ded91-24cf-4caa-b023-55cbddc5fd1d`::moving from state init -> state preparing >Thread-54333::INFO::2014-05-16 17:38:40,615::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54333::INFO::2014-05-16 17:38:40,616::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108829', 'lastCheck': '4.3', 'valid': True}} >Thread-54333::DEBUG::2014-05-16 17:38:40,616::task::1168::TaskManager.Task::(prepare) Task=`009ded91-24cf-4caa-b023-55cbddc5fd1d`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108829', 'lastCheck': '4.3', 'valid': True}} >Thread-54333::DEBUG::2014-05-16 17:38:40,616::task::579::TaskManager.Task::(_updateState) Task=`009ded91-24cf-4caa-b023-55cbddc5fd1d`::moving from state preparing -> state finished >Thread-54333::DEBUG::2014-05-16 17:38:40,616::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54333::DEBUG::2014-05-16 17:38:40,616::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54333::DEBUG::2014-05-16 17:38:40,616::task::974::TaskManager.Task::(_decref) Task=`009ded91-24cf-4caa-b023-55cbddc5fd1d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:38:41,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:41,348::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367418 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:43,359::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:43,430::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347505 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:45,442::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:45,509::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313676 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:38:46,349::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:38:46,359::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000854095 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:47,521::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:47,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320388 s, 32.0 MB/s\n'; <rc> = 0 >Thread-54337::DEBUG::2014-05-16 17:38:48,949::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54337::DEBUG::2014-05-16 17:38:48,950::task::579::TaskManager.Task::(_updateState) Task=`ea937242-b565-48d1-b994-c48c4370df88`::moving from state init -> state preparing >Thread-54337::INFO::2014-05-16 17:38:48,950::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54337::INFO::2014-05-16 17:38:48,950::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54337::DEBUG::2014-05-16 17:38:48,951::task::1168::TaskManager.Task::(prepare) Task=`ea937242-b565-48d1-b994-c48c4370df88`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54337::DEBUG::2014-05-16 17:38:48,951::task::579::TaskManager.Task::(_updateState) Task=`ea937242-b565-48d1-b994-c48c4370df88`::moving from state preparing -> state finished >Thread-54337::DEBUG::2014-05-16 17:38:48,951::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54337::DEBUG::2014-05-16 17:38:48,951::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54337::DEBUG::2014-05-16 17:38:48,951::task::974::TaskManager.Task::(_decref) Task=`ea937242-b565-48d1-b994-c48c4370df88`::ref 0 aborting False >Thread-54338::DEBUG::2014-05-16 17:38:48,960::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54338::DEBUG::2014-05-16 17:38:48,960::task::579::TaskManager.Task::(_updateState) Task=`17cfb3ef-359f-46c3-847c-3a0a36afe880`::moving from state init -> state preparing >Thread-54338::INFO::2014-05-16 17:38:48,960::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54338::DEBUG::2014-05-16 17:38:48,961::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0d1acd0e-63d8-400d-a544-f295bc7126b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54338::DEBUG::2014-05-16 17:38:48,961::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54338::DEBUG::2014-05-16 17:38:48,961::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54338::DEBUG::2014-05-16 17:38:48,961::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0d1acd0e-63d8-400d-a544-f295bc7126b7`::Granted request >Thread-54338::DEBUG::2014-05-16 17:38:48,962::task::811::TaskManager.Task::(resourceAcquired) Task=`17cfb3ef-359f-46c3-847c-3a0a36afe880`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54338::DEBUG::2014-05-16 17:38:48,962::task::974::TaskManager.Task::(_decref) Task=`17cfb3ef-359f-46c3-847c-3a0a36afe880`::ref 1 aborting False >Thread-54338::INFO::2014-05-16 17:38:48,962::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54338::DEBUG::2014-05-16 17:38:48,963::task::1168::TaskManager.Task::(prepare) Task=`17cfb3ef-359f-46c3-847c-3a0a36afe880`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54338::DEBUG::2014-05-16 17:38:48,963::task::579::TaskManager.Task::(_updateState) Task=`17cfb3ef-359f-46c3-847c-3a0a36afe880`::moving from state preparing -> state finished >Thread-54338::DEBUG::2014-05-16 17:38:48,963::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54338::DEBUG::2014-05-16 17:38:48,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54338::DEBUG::2014-05-16 17:38:48,963::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54338::DEBUG::2014-05-16 17:38:48,964::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54338::DEBUG::2014-05-16 17:38:48,964::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54338::DEBUG::2014-05-16 17:38:48,964::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54338::DEBUG::2014-05-16 17:38:48,964::task::974::TaskManager.Task::(_decref) Task=`17cfb3ef-359f-46c3-847c-3a0a36afe880`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:38:49,601::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:49,671::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333773 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:51,683::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:51,754::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355497 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:53,766::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:53,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030921 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:55,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54341::DEBUG::2014-05-16 17:38:55,855::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4307830.000000 / 8.009182 / 262500000.000000 = 0.204900 >Thread-54341::DEBUG::2014-05-16 17:38:55,855::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053076224777271249, 'statsAge': 0.30656099319458008, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20489958900802274, 'rxDropped': 0} >Thread-54341::DEBUG::2014-05-16 17:38:55,855::task::579::TaskManager.Task::(_updateState) Task=`43a491bb-8a61-4464-9037-28053a03dcfd`::moving from state init -> state preparing >Thread-54341::INFO::2014-05-16 17:38:55,856::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54341::INFO::2014-05-16 17:38:55,856::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000854095', 'lastCheck': '9.5', 'valid': True}} >Thread-54341::DEBUG::2014-05-16 17:38:55,856::task::1168::TaskManager.Task::(prepare) Task=`43a491bb-8a61-4464-9037-28053a03dcfd`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000854095', 'lastCheck': '9.5', 'valid': True}} >Thread-54341::DEBUG::2014-05-16 17:38:55,856::task::579::TaskManager.Task::(_updateState) Task=`43a491bb-8a61-4464-9037-28053a03dcfd`::moving from state preparing -> state finished >Thread-54341::DEBUG::2014-05-16 17:38:55,856::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54341::DEBUG::2014-05-16 17:38:55,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54341::DEBUG::2014-05-16 17:38:55,856::task::974::TaskManager.Task::(_decref) Task=`43a491bb-8a61-4464-9037-28053a03dcfd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:38:55,934::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310141 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:38:56,396::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:38:56,406::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000810119 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:38:57,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:38:58,017::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343668 s, 29.8 MB/s\n'; <rc> = 0 >Thread-54344::DEBUG::2014-05-16 17:38:59,072::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54344::DEBUG::2014-05-16 17:38:59,072::task::579::TaskManager.Task::(_updateState) Task=`c6f82f73-4bf4-4db0-80a3-4864220fda52`::moving from state init -> state preparing >Thread-54344::INFO::2014-05-16 17:38:59,072::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54344::INFO::2014-05-16 17:38:59,072::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54344::DEBUG::2014-05-16 17:38:59,073::task::1168::TaskManager.Task::(prepare) Task=`c6f82f73-4bf4-4db0-80a3-4864220fda52`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54344::DEBUG::2014-05-16 17:38:59,073::task::579::TaskManager.Task::(_updateState) Task=`c6f82f73-4bf4-4db0-80a3-4864220fda52`::moving from state preparing -> state finished >Thread-54344::DEBUG::2014-05-16 17:38:59,073::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54344::DEBUG::2014-05-16 17:38:59,073::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54344::DEBUG::2014-05-16 17:38:59,073::task::974::TaskManager.Task::(_decref) Task=`c6f82f73-4bf4-4db0-80a3-4864220fda52`::ref 0 aborting False >Thread-54345::DEBUG::2014-05-16 17:38:59,081::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54345::DEBUG::2014-05-16 17:38:59,082::task::579::TaskManager.Task::(_updateState) Task=`975eeb35-2717-4bd3-a05b-b1697feb24fd`::moving from state init -> state preparing >Thread-54345::INFO::2014-05-16 17:38:59,082::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54345::DEBUG::2014-05-16 17:38:59,082::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fcd9e375-c44a-4953-bed6-7dde91931cd2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54345::DEBUG::2014-05-16 17:38:59,082::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54345::DEBUG::2014-05-16 17:38:59,082::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54345::DEBUG::2014-05-16 17:38:59,083::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fcd9e375-c44a-4953-bed6-7dde91931cd2`::Granted request >Thread-54345::DEBUG::2014-05-16 17:38:59,083::task::811::TaskManager.Task::(resourceAcquired) Task=`975eeb35-2717-4bd3-a05b-b1697feb24fd`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54345::DEBUG::2014-05-16 17:38:59,083::task::974::TaskManager.Task::(_decref) Task=`975eeb35-2717-4bd3-a05b-b1697feb24fd`::ref 1 aborting False >Thread-54345::INFO::2014-05-16 17:38:59,083::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54345::DEBUG::2014-05-16 17:38:59,084::task::1168::TaskManager.Task::(prepare) Task=`975eeb35-2717-4bd3-a05b-b1697feb24fd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54345::DEBUG::2014-05-16 17:38:59,084::task::579::TaskManager.Task::(_updateState) Task=`975eeb35-2717-4bd3-a05b-b1697feb24fd`::moving from state preparing -> state finished >Thread-54345::DEBUG::2014-05-16 17:38:59,084::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54345::DEBUG::2014-05-16 17:38:59,084::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54345::DEBUG::2014-05-16 17:38:59,084::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54345::DEBUG::2014-05-16 17:38:59,084::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54345::DEBUG::2014-05-16 17:38:59,085::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54345::DEBUG::2014-05-16 17:38:59,085::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54345::DEBUG::2014-05-16 17:38:59,085::task::974::TaskManager.Task::(_decref) Task=`975eeb35-2717-4bd3-a05b-b1697feb24fd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:39:00,029::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:00,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303571 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:02,107::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:02,175::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307782 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:04,186::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:04,258::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356354 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:06,269::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:06,340::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356139 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:39:06,444::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:39:06,454::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729039 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:08,352::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:08,418::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300706 s, 34.1 MB/s\n'; <rc> = 0 >Thread-54349::DEBUG::2014-05-16 17:39:09,218::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54349::DEBUG::2014-05-16 17:39:09,219::task::579::TaskManager.Task::(_updateState) Task=`cfe12368-31ae-4f70-aece-f68b3b4a9a03`::moving from state init -> state preparing >Thread-54349::INFO::2014-05-16 17:39:09,219::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54349::INFO::2014-05-16 17:39:09,219::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54349::DEBUG::2014-05-16 17:39:09,220::task::1168::TaskManager.Task::(prepare) Task=`cfe12368-31ae-4f70-aece-f68b3b4a9a03`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54349::DEBUG::2014-05-16 17:39:09,220::task::579::TaskManager.Task::(_updateState) Task=`cfe12368-31ae-4f70-aece-f68b3b4a9a03`::moving from state preparing -> state finished >Thread-54349::DEBUG::2014-05-16 17:39:09,220::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54349::DEBUG::2014-05-16 17:39:09,220::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54349::DEBUG::2014-05-16 17:39:09,220::task::974::TaskManager.Task::(_decref) Task=`cfe12368-31ae-4f70-aece-f68b3b4a9a03`::ref 0 aborting False >Thread-54350::DEBUG::2014-05-16 17:39:09,230::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54350::DEBUG::2014-05-16 17:39:09,230::task::579::TaskManager.Task::(_updateState) Task=`ec33613b-95b0-4272-9349-ebd68a1ac64e`::moving from state init -> state preparing >Thread-54350::INFO::2014-05-16 17:39:09,230::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54350::DEBUG::2014-05-16 17:39:09,230::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`58799dee-53fe-4944-9a5f-88246291aca0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54350::DEBUG::2014-05-16 17:39:09,231::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54350::DEBUG::2014-05-16 17:39:09,231::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54350::DEBUG::2014-05-16 17:39:09,231::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`58799dee-53fe-4944-9a5f-88246291aca0`::Granted request >Thread-54350::DEBUG::2014-05-16 17:39:09,231::task::811::TaskManager.Task::(resourceAcquired) Task=`ec33613b-95b0-4272-9349-ebd68a1ac64e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54350::DEBUG::2014-05-16 17:39:09,232::task::974::TaskManager.Task::(_decref) Task=`ec33613b-95b0-4272-9349-ebd68a1ac64e`::ref 1 aborting False >Thread-54350::INFO::2014-05-16 17:39:09,232::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54350::DEBUG::2014-05-16 17:39:09,232::task::1168::TaskManager.Task::(prepare) Task=`ec33613b-95b0-4272-9349-ebd68a1ac64e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54350::DEBUG::2014-05-16 17:39:09,233::task::579::TaskManager.Task::(_updateState) Task=`ec33613b-95b0-4272-9349-ebd68a1ac64e`::moving from state preparing -> state finished >Thread-54350::DEBUG::2014-05-16 17:39:09,233::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54350::DEBUG::2014-05-16 17:39:09,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54350::DEBUG::2014-05-16 17:39:09,233::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54350::DEBUG::2014-05-16 17:39:09,233::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54350::DEBUG::2014-05-16 17:39:09,233::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54350::DEBUG::2014-05-16 17:39:09,234::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54350::DEBUG::2014-05-16 17:39:09,234::task::974::TaskManager.Task::(_decref) Task=`ec33613b-95b0-4272-9349-ebd68a1ac64e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:39:10,430::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:10,503::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375219 s, 27.3 MB/s\n'; <rc> = 0 >Thread-54351::DEBUG::2014-05-16 17:39:11,138::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4311473.000000 / 8.008340 / 262500000.000000 = 0.205094 >Thread-54351::DEBUG::2014-05-16 17:39:11,138::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051449220556659151, 'statsAge': 1.5755069255828857, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20509442407363523, 'rxDropped': 0} >Thread-54351::DEBUG::2014-05-16 17:39:11,139::task::579::TaskManager.Task::(_updateState) Task=`e257fbf9-6a77-41c2-8d26-6f4b3872c2cd`::moving from state init -> state preparing >Thread-54351::INFO::2014-05-16 17:39:11,139::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54351::INFO::2014-05-16 17:39:11,140::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729039', 'lastCheck': '4.7', 'valid': True}} >Thread-54351::DEBUG::2014-05-16 17:39:11,140::task::1168::TaskManager.Task::(prepare) Task=`e257fbf9-6a77-41c2-8d26-6f4b3872c2cd`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729039', 'lastCheck': '4.7', 'valid': True}} >Thread-54351::DEBUG::2014-05-16 17:39:11,140::task::579::TaskManager.Task::(_updateState) Task=`e257fbf9-6a77-41c2-8d26-6f4b3872c2cd`::moving from state preparing -> state finished >Thread-54351::DEBUG::2014-05-16 17:39:11,140::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54351::DEBUG::2014-05-16 17:39:11,140::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54351::DEBUG::2014-05-16 17:39:11,140::task::974::TaskManager.Task::(_decref) Task=`e257fbf9-6a77-41c2-8d26-6f4b3872c2cd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:39:12,516::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:12,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351362 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:14,600::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:14,667::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311025 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:39:16,490::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:39:16,500::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113901 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:16,679::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:16,748::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337432 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:18,760::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:18,832::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035919 s, 28.5 MB/s\n'; <rc> = 0 >Thread-54355::DEBUG::2014-05-16 17:39:19,307::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [62fee17b] >Thread-54355::DEBUG::2014-05-16 17:39:19,308::task::579::TaskManager.Task::(_updateState) Task=`0972a855-52aa-4508-8338-7b39491317b4`::moving from state init -> state preparing >Thread-54355::INFO::2014-05-16 17:39:19,308::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54355::INFO::2014-05-16 17:39:19,308::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54355::DEBUG::2014-05-16 17:39:19,309::task::1168::TaskManager.Task::(prepare) Task=`0972a855-52aa-4508-8338-7b39491317b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54355::DEBUG::2014-05-16 17:39:19,309::task::579::TaskManager.Task::(_updateState) Task=`0972a855-52aa-4508-8338-7b39491317b4`::moving from state preparing -> state finished >Thread-54355::DEBUG::2014-05-16 17:39:19,309::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54355::DEBUG::2014-05-16 17:39:19,309::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54355::DEBUG::2014-05-16 17:39:19,309::task::974::TaskManager.Task::(_decref) Task=`0972a855-52aa-4508-8338-7b39491317b4`::ref 0 aborting False >Thread-54356::DEBUG::2014-05-16 17:39:19,318::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [62fee17b] >Thread-54356::DEBUG::2014-05-16 17:39:19,319::task::579::TaskManager.Task::(_updateState) Task=`1671bcd8-c161-4297-9bbf-ab4324742eda`::moving from state init -> state preparing >Thread-54356::INFO::2014-05-16 17:39:19,319::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54356::DEBUG::2014-05-16 17:39:19,319::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`baf16018-876e-445c-84d5-8866683ff0e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54356::DEBUG::2014-05-16 17:39:19,319::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54356::DEBUG::2014-05-16 17:39:19,320::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54356::DEBUG::2014-05-16 17:39:19,320::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`baf16018-876e-445c-84d5-8866683ff0e1`::Granted request >Thread-54356::DEBUG::2014-05-16 17:39:19,320::task::811::TaskManager.Task::(resourceAcquired) Task=`1671bcd8-c161-4297-9bbf-ab4324742eda`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54356::DEBUG::2014-05-16 17:39:19,320::task::974::TaskManager.Task::(_decref) Task=`1671bcd8-c161-4297-9bbf-ab4324742eda`::ref 1 aborting False >Thread-54356::INFO::2014-05-16 17:39:19,321::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54356::DEBUG::2014-05-16 17:39:19,321::task::1168::TaskManager.Task::(prepare) Task=`1671bcd8-c161-4297-9bbf-ab4324742eda`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54356::DEBUG::2014-05-16 17:39:19,321::task::579::TaskManager.Task::(_updateState) Task=`1671bcd8-c161-4297-9bbf-ab4324742eda`::moving from state preparing -> state finished >Thread-54356::DEBUG::2014-05-16 17:39:19,321::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54356::DEBUG::2014-05-16 17:39:19,321::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54356::DEBUG::2014-05-16 17:39:19,322::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54356::DEBUG::2014-05-16 17:39:19,322::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54356::DEBUG::2014-05-16 17:39:19,322::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54356::DEBUG::2014-05-16 17:39:19,322::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54356::DEBUG::2014-05-16 17:39:19,322::task::974::TaskManager.Task::(_decref) Task=`1671bcd8-c161-4297-9bbf-ab4324742eda`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:39:20,844::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:20,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309906 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:22,922::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:22,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311369 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:25,001::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:25,074::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362419 s, 28.3 MB/s\n'; <rc> = 0 >Thread-54359::DEBUG::2014-05-16 17:39:26,328::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4335968.000000 / 8.008410 / 262500000.000000 = 0.206258 >Thread-54359::DEBUG::2014-05-16 17:39:26,329::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005440851748840638, 'statsAge': 0.74897098541259766, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20625783870776759, 'rxDropped': 0} >Thread-54359::DEBUG::2014-05-16 17:39:26,329::task::579::TaskManager.Task::(_updateState) Task=`c795b81a-c85b-4509-80e7-3216c7da419c`::moving from state init -> state preparing >Thread-54359::INFO::2014-05-16 17:39:26,329::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54359::INFO::2014-05-16 17:39:26,330::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113901', 'lastCheck': '9.8', 'valid': True}} >Thread-54359::DEBUG::2014-05-16 17:39:26,330::task::1168::TaskManager.Task::(prepare) Task=`c795b81a-c85b-4509-80e7-3216c7da419c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113901', 'lastCheck': '9.8', 'valid': True}} >Thread-54359::DEBUG::2014-05-16 17:39:26,330::task::579::TaskManager.Task::(_updateState) Task=`c795b81a-c85b-4509-80e7-3216c7da419c`::moving from state preparing -> state finished >Thread-54359::DEBUG::2014-05-16 17:39:26,330::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54359::DEBUG::2014-05-16 17:39:26,330::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54359::DEBUG::2014-05-16 17:39:26,330::task::974::TaskManager.Task::(_decref) Task=`c795b81a-c85b-4509-80e7-3216c7da419c`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:39:26,537::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:39:26,547::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000903544 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:27,086::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:27,157::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349677 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:29,168::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:29,237::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310538 s, 33.0 MB/s\n'; <rc> = 0 >Thread-54361::DEBUG::2014-05-16 17:39:29,437::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54361::DEBUG::2014-05-16 17:39:29,438::task::579::TaskManager.Task::(_updateState) Task=`2a8c994e-3301-4f27-93fc-d91df1640456`::moving from state init -> state preparing >Thread-54361::INFO::2014-05-16 17:39:29,441::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54361::INFO::2014-05-16 17:39:29,442::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54361::DEBUG::2014-05-16 17:39:29,442::task::1168::TaskManager.Task::(prepare) Task=`2a8c994e-3301-4f27-93fc-d91df1640456`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54361::DEBUG::2014-05-16 17:39:29,442::task::579::TaskManager.Task::(_updateState) Task=`2a8c994e-3301-4f27-93fc-d91df1640456`::moving from state preparing -> state finished >Thread-54361::DEBUG::2014-05-16 17:39:29,443::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54361::DEBUG::2014-05-16 17:39:29,443::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54361::DEBUG::2014-05-16 17:39:29,443::task::974::TaskManager.Task::(_decref) Task=`2a8c994e-3301-4f27-93fc-d91df1640456`::ref 0 aborting False >Thread-54363::DEBUG::2014-05-16 17:39:29,454::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54363::DEBUG::2014-05-16 17:39:29,454::task::579::TaskManager.Task::(_updateState) Task=`f3249bce-b359-4493-90ac-b173ed6addfc`::moving from state init -> state preparing >Thread-54363::INFO::2014-05-16 17:39:29,454::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54363::DEBUG::2014-05-16 17:39:29,455::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5c52e62b-e15d-4131-ba2f-376062a4a6cb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54363::DEBUG::2014-05-16 17:39:29,455::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54363::DEBUG::2014-05-16 17:39:29,455::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54363::DEBUG::2014-05-16 17:39:29,455::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5c52e62b-e15d-4131-ba2f-376062a4a6cb`::Granted request >Thread-54363::DEBUG::2014-05-16 17:39:29,455::task::811::TaskManager.Task::(resourceAcquired) Task=`f3249bce-b359-4493-90ac-b173ed6addfc`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54363::DEBUG::2014-05-16 17:39:29,456::task::974::TaskManager.Task::(_decref) Task=`f3249bce-b359-4493-90ac-b173ed6addfc`::ref 1 aborting False >Thread-54363::INFO::2014-05-16 17:39:29,456::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54363::DEBUG::2014-05-16 17:39:29,456::task::1168::TaskManager.Task::(prepare) Task=`f3249bce-b359-4493-90ac-b173ed6addfc`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54363::DEBUG::2014-05-16 17:39:29,457::task::579::TaskManager.Task::(_updateState) Task=`f3249bce-b359-4493-90ac-b173ed6addfc`::moving from state preparing -> state finished >Thread-54363::DEBUG::2014-05-16 17:39:29,457::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54363::DEBUG::2014-05-16 17:39:29,457::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54363::DEBUG::2014-05-16 17:39:29,457::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54363::DEBUG::2014-05-16 17:39:29,457::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54363::DEBUG::2014-05-16 17:39:29,458::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54363::DEBUG::2014-05-16 17:39:29,458::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54363::DEBUG::2014-05-16 17:39:29,458::task::974::TaskManager.Task::(_decref) Task=`f3249bce-b359-4493-90ac-b173ed6addfc`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:39:31,249::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:31,321::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035433 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:33,333::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:33,400::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312958 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:35,411::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:35,479::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315552 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:39:36,585::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:39:36,595::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000819854 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:37,496::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:37,567::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03529 s, 29.0 MB/s\n'; <rc> = 0 >Thread-54367::DEBUG::2014-05-16 17:39:39,513::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54367::DEBUG::2014-05-16 17:39:39,513::task::579::TaskManager.Task::(_updateState) Task=`243d84dd-ae02-49cf-9514-c5603cf4442d`::moving from state init -> state preparing >Thread-54367::INFO::2014-05-16 17:39:39,513::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54367::INFO::2014-05-16 17:39:39,514::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54367::DEBUG::2014-05-16 17:39:39,514::task::1168::TaskManager.Task::(prepare) Task=`243d84dd-ae02-49cf-9514-c5603cf4442d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54367::DEBUG::2014-05-16 17:39:39,514::task::579::TaskManager.Task::(_updateState) Task=`243d84dd-ae02-49cf-9514-c5603cf4442d`::moving from state preparing -> state finished >Thread-54367::DEBUG::2014-05-16 17:39:39,514::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54367::DEBUG::2014-05-16 17:39:39,514::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54367::DEBUG::2014-05-16 17:39:39,514::task::974::TaskManager.Task::(_decref) Task=`243d84dd-ae02-49cf-9514-c5603cf4442d`::ref 0 aborting False >Thread-54368::DEBUG::2014-05-16 17:39:39,523::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54368::DEBUG::2014-05-16 17:39:39,523::task::579::TaskManager.Task::(_updateState) Task=`40e5c20b-67b5-42aa-aaa6-a2da3df00b1b`::moving from state init -> state preparing >Thread-54368::INFO::2014-05-16 17:39:39,523::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54368::DEBUG::2014-05-16 17:39:39,523::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a7c8685c-19a6-4cb2-aaba-108510132371`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54368::DEBUG::2014-05-16 17:39:39,523::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54368::DEBUG::2014-05-16 17:39:39,524::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54368::DEBUG::2014-05-16 17:39:39,524::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a7c8685c-19a6-4cb2-aaba-108510132371`::Granted request >Thread-54368::DEBUG::2014-05-16 17:39:39,524::task::811::TaskManager.Task::(resourceAcquired) Task=`40e5c20b-67b5-42aa-aaa6-a2da3df00b1b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54368::DEBUG::2014-05-16 17:39:39,524::task::974::TaskManager.Task::(_decref) Task=`40e5c20b-67b5-42aa-aaa6-a2da3df00b1b`::ref 1 aborting False >Thread-54368::INFO::2014-05-16 17:39:39,525::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54368::DEBUG::2014-05-16 17:39:39,525::task::1168::TaskManager.Task::(prepare) Task=`40e5c20b-67b5-42aa-aaa6-a2da3df00b1b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54368::DEBUG::2014-05-16 17:39:39,525::task::579::TaskManager.Task::(_updateState) Task=`40e5c20b-67b5-42aa-aaa6-a2da3df00b1b`::moving from state preparing -> state finished >Thread-54368::DEBUG::2014-05-16 17:39:39,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54368::DEBUG::2014-05-16 17:39:39,525::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54368::DEBUG::2014-05-16 17:39:39,526::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54368::DEBUG::2014-05-16 17:39:39,526::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54368::DEBUG::2014-05-16 17:39:39,526::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54368::DEBUG::2014-05-16 17:39:39,526::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54368::DEBUG::2014-05-16 17:39:39,526::task::974::TaskManager.Task::(_decref) Task=`40e5c20b-67b5-42aa-aaa6-a2da3df00b1b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:39:39,579::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:39,646::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312483 s, 32.8 MB/s\n'; <rc> = 0 >Thread-54369::DEBUG::2014-05-16 17:39:41,548::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4312129.000000 / 8.008396 / 262500000.000000 = 0.205124 >Thread-54369::DEBUG::2014-05-16 17:39:41,548::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051089239559013958, 'statsAge': 1.9533989429473877, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20512420064280379, 'rxDropped': 0} >Thread-54369::DEBUG::2014-05-16 17:39:41,548::task::579::TaskManager.Task::(_updateState) Task=`63e77634-9bc7-4e72-889e-6179faa3c202`::moving from state init -> state preparing >Thread-54369::INFO::2014-05-16 17:39:41,549::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54369::INFO::2014-05-16 17:39:41,549::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819854', 'lastCheck': '4.9', 'valid': True}} >Thread-54369::DEBUG::2014-05-16 17:39:41,549::task::1168::TaskManager.Task::(prepare) Task=`63e77634-9bc7-4e72-889e-6179faa3c202`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819854', 'lastCheck': '4.9', 'valid': True}} >Thread-54369::DEBUG::2014-05-16 17:39:41,549::task::579::TaskManager.Task::(_updateState) Task=`63e77634-9bc7-4e72-889e-6179faa3c202`::moving from state preparing -> state finished >Thread-54369::DEBUG::2014-05-16 17:39:41,549::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54369::DEBUG::2014-05-16 17:39:41,549::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54369::DEBUG::2014-05-16 17:39:41,550::task::974::TaskManager.Task::(_decref) Task=`63e77634-9bc7-4e72-889e-6179faa3c202`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:39:41,658::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:41,729::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349983 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:43,740::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:43,808::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306058 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:45,820::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:45,892::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356633 s, 28.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:39:46,633::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:39:46,643::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618838 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:47,904::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:47,970::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304914 s, 33.6 MB/s\n'; <rc> = 0 >Thread-54373::DEBUG::2014-05-16 17:39:49,637::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54373::DEBUG::2014-05-16 17:39:49,638::task::579::TaskManager.Task::(_updateState) Task=`59b019eb-c198-435e-a1b7-6ac7e234c15e`::moving from state init -> state preparing >Thread-54373::INFO::2014-05-16 17:39:49,638::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54373::INFO::2014-05-16 17:39:49,639::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54373::DEBUG::2014-05-16 17:39:49,639::task::1168::TaskManager.Task::(prepare) Task=`59b019eb-c198-435e-a1b7-6ac7e234c15e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54373::DEBUG::2014-05-16 17:39:49,639::task::579::TaskManager.Task::(_updateState) Task=`59b019eb-c198-435e-a1b7-6ac7e234c15e`::moving from state preparing -> state finished >Thread-54373::DEBUG::2014-05-16 17:39:49,639::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54373::DEBUG::2014-05-16 17:39:49,639::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54373::DEBUG::2014-05-16 17:39:49,639::task::974::TaskManager.Task::(_decref) Task=`59b019eb-c198-435e-a1b7-6ac7e234c15e`::ref 0 aborting False >Thread-54374::DEBUG::2014-05-16 17:39:49,648::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54374::DEBUG::2014-05-16 17:39:49,648::task::579::TaskManager.Task::(_updateState) Task=`6ce6418d-fe9b-4e49-927a-40c452157319`::moving from state init -> state preparing >Thread-54374::INFO::2014-05-16 17:39:49,649::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54374::DEBUG::2014-05-16 17:39:49,649::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`136d0ef3-38a7-4b51-9dfc-c0dd8c1d7741`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54374::DEBUG::2014-05-16 17:39:49,649::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54374::DEBUG::2014-05-16 17:39:49,649::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54374::DEBUG::2014-05-16 17:39:49,650::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`136d0ef3-38a7-4b51-9dfc-c0dd8c1d7741`::Granted request >Thread-54374::DEBUG::2014-05-16 17:39:49,650::task::811::TaskManager.Task::(resourceAcquired) Task=`6ce6418d-fe9b-4e49-927a-40c452157319`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54374::DEBUG::2014-05-16 17:39:49,650::task::974::TaskManager.Task::(_decref) Task=`6ce6418d-fe9b-4e49-927a-40c452157319`::ref 1 aborting False >Thread-54374::INFO::2014-05-16 17:39:49,651::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54374::DEBUG::2014-05-16 17:39:49,651::task::1168::TaskManager.Task::(prepare) Task=`6ce6418d-fe9b-4e49-927a-40c452157319`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54374::DEBUG::2014-05-16 17:39:49,651::task::579::TaskManager.Task::(_updateState) Task=`6ce6418d-fe9b-4e49-927a-40c452157319`::moving from state preparing -> state finished >Thread-54374::DEBUG::2014-05-16 17:39:49,651::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54374::DEBUG::2014-05-16 17:39:49,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54374::DEBUG::2014-05-16 17:39:49,652::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54374::DEBUG::2014-05-16 17:39:49,652::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54374::DEBUG::2014-05-16 17:39:49,652::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54374::DEBUG::2014-05-16 17:39:49,652::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54374::DEBUG::2014-05-16 17:39:49,652::task::974::TaskManager.Task::(_decref) Task=`6ce6418d-fe9b-4e49-927a-40c452157319`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:39:49,982::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:50,049::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309856 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:52,061::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:52,132::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356957 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:54,144::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:54,210::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305211 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:39:56,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:56,299::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0412756 s, 24.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:39:56,681::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:39:56,691::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00077858 s, 5.3 MB/s\n'; <rc> = 0 >Thread-54377::DEBUG::2014-05-16 17:39:56,717::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4307803.000000 / 8.008407 / 262500000.000000 = 0.204918 >Thread-54377::DEBUG::2014-05-16 17:39:56,717::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053798703206679385, 'statsAge': 1.1057529449462891, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20491813598168199, 'rxDropped': 0} >Thread-54377::DEBUG::2014-05-16 17:39:56,718::task::579::TaskManager.Task::(_updateState) Task=`23fa0c69-3c20-4a78-bd49-395170a164f4`::moving from state init -> state preparing >Thread-54377::INFO::2014-05-16 17:39:56,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54377::INFO::2014-05-16 17:39:56,718::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00077858', 'lastCheck': '0.0', 'valid': True}} >Thread-54377::DEBUG::2014-05-16 17:39:56,718::task::1168::TaskManager.Task::(prepare) Task=`23fa0c69-3c20-4a78-bd49-395170a164f4`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00077858', 'lastCheck': '0.0', 'valid': True}} >Thread-54377::DEBUG::2014-05-16 17:39:56,719::task::579::TaskManager.Task::(_updateState) Task=`23fa0c69-3c20-4a78-bd49-395170a164f4`::moving from state preparing -> state finished >Thread-54377::DEBUG::2014-05-16 17:39:56,719::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54377::DEBUG::2014-05-16 17:39:56,719::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54377::DEBUG::2014-05-16 17:39:56,719::task::974::TaskManager.Task::(_decref) Task=`23fa0c69-3c20-4a78-bd49-395170a164f4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:39:58,311::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:39:58,382::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349218 s, 29.3 MB/s\n'; <rc> = 0 >Thread-54379::DEBUG::2014-05-16 17:39:59,695::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54379::DEBUG::2014-05-16 17:39:59,695::task::579::TaskManager.Task::(_updateState) Task=`3da671fd-81bf-419b-bc6f-76ec534f2ac3`::moving from state init -> state preparing >Thread-54379::INFO::2014-05-16 17:39:59,696::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54379::INFO::2014-05-16 17:39:59,696::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54379::DEBUG::2014-05-16 17:39:59,696::task::1168::TaskManager.Task::(prepare) Task=`3da671fd-81bf-419b-bc6f-76ec534f2ac3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54379::DEBUG::2014-05-16 17:39:59,696::task::579::TaskManager.Task::(_updateState) Task=`3da671fd-81bf-419b-bc6f-76ec534f2ac3`::moving from state preparing -> state finished >Thread-54379::DEBUG::2014-05-16 17:39:59,696::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54379::DEBUG::2014-05-16 17:39:59,697::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54379::DEBUG::2014-05-16 17:39:59,697::task::974::TaskManager.Task::(_decref) Task=`3da671fd-81bf-419b-bc6f-76ec534f2ac3`::ref 0 aborting False >Thread-54380::DEBUG::2014-05-16 17:39:59,705::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54380::DEBUG::2014-05-16 17:39:59,705::task::579::TaskManager.Task::(_updateState) Task=`cc4b2ac3-d293-4d83-92ad-64a4bd29a866`::moving from state init -> state preparing >Thread-54380::INFO::2014-05-16 17:39:59,705::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54380::DEBUG::2014-05-16 17:39:59,706::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b394a11d-9b82-41b2-875f-62935c21e8af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54380::DEBUG::2014-05-16 17:39:59,706::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54380::DEBUG::2014-05-16 17:39:59,706::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54380::DEBUG::2014-05-16 17:39:59,706::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b394a11d-9b82-41b2-875f-62935c21e8af`::Granted request >Thread-54380::DEBUG::2014-05-16 17:39:59,707::task::811::TaskManager.Task::(resourceAcquired) Task=`cc4b2ac3-d293-4d83-92ad-64a4bd29a866`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54380::DEBUG::2014-05-16 17:39:59,707::task::974::TaskManager.Task::(_decref) Task=`cc4b2ac3-d293-4d83-92ad-64a4bd29a866`::ref 1 aborting False >Thread-54380::INFO::2014-05-16 17:39:59,707::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54380::DEBUG::2014-05-16 17:39:59,707::task::1168::TaskManager.Task::(prepare) Task=`cc4b2ac3-d293-4d83-92ad-64a4bd29a866`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54380::DEBUG::2014-05-16 17:39:59,708::task::579::TaskManager.Task::(_updateState) Task=`cc4b2ac3-d293-4d83-92ad-64a4bd29a866`::moving from state preparing -> state finished >Thread-54380::DEBUG::2014-05-16 17:39:59,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54380::DEBUG::2014-05-16 17:39:59,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54380::DEBUG::2014-05-16 17:39:59,708::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54380::DEBUG::2014-05-16 17:39:59,708::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54380::DEBUG::2014-05-16 17:39:59,708::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54380::DEBUG::2014-05-16 17:39:59,708::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54380::DEBUG::2014-05-16 17:39:59,709::task::974::TaskManager.Task::(_decref) Task=`cc4b2ac3-d293-4d83-92ad-64a4bd29a866`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:40:00,393::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:00,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300214 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:02,471::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:02,539::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314338 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:04,550::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:04,621::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035306 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:06,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:06,704::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035795 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:40:06,769::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:40:06,779::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072293 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:08,760::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:08,826::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304414 s, 33.6 MB/s\n'; <rc> = 0 >Thread-54385::DEBUG::2014-05-16 17:40:09,763::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54385::DEBUG::2014-05-16 17:40:09,763::task::579::TaskManager.Task::(_updateState) Task=`572e6dde-50d1-4f84-8617-4002c94c7de8`::moving from state init -> state preparing >Thread-54385::INFO::2014-05-16 17:40:09,763::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54385::INFO::2014-05-16 17:40:09,764::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54385::DEBUG::2014-05-16 17:40:09,764::task::1168::TaskManager.Task::(prepare) Task=`572e6dde-50d1-4f84-8617-4002c94c7de8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54385::DEBUG::2014-05-16 17:40:09,764::task::579::TaskManager.Task::(_updateState) Task=`572e6dde-50d1-4f84-8617-4002c94c7de8`::moving from state preparing -> state finished >Thread-54385::DEBUG::2014-05-16 17:40:09,764::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54385::DEBUG::2014-05-16 17:40:09,764::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54385::DEBUG::2014-05-16 17:40:09,764::task::974::TaskManager.Task::(_decref) Task=`572e6dde-50d1-4f84-8617-4002c94c7de8`::ref 0 aborting False >Thread-54386::DEBUG::2014-05-16 17:40:09,773::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54386::DEBUG::2014-05-16 17:40:09,773::task::579::TaskManager.Task::(_updateState) Task=`5613890f-a532-4a6e-af32-be7f84693e03`::moving from state init -> state preparing >Thread-54386::INFO::2014-05-16 17:40:09,773::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54386::DEBUG::2014-05-16 17:40:09,774::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`05e168fc-3c69-4f27-b1c4-e6b33be6dba9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54386::DEBUG::2014-05-16 17:40:09,774::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54386::DEBUG::2014-05-16 17:40:09,774::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54386::DEBUG::2014-05-16 17:40:09,774::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`05e168fc-3c69-4f27-b1c4-e6b33be6dba9`::Granted request >Thread-54386::DEBUG::2014-05-16 17:40:09,775::task::811::TaskManager.Task::(resourceAcquired) Task=`5613890f-a532-4a6e-af32-be7f84693e03`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54386::DEBUG::2014-05-16 17:40:09,775::task::974::TaskManager.Task::(_decref) Task=`5613890f-a532-4a6e-af32-be7f84693e03`::ref 1 aborting False >Thread-54386::INFO::2014-05-16 17:40:09,776::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54386::DEBUG::2014-05-16 17:40:09,776::task::1168::TaskManager.Task::(prepare) Task=`5613890f-a532-4a6e-af32-be7f84693e03`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54386::DEBUG::2014-05-16 17:40:09,776::task::579::TaskManager.Task::(_updateState) Task=`5613890f-a532-4a6e-af32-be7f84693e03`::moving from state preparing -> state finished >Thread-54386::DEBUG::2014-05-16 17:40:09,776::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54386::DEBUG::2014-05-16 17:40:09,776::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54386::DEBUG::2014-05-16 17:40:09,776::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54386::DEBUG::2014-05-16 17:40:09,777::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54386::DEBUG::2014-05-16 17:40:09,777::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54386::DEBUG::2014-05-16 17:40:09,777::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54386::DEBUG::2014-05-16 17:40:09,777::task::974::TaskManager.Task::(_decref) Task=`5613890f-a532-4a6e-af32-be7f84693e03`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:40:10,838::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:10,905::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316247 s, 32.4 MB/s\n'; <rc> = 0 >Thread-54387::DEBUG::2014-05-16 17:40:11,867::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3238879.000000 / 8.008499 / 262500000.000000 = 0.154069 >Thread-54387::DEBUG::2014-05-16 17:40:11,867::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041703313731174148, 'statsAge': 0.23891496658325195, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15406865184705326, 'rxDropped': 0} >Thread-54387::DEBUG::2014-05-16 17:40:11,868::task::579::TaskManager.Task::(_updateState) Task=`18121daa-2341-40a6-ad0f-5cfc27712e0a`::moving from state init -> state preparing >Thread-54387::INFO::2014-05-16 17:40:11,868::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54387::INFO::2014-05-16 17:40:11,868::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072293', 'lastCheck': '5.1', 'valid': True}} >Thread-54387::DEBUG::2014-05-16 17:40:11,868::task::1168::TaskManager.Task::(prepare) Task=`18121daa-2341-40a6-ad0f-5cfc27712e0a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072293', 'lastCheck': '5.1', 'valid': True}} >Thread-54387::DEBUG::2014-05-16 17:40:11,869::task::579::TaskManager.Task::(_updateState) Task=`18121daa-2341-40a6-ad0f-5cfc27712e0a`::moving from state preparing -> state finished >Thread-54387::DEBUG::2014-05-16 17:40:11,869::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54387::DEBUG::2014-05-16 17:40:11,869::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54387::DEBUG::2014-05-16 17:40:11,869::task::974::TaskManager.Task::(_decref) Task=`18121daa-2341-40a6-ad0f-5cfc27712e0a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:40:12,917::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:12,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356345 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:15,000::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:15,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314682 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:40:16,814::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:40:16,824::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114095 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:17,080::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:17,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347306 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:19,162::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:19,233::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350296 s, 29.2 MB/s\n'; <rc> = 0 >Thread-54391::DEBUG::2014-05-16 17:40:19,841::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54391::DEBUG::2014-05-16 17:40:19,841::task::579::TaskManager.Task::(_updateState) Task=`83509c4c-de90-4c40-a851-72032760390d`::moving from state init -> state preparing >Thread-54391::INFO::2014-05-16 17:40:19,841::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54391::INFO::2014-05-16 17:40:19,841::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54391::DEBUG::2014-05-16 17:40:19,842::task::1168::TaskManager.Task::(prepare) Task=`83509c4c-de90-4c40-a851-72032760390d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54391::DEBUG::2014-05-16 17:40:19,842::task::579::TaskManager.Task::(_updateState) Task=`83509c4c-de90-4c40-a851-72032760390d`::moving from state preparing -> state finished >Thread-54391::DEBUG::2014-05-16 17:40:19,842::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54391::DEBUG::2014-05-16 17:40:19,842::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54391::DEBUG::2014-05-16 17:40:19,842::task::974::TaskManager.Task::(_decref) Task=`83509c4c-de90-4c40-a851-72032760390d`::ref 0 aborting False >Thread-54392::DEBUG::2014-05-16 17:40:19,851::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54392::DEBUG::2014-05-16 17:40:19,851::task::579::TaskManager.Task::(_updateState) Task=`72871535-4e7d-45b4-8c03-d1d1c0f7669d`::moving from state init -> state preparing >Thread-54392::INFO::2014-05-16 17:40:19,851::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54392::DEBUG::2014-05-16 17:40:19,852::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`76f4b433-b8a7-4ab2-b481-18db85edceb4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54392::DEBUG::2014-05-16 17:40:19,852::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54392::DEBUG::2014-05-16 17:40:19,852::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54392::DEBUG::2014-05-16 17:40:19,852::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`76f4b433-b8a7-4ab2-b481-18db85edceb4`::Granted request >Thread-54392::DEBUG::2014-05-16 17:40:19,852::task::811::TaskManager.Task::(resourceAcquired) Task=`72871535-4e7d-45b4-8c03-d1d1c0f7669d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54392::DEBUG::2014-05-16 17:40:19,852::task::974::TaskManager.Task::(_decref) Task=`72871535-4e7d-45b4-8c03-d1d1c0f7669d`::ref 1 aborting False >Thread-54392::INFO::2014-05-16 17:40:19,853::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54392::DEBUG::2014-05-16 17:40:19,853::task::1168::TaskManager.Task::(prepare) Task=`72871535-4e7d-45b4-8c03-d1d1c0f7669d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54392::DEBUG::2014-05-16 17:40:19,853::task::579::TaskManager.Task::(_updateState) Task=`72871535-4e7d-45b4-8c03-d1d1c0f7669d`::moving from state preparing -> state finished >Thread-54392::DEBUG::2014-05-16 17:40:19,854::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54392::DEBUG::2014-05-16 17:40:19,854::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54392::DEBUG::2014-05-16 17:40:19,854::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54392::DEBUG::2014-05-16 17:40:19,854::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54392::DEBUG::2014-05-16 17:40:19,854::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54392::DEBUG::2014-05-16 17:40:19,854::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54392::DEBUG::2014-05-16 17:40:19,854::task::974::TaskManager.Task::(_decref) Task=`72871535-4e7d-45b4-8c03-d1d1c0f7669d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:40:21,244::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:21,318::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297692 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:23,331::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:23,396::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297035 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:25,408::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:25,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349034 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:40:26,861::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:40:26,871::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110075 s, 3.7 MB/s\n'; <rc> = 0 >Thread-54395::DEBUG::2014-05-16 17:40:27,063::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413920.000000 / 8.008590 / 262500000.000000 = 0.257529 >Thread-54395::DEBUG::2014-05-16 17:40:27,063::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0068327585781031847, 'statsAge': 1.4200410842895508, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25752919286256382, 'rxDropped': 0} >Thread-54395::DEBUG::2014-05-16 17:40:27,064::task::579::TaskManager.Task::(_updateState) Task=`3a836c44-88b6-497b-90d6-47a7d5ba80fd`::moving from state init -> state preparing >Thread-54395::INFO::2014-05-16 17:40:27,064::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54395::INFO::2014-05-16 17:40:27,064::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110075', 'lastCheck': '0.2', 'valid': True}} >Thread-54395::DEBUG::2014-05-16 17:40:27,065::task::1168::TaskManager.Task::(prepare) Task=`3a836c44-88b6-497b-90d6-47a7d5ba80fd`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110075', 'lastCheck': '0.2', 'valid': True}} >Thread-54395::DEBUG::2014-05-16 17:40:27,065::task::579::TaskManager.Task::(_updateState) Task=`3a836c44-88b6-497b-90d6-47a7d5ba80fd`::moving from state preparing -> state finished >Thread-54395::DEBUG::2014-05-16 17:40:27,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54395::DEBUG::2014-05-16 17:40:27,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54395::DEBUG::2014-05-16 17:40:27,065::task::974::TaskManager.Task::(_decref) Task=`3a836c44-88b6-497b-90d6-47a7d5ba80fd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:40:27,490::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:27,561::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348819 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:29,572::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:29,640::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309365 s, 33.1 MB/s\n'; <rc> = 0 >Thread-54397::DEBUG::2014-05-16 17:40:29,894::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54397::DEBUG::2014-05-16 17:40:29,894::task::579::TaskManager.Task::(_updateState) Task=`2e14cbac-3c1f-47b1-9593-b8d1f686fe70`::moving from state init -> state preparing >Thread-54397::INFO::2014-05-16 17:40:29,894::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54397::INFO::2014-05-16 17:40:29,895::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54397::DEBUG::2014-05-16 17:40:29,895::task::1168::TaskManager.Task::(prepare) Task=`2e14cbac-3c1f-47b1-9593-b8d1f686fe70`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54397::DEBUG::2014-05-16 17:40:29,895::task::579::TaskManager.Task::(_updateState) Task=`2e14cbac-3c1f-47b1-9593-b8d1f686fe70`::moving from state preparing -> state finished >Thread-54397::DEBUG::2014-05-16 17:40:29,895::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54397::DEBUG::2014-05-16 17:40:29,895::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54397::DEBUG::2014-05-16 17:40:29,896::task::974::TaskManager.Task::(_decref) Task=`2e14cbac-3c1f-47b1-9593-b8d1f686fe70`::ref 0 aborting False >Thread-54398::DEBUG::2014-05-16 17:40:29,904::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54398::DEBUG::2014-05-16 17:40:29,904::task::579::TaskManager.Task::(_updateState) Task=`bef58f98-df05-4975-a7b8-55dc5a9c90e2`::moving from state init -> state preparing >Thread-54398::INFO::2014-05-16 17:40:29,905::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54398::DEBUG::2014-05-16 17:40:29,905::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c9a8d848-e538-496c-97b2-abeb7c418012`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54398::DEBUG::2014-05-16 17:40:29,905::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54398::DEBUG::2014-05-16 17:40:29,905::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54398::DEBUG::2014-05-16 17:40:29,906::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c9a8d848-e538-496c-97b2-abeb7c418012`::Granted request >Thread-54398::DEBUG::2014-05-16 17:40:29,906::task::811::TaskManager.Task::(resourceAcquired) Task=`bef58f98-df05-4975-a7b8-55dc5a9c90e2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54398::DEBUG::2014-05-16 17:40:29,906::task::974::TaskManager.Task::(_decref) Task=`bef58f98-df05-4975-a7b8-55dc5a9c90e2`::ref 1 aborting False >Thread-54398::INFO::2014-05-16 17:40:29,907::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54398::DEBUG::2014-05-16 17:40:29,907::task::1168::TaskManager.Task::(prepare) Task=`bef58f98-df05-4975-a7b8-55dc5a9c90e2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54398::DEBUG::2014-05-16 17:40:29,907::task::579::TaskManager.Task::(_updateState) Task=`bef58f98-df05-4975-a7b8-55dc5a9c90e2`::moving from state preparing -> state finished >Thread-54398::DEBUG::2014-05-16 17:40:29,907::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54398::DEBUG::2014-05-16 17:40:29,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54398::DEBUG::2014-05-16 17:40:29,908::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54398::DEBUG::2014-05-16 17:40:29,908::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54398::DEBUG::2014-05-16 17:40:29,908::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54398::DEBUG::2014-05-16 17:40:29,908::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54398::DEBUG::2014-05-16 17:40:29,908::task::974::TaskManager.Task::(_decref) Task=`bef58f98-df05-4975-a7b8-55dc5a9c90e2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:40:31,655::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:31,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354456 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:33,738::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:33,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310185 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:35,817::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:35,884::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311939 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:40:36,908::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:40:36,918::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000788711 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:37,895::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:37,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306218 s, 33.4 MB/s\n'; <rc> = 0 >Thread-54403::DEBUG::2014-05-16 17:40:39,970::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54403::DEBUG::2014-05-16 17:40:39,970::task::579::TaskManager.Task::(_updateState) Task=`558cc0dc-ab25-40af-abf3-c8193769b1ae`::moving from state init -> state preparing >Thread-54403::INFO::2014-05-16 17:40:39,970::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54403::INFO::2014-05-16 17:40:39,971::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54403::DEBUG::2014-05-16 17:40:39,971::task::1168::TaskManager.Task::(prepare) Task=`558cc0dc-ab25-40af-abf3-c8193769b1ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54403::DEBUG::2014-05-16 17:40:39,971::task::579::TaskManager.Task::(_updateState) Task=`558cc0dc-ab25-40af-abf3-c8193769b1ae`::moving from state preparing -> state finished >Thread-54403::DEBUG::2014-05-16 17:40:39,971::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54403::DEBUG::2014-05-16 17:40:39,971::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54403::DEBUG::2014-05-16 17:40:39,971::task::974::TaskManager.Task::(_decref) Task=`558cc0dc-ab25-40af-abf3-c8193769b1ae`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:40:39,974::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54404::DEBUG::2014-05-16 17:40:39,989::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54404::DEBUG::2014-05-16 17:40:39,990::task::579::TaskManager.Task::(_updateState) Task=`197d5f92-d670-4cad-aaef-3e8d2bb6fd17`::moving from state init -> state preparing >Thread-54404::INFO::2014-05-16 17:40:39,990::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54404::DEBUG::2014-05-16 17:40:39,991::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a966c746-e9c3-42fe-82ca-38a3c3b0db85`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54404::DEBUG::2014-05-16 17:40:39,991::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54404::DEBUG::2014-05-16 17:40:39,991::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54404::DEBUG::2014-05-16 17:40:39,991::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a966c746-e9c3-42fe-82ca-38a3c3b0db85`::Granted request >Thread-54404::DEBUG::2014-05-16 17:40:39,992::task::811::TaskManager.Task::(resourceAcquired) Task=`197d5f92-d670-4cad-aaef-3e8d2bb6fd17`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54404::DEBUG::2014-05-16 17:40:39,992::task::974::TaskManager.Task::(_decref) Task=`197d5f92-d670-4cad-aaef-3e8d2bb6fd17`::ref 1 aborting False >Thread-54404::INFO::2014-05-16 17:40:39,992::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54404::DEBUG::2014-05-16 17:40:39,993::task::1168::TaskManager.Task::(prepare) Task=`197d5f92-d670-4cad-aaef-3e8d2bb6fd17`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54404::DEBUG::2014-05-16 17:40:39,993::task::579::TaskManager.Task::(_updateState) Task=`197d5f92-d670-4cad-aaef-3e8d2bb6fd17`::moving from state preparing -> state finished >Thread-54404::DEBUG::2014-05-16 17:40:39,993::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54404::DEBUG::2014-05-16 17:40:39,993::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54404::DEBUG::2014-05-16 17:40:39,993::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54404::DEBUG::2014-05-16 17:40:39,994::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54404::DEBUG::2014-05-16 17:40:39,994::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54404::DEBUG::2014-05-16 17:40:39,994::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54404::DEBUG::2014-05-16 17:40:39,994::task::974::TaskManager.Task::(_decref) Task=`197d5f92-d670-4cad-aaef-3e8d2bb6fd17`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:40:40,050::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0393932 s, 26.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:42,062::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:42,132::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344559 s, 29.7 MB/s\n'; <rc> = 0 >Thread-54405::DEBUG::2014-05-16 17:40:42,276::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4312503.000000 / 8.008251 / 262500000.000000 = 0.205146 >Thread-54405::DEBUG::2014-05-16 17:40:42,276::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053578074569703132, 'statsAge': 0.61388015747070312, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2051457047998477, 'rxDropped': 0} >Thread-54405::DEBUG::2014-05-16 17:40:42,277::task::579::TaskManager.Task::(_updateState) Task=`338d7ca4-1f05-4916-a1ed-d614230963fb`::moving from state init -> state preparing >Thread-54405::INFO::2014-05-16 17:40:42,277::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54405::INFO::2014-05-16 17:40:42,277::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788711', 'lastCheck': '5.3', 'valid': True}} >Thread-54405::DEBUG::2014-05-16 17:40:42,277::task::1168::TaskManager.Task::(prepare) Task=`338d7ca4-1f05-4916-a1ed-d614230963fb`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788711', 'lastCheck': '5.3', 'valid': True}} >Thread-54405::DEBUG::2014-05-16 17:40:42,278::task::579::TaskManager.Task::(_updateState) Task=`338d7ca4-1f05-4916-a1ed-d614230963fb`::moving from state preparing -> state finished >Thread-54405::DEBUG::2014-05-16 17:40:42,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54405::DEBUG::2014-05-16 17:40:42,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54405::DEBUG::2014-05-16 17:40:42,278::task::974::TaskManager.Task::(_decref) Task=`338d7ca4-1f05-4916-a1ed-d614230963fb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:40:44,144::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:44,211::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312263 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:46,223::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:46,295::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357813 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:40:46,953::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:40:46,963::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0008017 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:48,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:48,385::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353585 s, 29.0 MB/s\n'; <rc> = 0 >Thread-54409::DEBUG::2014-05-16 17:40:50,084::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54409::DEBUG::2014-05-16 17:40:50,084::task::579::TaskManager.Task::(_updateState) Task=`d9111fd7-285a-4426-86d6-4cca1df6d4f4`::moving from state init -> state preparing >Thread-54409::INFO::2014-05-16 17:40:50,085::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54409::INFO::2014-05-16 17:40:50,085::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54409::DEBUG::2014-05-16 17:40:50,085::task::1168::TaskManager.Task::(prepare) Task=`d9111fd7-285a-4426-86d6-4cca1df6d4f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54409::DEBUG::2014-05-16 17:40:50,085::task::579::TaskManager.Task::(_updateState) Task=`d9111fd7-285a-4426-86d6-4cca1df6d4f4`::moving from state preparing -> state finished >Thread-54409::DEBUG::2014-05-16 17:40:50,085::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54409::DEBUG::2014-05-16 17:40:50,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54409::DEBUG::2014-05-16 17:40:50,085::task::974::TaskManager.Task::(_decref) Task=`d9111fd7-285a-4426-86d6-4cca1df6d4f4`::ref 0 aborting False >Thread-54410::DEBUG::2014-05-16 17:40:50,093::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54410::DEBUG::2014-05-16 17:40:50,094::task::579::TaskManager.Task::(_updateState) Task=`833fb5fc-c3c5-4695-ace6-a3f9d5e04e92`::moving from state init -> state preparing >Thread-54410::INFO::2014-05-16 17:40:50,094::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54410::DEBUG::2014-05-16 17:40:50,094::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e6d96e7a-86a8-4eb1-9a45-5f0c28df59e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54410::DEBUG::2014-05-16 17:40:50,094::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54410::DEBUG::2014-05-16 17:40:50,095::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54410::DEBUG::2014-05-16 17:40:50,095::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e6d96e7a-86a8-4eb1-9a45-5f0c28df59e0`::Granted request >Thread-54410::DEBUG::2014-05-16 17:40:50,095::task::811::TaskManager.Task::(resourceAcquired) Task=`833fb5fc-c3c5-4695-ace6-a3f9d5e04e92`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54410::DEBUG::2014-05-16 17:40:50,095::task::974::TaskManager.Task::(_decref) Task=`833fb5fc-c3c5-4695-ace6-a3f9d5e04e92`::ref 1 aborting False >Thread-54410::INFO::2014-05-16 17:40:50,096::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54410::DEBUG::2014-05-16 17:40:50,096::task::1168::TaskManager.Task::(prepare) Task=`833fb5fc-c3c5-4695-ace6-a3f9d5e04e92`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54410::DEBUG::2014-05-16 17:40:50,096::task::579::TaskManager.Task::(_updateState) Task=`833fb5fc-c3c5-4695-ace6-a3f9d5e04e92`::moving from state preparing -> state finished >Thread-54410::DEBUG::2014-05-16 17:40:50,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54410::DEBUG::2014-05-16 17:40:50,096::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54410::DEBUG::2014-05-16 17:40:50,097::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54410::DEBUG::2014-05-16 17:40:50,097::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54410::DEBUG::2014-05-16 17:40:50,097::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54410::DEBUG::2014-05-16 17:40:50,097::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54410::DEBUG::2014-05-16 17:40:50,097::task::974::TaskManager.Task::(_decref) Task=`833fb5fc-c3c5-4695-ace6-a3f9d5e04e92`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:40:50,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:50,465::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314729 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:52,476::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:52,547::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350156 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:54,559::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:54,626::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310025 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:40:56,637::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:56,711::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362187 s, 28.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:40:57,001::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:40:57,011::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000789668 s, 5.2 MB/s\n'; <rc> = 0 >Thread-54413::DEBUG::2014-05-16 17:40:57,419::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313167.000000 / 8.008586 / 262500000.000000 = 0.205169 >Thread-54413::DEBUG::2014-05-16 17:40:57,419::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053898344550384059, 'statsAge': 1.7414638996124268, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20516870924325412, 'rxDropped': 0} >Thread-54413::DEBUG::2014-05-16 17:40:57,419::task::579::TaskManager.Task::(_updateState) Task=`57c0919c-b9cd-4940-a305-65e57b445a72`::moving from state init -> state preparing >Thread-54413::INFO::2014-05-16 17:40:57,420::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54413::INFO::2014-05-16 17:40:57,420::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789668', 'lastCheck': '0.4', 'valid': True}} >Thread-54413::DEBUG::2014-05-16 17:40:57,420::task::1168::TaskManager.Task::(prepare) Task=`57c0919c-b9cd-4940-a305-65e57b445a72`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789668', 'lastCheck': '0.4', 'valid': True}} >Thread-54413::DEBUG::2014-05-16 17:40:57,420::task::579::TaskManager.Task::(_updateState) Task=`57c0919c-b9cd-4940-a305-65e57b445a72`::moving from state preparing -> state finished >Thread-54413::DEBUG::2014-05-16 17:40:57,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54413::DEBUG::2014-05-16 17:40:57,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54413::DEBUG::2014-05-16 17:40:57,421::task::974::TaskManager.Task::(_decref) Task=`57c0919c-b9cd-4940-a305-65e57b445a72`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:40:58,723::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:40:58,794::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350346 s, 29.2 MB/s\n'; <rc> = 0 >Thread-54415::DEBUG::2014-05-16 17:41:00,136::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54415::DEBUG::2014-05-16 17:41:00,137::task::579::TaskManager.Task::(_updateState) Task=`f5dedf4c-9f63-435f-b275-9a04357929c3`::moving from state init -> state preparing >Thread-54415::INFO::2014-05-16 17:41:00,137::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54415::INFO::2014-05-16 17:41:00,137::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54415::DEBUG::2014-05-16 17:41:00,137::task::1168::TaskManager.Task::(prepare) Task=`f5dedf4c-9f63-435f-b275-9a04357929c3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54415::DEBUG::2014-05-16 17:41:00,138::task::579::TaskManager.Task::(_updateState) Task=`f5dedf4c-9f63-435f-b275-9a04357929c3`::moving from state preparing -> state finished >Thread-54415::DEBUG::2014-05-16 17:41:00,138::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54415::DEBUG::2014-05-16 17:41:00,138::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54415::DEBUG::2014-05-16 17:41:00,138::task::974::TaskManager.Task::(_decref) Task=`f5dedf4c-9f63-435f-b275-9a04357929c3`::ref 0 aborting False >Thread-54416::DEBUG::2014-05-16 17:41:00,146::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54416::DEBUG::2014-05-16 17:41:00,146::task::579::TaskManager.Task::(_updateState) Task=`dba55f3e-0494-4dad-a5f7-f93b157a8fc0`::moving from state init -> state preparing >Thread-54416::INFO::2014-05-16 17:41:00,146::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54416::DEBUG::2014-05-16 17:41:00,147::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`84e358c3-ac8e-485e-a9f6-a93aaa429195`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54416::DEBUG::2014-05-16 17:41:00,147::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54416::DEBUG::2014-05-16 17:41:00,147::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54416::DEBUG::2014-05-16 17:41:00,147::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`84e358c3-ac8e-485e-a9f6-a93aaa429195`::Granted request >Thread-54416::DEBUG::2014-05-16 17:41:00,147::task::811::TaskManager.Task::(resourceAcquired) Task=`dba55f3e-0494-4dad-a5f7-f93b157a8fc0`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54416::DEBUG::2014-05-16 17:41:00,148::task::974::TaskManager.Task::(_decref) Task=`dba55f3e-0494-4dad-a5f7-f93b157a8fc0`::ref 1 aborting False >Thread-54416::INFO::2014-05-16 17:41:00,148::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54416::DEBUG::2014-05-16 17:41:00,148::task::1168::TaskManager.Task::(prepare) Task=`dba55f3e-0494-4dad-a5f7-f93b157a8fc0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54416::DEBUG::2014-05-16 17:41:00,148::task::579::TaskManager.Task::(_updateState) Task=`dba55f3e-0494-4dad-a5f7-f93b157a8fc0`::moving from state preparing -> state finished >Thread-54416::DEBUG::2014-05-16 17:41:00,149::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54416::DEBUG::2014-05-16 17:41:00,149::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54416::DEBUG::2014-05-16 17:41:00,149::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54416::DEBUG::2014-05-16 17:41:00,149::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54416::DEBUG::2014-05-16 17:41:00,149::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54416::DEBUG::2014-05-16 17:41:00,149::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54416::DEBUG::2014-05-16 17:41:00,150::task::974::TaskManager.Task::(_decref) Task=`dba55f3e-0494-4dad-a5f7-f93b157a8fc0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:41:00,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:00,873::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031427 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:02,884::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:02,951::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303751 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:04,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:05,030::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315867 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:07,043::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 17:41:07,074::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:41:07,102::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000802409 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:07,239::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.157554 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:09,252::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:09,318::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303981 s, 33.7 MB/s\n'; <rc> = 0 >Thread-54421::DEBUG::2014-05-16 17:41:10,198::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54421::DEBUG::2014-05-16 17:41:10,199::task::579::TaskManager.Task::(_updateState) Task=`239057ba-cde0-4ed0-9ccd-c702e34d2df5`::moving from state init -> state preparing >Thread-54421::INFO::2014-05-16 17:41:10,199::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54421::INFO::2014-05-16 17:41:10,200::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54421::DEBUG::2014-05-16 17:41:10,200::task::1168::TaskManager.Task::(prepare) Task=`239057ba-cde0-4ed0-9ccd-c702e34d2df5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54421::DEBUG::2014-05-16 17:41:10,200::task::579::TaskManager.Task::(_updateState) Task=`239057ba-cde0-4ed0-9ccd-c702e34d2df5`::moving from state preparing -> state finished >Thread-54421::DEBUG::2014-05-16 17:41:10,200::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54421::DEBUG::2014-05-16 17:41:10,200::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54421::DEBUG::2014-05-16 17:41:10,200::task::974::TaskManager.Task::(_decref) Task=`239057ba-cde0-4ed0-9ccd-c702e34d2df5`::ref 0 aborting False >Thread-54422::DEBUG::2014-05-16 17:41:10,210::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54422::DEBUG::2014-05-16 17:41:10,210::task::579::TaskManager.Task::(_updateState) Task=`01279811-4a3a-4f6f-8bf2-d6c8eb340455`::moving from state init -> state preparing >Thread-54422::INFO::2014-05-16 17:41:10,210::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54422::DEBUG::2014-05-16 17:41:10,210::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9cd6d848-62fc-4632-92ee-25a227ae2328`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54422::DEBUG::2014-05-16 17:41:10,211::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54422::DEBUG::2014-05-16 17:41:10,211::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54422::DEBUG::2014-05-16 17:41:10,211::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9cd6d848-62fc-4632-92ee-25a227ae2328`::Granted request >Thread-54422::DEBUG::2014-05-16 17:41:10,211::task::811::TaskManager.Task::(resourceAcquired) Task=`01279811-4a3a-4f6f-8bf2-d6c8eb340455`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54422::DEBUG::2014-05-16 17:41:10,211::task::974::TaskManager.Task::(_decref) Task=`01279811-4a3a-4f6f-8bf2-d6c8eb340455`::ref 1 aborting False >Thread-54422::INFO::2014-05-16 17:41:10,212::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54422::DEBUG::2014-05-16 17:41:10,212::task::1168::TaskManager.Task::(prepare) Task=`01279811-4a3a-4f6f-8bf2-d6c8eb340455`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54422::DEBUG::2014-05-16 17:41:10,212::task::579::TaskManager.Task::(_updateState) Task=`01279811-4a3a-4f6f-8bf2-d6c8eb340455`::moving from state preparing -> state finished >Thread-54422::DEBUG::2014-05-16 17:41:10,213::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54422::DEBUG::2014-05-16 17:41:10,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54422::DEBUG::2014-05-16 17:41:10,213::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54422::DEBUG::2014-05-16 17:41:10,213::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54422::DEBUG::2014-05-16 17:41:10,213::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54422::DEBUG::2014-05-16 17:41:10,213::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54422::DEBUG::2014-05-16 17:41:10,214::task::974::TaskManager.Task::(_decref) Task=`01279811-4a3a-4f6f-8bf2-d6c8eb340455`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:41:11,330::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:11,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314488 s, 32.6 MB/s\n'; <rc> = 0 >Thread-54423::DEBUG::2014-05-16 17:41:12,575::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314788.000000 / 8.008518 / 262500000.000000 = 0.205248 >Thread-54423::DEBUG::2014-05-16 17:41:12,576::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053502079814984364, 'statsAge': 0.88134288787841797, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20524755228829486, 'rxDropped': 0} >Thread-54423::DEBUG::2014-05-16 17:41:12,576::task::579::TaskManager.Task::(_updateState) Task=`5253ff6e-e05c-4730-ac13-d5db7b2491ce`::moving from state init -> state preparing >Thread-54423::INFO::2014-05-16 17:41:12,576::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54423::INFO::2014-05-16 17:41:12,577::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000802409', 'lastCheck': '5.4', 'valid': True}} >Thread-54423::DEBUG::2014-05-16 17:41:12,577::task::1168::TaskManager.Task::(prepare) Task=`5253ff6e-e05c-4730-ac13-d5db7b2491ce`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000802409', 'lastCheck': '5.4', 'valid': True}} >Thread-54423::DEBUG::2014-05-16 17:41:12,577::task::579::TaskManager.Task::(_updateState) Task=`5253ff6e-e05c-4730-ac13-d5db7b2491ce`::moving from state preparing -> state finished >Thread-54423::DEBUG::2014-05-16 17:41:12,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54423::DEBUG::2014-05-16 17:41:12,577::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54423::DEBUG::2014-05-16 17:41:12,577::task::974::TaskManager.Task::(_decref) Task=`5253ff6e-e05c-4730-ac13-d5db7b2491ce`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:41:13,409::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:13,480::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346874 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:15,491::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:15,558::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314595 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:41:17,214::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:41:17,225::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107747 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:17,570::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:17,642::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335719 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:19,654::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:19,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356028 s, 28.8 MB/s\n'; <rc> = 0 >Thread-54427::DEBUG::2014-05-16 17:41:20,254::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54427::DEBUG::2014-05-16 17:41:20,254::task::579::TaskManager.Task::(_updateState) Task=`27bb570f-4a57-47b1-afd1-38561f0f51ff`::moving from state init -> state preparing >Thread-54427::INFO::2014-05-16 17:41:20,255::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54427::INFO::2014-05-16 17:41:20,255::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54427::DEBUG::2014-05-16 17:41:20,255::task::1168::TaskManager.Task::(prepare) Task=`27bb570f-4a57-47b1-afd1-38561f0f51ff`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54427::DEBUG::2014-05-16 17:41:20,255::task::579::TaskManager.Task::(_updateState) Task=`27bb570f-4a57-47b1-afd1-38561f0f51ff`::moving from state preparing -> state finished >Thread-54427::DEBUG::2014-05-16 17:41:20,255::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54427::DEBUG::2014-05-16 17:41:20,255::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54427::DEBUG::2014-05-16 17:41:20,256::task::974::TaskManager.Task::(_decref) Task=`27bb570f-4a57-47b1-afd1-38561f0f51ff`::ref 0 aborting False >Thread-54428::DEBUG::2014-05-16 17:41:20,264::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54428::DEBUG::2014-05-16 17:41:20,264::task::579::TaskManager.Task::(_updateState) Task=`7920d96f-75c1-467a-ac6a-35d3b40ff626`::moving from state init -> state preparing >Thread-54428::INFO::2014-05-16 17:41:20,264::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54428::DEBUG::2014-05-16 17:41:20,264::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`409a4577-e945-4ce9-8c63-d763b592c3e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54428::DEBUG::2014-05-16 17:41:20,264::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54428::DEBUG::2014-05-16 17:41:20,265::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54428::DEBUG::2014-05-16 17:41:20,265::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`409a4577-e945-4ce9-8c63-d763b592c3e8`::Granted request >Thread-54428::DEBUG::2014-05-16 17:41:20,265::task::811::TaskManager.Task::(resourceAcquired) Task=`7920d96f-75c1-467a-ac6a-35d3b40ff626`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54428::DEBUG::2014-05-16 17:41:20,265::task::974::TaskManager.Task::(_decref) Task=`7920d96f-75c1-467a-ac6a-35d3b40ff626`::ref 1 aborting False >Thread-54428::INFO::2014-05-16 17:41:20,266::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54428::DEBUG::2014-05-16 17:41:20,266::task::1168::TaskManager.Task::(prepare) Task=`7920d96f-75c1-467a-ac6a-35d3b40ff626`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54428::DEBUG::2014-05-16 17:41:20,266::task::579::TaskManager.Task::(_updateState) Task=`7920d96f-75c1-467a-ac6a-35d3b40ff626`::moving from state preparing -> state finished >Thread-54428::DEBUG::2014-05-16 17:41:20,266::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54428::DEBUG::2014-05-16 17:41:20,266::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54428::DEBUG::2014-05-16 17:41:20,267::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54428::DEBUG::2014-05-16 17:41:20,267::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54428::DEBUG::2014-05-16 17:41:20,267::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54428::DEBUG::2014-05-16 17:41:20,267::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54428::DEBUG::2014-05-16 17:41:20,267::task::974::TaskManager.Task::(_decref) Task=`7920d96f-75c1-467a-ac6a-35d3b40ff626`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:41:21,743::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:21,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356217 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:23,826::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:23,903::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311537 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:25,915::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:25,983::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317603 s, 32.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:41:27,244::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 17:41:27,244::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:41:27,263::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:41:27,272::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000808951 s, 2.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:41:27,272::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000808951 s, 2.5 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 17:41:27,272::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 17:41:27,272::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 17:41:27,272::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:41:27,273::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:41:27,273::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:41:27,273::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:41:27,273::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:41:27,274::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:41:27,274::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:41:27,423::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:41:27,425::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:41:27,425::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 17:41:27,426::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 17:41:27,426::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 17:41:27,426::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 17:41:27,427::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:41:27,569::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:41:27,589::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:41:27,599::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654318 s, 6.3 MB/s\n'; <rc> = 0 >Thread-54431::DEBUG::2014-05-16 17:41:27,744::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5409300.000000 / 8.012143 / 262500000.000000 = 0.257195 >Thread-54431::DEBUG::2014-05-16 17:41:27,744::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065495824466781571, 'statsAge': 0.029222965240478516, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25719532725093397, 'rxDropped': 0} >Thread-54431::DEBUG::2014-05-16 17:41:27,746::task::579::TaskManager.Task::(_updateState) Task=`70ee0331-1d51-4a36-9b9b-73c608687745`::moving from state init -> state preparing >Thread-54431::INFO::2014-05-16 17:41:27,746::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54431::INFO::2014-05-16 17:41:27,746::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654318', 'lastCheck': '0.1', 'valid': True}} >Thread-54431::DEBUG::2014-05-16 17:41:27,746::task::1168::TaskManager.Task::(prepare) Task=`70ee0331-1d51-4a36-9b9b-73c608687745`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654318', 'lastCheck': '0.1', 'valid': True}} >Thread-54431::DEBUG::2014-05-16 17:41:27,746::task::579::TaskManager.Task::(_updateState) Task=`70ee0331-1d51-4a36-9b9b-73c608687745`::moving from state preparing -> state finished >Thread-54431::DEBUG::2014-05-16 17:41:27,746::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54431::DEBUG::2014-05-16 17:41:27,747::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54431::DEBUG::2014-05-16 17:41:27,747::task::974::TaskManager.Task::(_decref) Task=`70ee0331-1d51-4a36-9b9b-73c608687745`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:41:27,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:28,067::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03597 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:30,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:30,147::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314332 s, 32.6 MB/s\n'; <rc> = 0 >Thread-54433::DEBUG::2014-05-16 17:41:30,302::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54433::DEBUG::2014-05-16 17:41:30,302::task::579::TaskManager.Task::(_updateState) Task=`0255843b-0afa-4bd5-867c-b4702f4eb8fb`::moving from state init -> state preparing >Thread-54433::INFO::2014-05-16 17:41:30,303::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54433::INFO::2014-05-16 17:41:30,303::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54433::DEBUG::2014-05-16 17:41:30,303::task::1168::TaskManager.Task::(prepare) Task=`0255843b-0afa-4bd5-867c-b4702f4eb8fb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54433::DEBUG::2014-05-16 17:41:30,303::task::579::TaskManager.Task::(_updateState) Task=`0255843b-0afa-4bd5-867c-b4702f4eb8fb`::moving from state preparing -> state finished >Thread-54433::DEBUG::2014-05-16 17:41:30,303::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54433::DEBUG::2014-05-16 17:41:30,303::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54433::DEBUG::2014-05-16 17:41:30,304::task::974::TaskManager.Task::(_decref) Task=`0255843b-0afa-4bd5-867c-b4702f4eb8fb`::ref 0 aborting False >Thread-54434::DEBUG::2014-05-16 17:41:30,312::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54434::DEBUG::2014-05-16 17:41:30,312::task::579::TaskManager.Task::(_updateState) Task=`9b819d4e-782a-4606-9b3b-0e1d82d79370`::moving from state init -> state preparing >Thread-54434::INFO::2014-05-16 17:41:30,313::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54434::DEBUG::2014-05-16 17:41:30,313::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e1aeb777-61c3-44e7-be69-c5d46cc1b1dd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54434::DEBUG::2014-05-16 17:41:30,313::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54434::DEBUG::2014-05-16 17:41:30,313::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54434::DEBUG::2014-05-16 17:41:30,314::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e1aeb777-61c3-44e7-be69-c5d46cc1b1dd`::Granted request >Thread-54434::DEBUG::2014-05-16 17:41:30,314::task::811::TaskManager.Task::(resourceAcquired) Task=`9b819d4e-782a-4606-9b3b-0e1d82d79370`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54434::DEBUG::2014-05-16 17:41:30,314::task::974::TaskManager.Task::(_decref) Task=`9b819d4e-782a-4606-9b3b-0e1d82d79370`::ref 1 aborting False >Thread-54434::INFO::2014-05-16 17:41:30,315::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54434::DEBUG::2014-05-16 17:41:30,315::task::1168::TaskManager.Task::(prepare) Task=`9b819d4e-782a-4606-9b3b-0e1d82d79370`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54434::DEBUG::2014-05-16 17:41:30,315::task::579::TaskManager.Task::(_updateState) Task=`9b819d4e-782a-4606-9b3b-0e1d82d79370`::moving from state preparing -> state finished >Thread-54434::DEBUG::2014-05-16 17:41:30,315::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54434::DEBUG::2014-05-16 17:41:30,315::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54434::DEBUG::2014-05-16 17:41:30,316::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54434::DEBUG::2014-05-16 17:41:30,316::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54434::DEBUG::2014-05-16 17:41:30,316::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54434::DEBUG::2014-05-16 17:41:30,316::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54434::DEBUG::2014-05-16 17:41:30,316::task::974::TaskManager.Task::(_decref) Task=`9b819d4e-782a-4606-9b3b-0e1d82d79370`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:41:32,158::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:32,226::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306276 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:34,237::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:34,308::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349987 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:36,320::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:36,388::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316668 s, 32.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:41:37,635::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:41:37,646::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104685 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:38,399::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:38,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306344 s, 33.4 MB/s\n'; <rc> = 0 >Thread-54439::DEBUG::2014-05-16 17:41:40,354::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54439::DEBUG::2014-05-16 17:41:40,354::task::579::TaskManager.Task::(_updateState) Task=`7fa7dde2-c9e9-4302-ada0-71bd6c01307d`::moving from state init -> state preparing >Thread-54439::INFO::2014-05-16 17:41:40,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54439::INFO::2014-05-16 17:41:40,355::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54439::DEBUG::2014-05-16 17:41:40,355::task::1168::TaskManager.Task::(prepare) Task=`7fa7dde2-c9e9-4302-ada0-71bd6c01307d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54439::DEBUG::2014-05-16 17:41:40,355::task::579::TaskManager.Task::(_updateState) Task=`7fa7dde2-c9e9-4302-ada0-71bd6c01307d`::moving from state preparing -> state finished >Thread-54439::DEBUG::2014-05-16 17:41:40,355::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54439::DEBUG::2014-05-16 17:41:40,355::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54439::DEBUG::2014-05-16 17:41:40,356::task::974::TaskManager.Task::(_decref) Task=`7fa7dde2-c9e9-4302-ada0-71bd6c01307d`::ref 0 aborting False >Thread-54440::DEBUG::2014-05-16 17:41:40,364::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54440::DEBUG::2014-05-16 17:41:40,364::task::579::TaskManager.Task::(_updateState) Task=`4c4199f6-6eea-496e-98f1-d218bcb0eae2`::moving from state init -> state preparing >Thread-54440::INFO::2014-05-16 17:41:40,364::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54440::DEBUG::2014-05-16 17:41:40,365::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0f9746db-d311-48da-b080-6ffba43b9b8e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54440::DEBUG::2014-05-16 17:41:40,365::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54440::DEBUG::2014-05-16 17:41:40,365::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54440::DEBUG::2014-05-16 17:41:40,365::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0f9746db-d311-48da-b080-6ffba43b9b8e`::Granted request >Thread-54440::DEBUG::2014-05-16 17:41:40,365::task::811::TaskManager.Task::(resourceAcquired) Task=`4c4199f6-6eea-496e-98f1-d218bcb0eae2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54440::DEBUG::2014-05-16 17:41:40,366::task::974::TaskManager.Task::(_decref) Task=`4c4199f6-6eea-496e-98f1-d218bcb0eae2`::ref 1 aborting False >Thread-54440::INFO::2014-05-16 17:41:40,366::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54440::DEBUG::2014-05-16 17:41:40,366::task::1168::TaskManager.Task::(prepare) Task=`4c4199f6-6eea-496e-98f1-d218bcb0eae2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54440::DEBUG::2014-05-16 17:41:40,367::task::579::TaskManager.Task::(_updateState) Task=`4c4199f6-6eea-496e-98f1-d218bcb0eae2`::moving from state preparing -> state finished >Thread-54440::DEBUG::2014-05-16 17:41:40,367::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54440::DEBUG::2014-05-16 17:41:40,367::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54440::DEBUG::2014-05-16 17:41:40,367::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54440::DEBUG::2014-05-16 17:41:40,367::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54440::DEBUG::2014-05-16 17:41:40,367::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54440::DEBUG::2014-05-16 17:41:40,368::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54440::DEBUG::2014-05-16 17:41:40,368::task::974::TaskManager.Task::(_decref) Task=`4c4199f6-6eea-496e-98f1-d218bcb0eae2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:41:40,477::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:40,548::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357916 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:42,560::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:42,632::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350136 s, 29.2 MB/s\n'; <rc> = 0 >Thread-54441::DEBUG::2014-05-16 17:41:42,895::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4336682.000000 / 8.008497 / 262500000.000000 = 0.206290 >Thread-54441::DEBUG::2014-05-16 17:41:42,895::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053654440850180313, 'statsAge': 1.165024995803833, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20628956137298232, 'rxDropped': 0} >Thread-54441::DEBUG::2014-05-16 17:41:42,895::task::579::TaskManager.Task::(_updateState) Task=`33e95c9f-a7d8-485a-a9ba-4ad0ba897606`::moving from state init -> state preparing >Thread-54441::INFO::2014-05-16 17:41:42,896::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54441::INFO::2014-05-16 17:41:42,896::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104685', 'lastCheck': '5.2', 'valid': True}} >Thread-54441::DEBUG::2014-05-16 17:41:42,896::task::1168::TaskManager.Task::(prepare) Task=`33e95c9f-a7d8-485a-a9ba-4ad0ba897606`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104685', 'lastCheck': '5.2', 'valid': True}} >Thread-54441::DEBUG::2014-05-16 17:41:42,896::task::579::TaskManager.Task::(_updateState) Task=`33e95c9f-a7d8-485a-a9ba-4ad0ba897606`::moving from state preparing -> state finished >Thread-54441::DEBUG::2014-05-16 17:41:42,896::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54441::DEBUG::2014-05-16 17:41:42,896::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54441::DEBUG::2014-05-16 17:41:42,897::task::974::TaskManager.Task::(_decref) Task=`33e95c9f-a7d8-485a-a9ba-4ad0ba897606`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:41:44,643::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:44,710::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305206 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:46,722::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:46,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360155 s, 28.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:41:47,679::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:41:47,689::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000792884 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:48,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:48,878::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354144 s, 28.9 MB/s\n'; <rc> = 0 >Thread-54445::DEBUG::2014-05-16 17:41:50,397::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54445::DEBUG::2014-05-16 17:41:50,398::task::579::TaskManager.Task::(_updateState) Task=`0ed209ad-18d0-43c4-bce7-91d1fde85da3`::moving from state init -> state preparing >Thread-54445::INFO::2014-05-16 17:41:50,398::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54445::INFO::2014-05-16 17:41:50,398::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54445::DEBUG::2014-05-16 17:41:50,398::task::1168::TaskManager.Task::(prepare) Task=`0ed209ad-18d0-43c4-bce7-91d1fde85da3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54445::DEBUG::2014-05-16 17:41:50,398::task::579::TaskManager.Task::(_updateState) Task=`0ed209ad-18d0-43c4-bce7-91d1fde85da3`::moving from state preparing -> state finished >Thread-54445::DEBUG::2014-05-16 17:41:50,399::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54445::DEBUG::2014-05-16 17:41:50,399::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54445::DEBUG::2014-05-16 17:41:50,399::task::974::TaskManager.Task::(_decref) Task=`0ed209ad-18d0-43c4-bce7-91d1fde85da3`::ref 0 aborting False >Thread-54446::DEBUG::2014-05-16 17:41:50,407::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54446::DEBUG::2014-05-16 17:41:50,408::task::579::TaskManager.Task::(_updateState) Task=`f6eb1341-92a9-4c5a-a4fb-16c47b6c144e`::moving from state init -> state preparing >Thread-54446::INFO::2014-05-16 17:41:50,408::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54446::DEBUG::2014-05-16 17:41:50,408::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4bb8cb12-1e3f-4bdd-b612-af2877892313`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54446::DEBUG::2014-05-16 17:41:50,408::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54446::DEBUG::2014-05-16 17:41:50,409::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54446::DEBUG::2014-05-16 17:41:50,409::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4bb8cb12-1e3f-4bdd-b612-af2877892313`::Granted request >Thread-54446::DEBUG::2014-05-16 17:41:50,409::task::811::TaskManager.Task::(resourceAcquired) Task=`f6eb1341-92a9-4c5a-a4fb-16c47b6c144e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54446::DEBUG::2014-05-16 17:41:50,409::task::974::TaskManager.Task::(_decref) Task=`f6eb1341-92a9-4c5a-a4fb-16c47b6c144e`::ref 1 aborting False >Thread-54446::INFO::2014-05-16 17:41:50,410::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54446::DEBUG::2014-05-16 17:41:50,410::task::1168::TaskManager.Task::(prepare) Task=`f6eb1341-92a9-4c5a-a4fb-16c47b6c144e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54446::DEBUG::2014-05-16 17:41:50,410::task::579::TaskManager.Task::(_updateState) Task=`f6eb1341-92a9-4c5a-a4fb-16c47b6c144e`::moving from state preparing -> state finished >Thread-54446::DEBUG::2014-05-16 17:41:50,410::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54446::DEBUG::2014-05-16 17:41:50,410::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54446::DEBUG::2014-05-16 17:41:50,410::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54446::DEBUG::2014-05-16 17:41:50,411::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54446::DEBUG::2014-05-16 17:41:50,411::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54446::DEBUG::2014-05-16 17:41:50,411::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54446::DEBUG::2014-05-16 17:41:50,411::task::974::TaskManager.Task::(_decref) Task=`f6eb1341-92a9-4c5a-a4fb-16c47b6c144e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:41:50,890::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:50,958::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317889 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:52,969::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:53,036::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303627 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:55,048::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:55,119::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353381 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:41:57,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:57,202::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349089 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:41:57,725::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:41:57,736::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000808353 s, 5.1 MB/s\n'; <rc> = 0 >Thread-54449::DEBUG::2014-05-16 17:41:58,048::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4309406.000000 / 8.008585 / 262500000.000000 = 0.204990 >Thread-54449::DEBUG::2014-05-16 17:41:58,048::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053622456560854818, 'statsAge': 0.30143594741821289, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20498983042197777, 'rxDropped': 0} >Thread-54449::DEBUG::2014-05-16 17:41:58,049::task::579::TaskManager.Task::(_updateState) Task=`88461a7d-465b-4fe0-b671-7d59cffb826a`::moving from state init -> state preparing >Thread-54449::INFO::2014-05-16 17:41:58,049::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54449::INFO::2014-05-16 17:41:58,049::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808353', 'lastCheck': '0.3', 'valid': True}} >Thread-54449::DEBUG::2014-05-16 17:41:58,049::task::1168::TaskManager.Task::(prepare) Task=`88461a7d-465b-4fe0-b671-7d59cffb826a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808353', 'lastCheck': '0.3', 'valid': True}} >Thread-54449::DEBUG::2014-05-16 17:41:58,050::task::579::TaskManager.Task::(_updateState) Task=`88461a7d-465b-4fe0-b671-7d59cffb826a`::moving from state preparing -> state finished >Thread-54449::DEBUG::2014-05-16 17:41:58,050::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54449::DEBUG::2014-05-16 17:41:58,050::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54449::DEBUG::2014-05-16 17:41:58,050::task::974::TaskManager.Task::(_decref) Task=`88461a7d-465b-4fe0-b671-7d59cffb826a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:41:59,214::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:41:59,281::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308526 s, 33.2 MB/s\n'; <rc> = 0 >Thread-54451::DEBUG::2014-05-16 17:42:00,447::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54451::DEBUG::2014-05-16 17:42:00,447::task::579::TaskManager.Task::(_updateState) Task=`8c170f91-7545-452a-b001-e2abd28638dc`::moving from state init -> state preparing >Thread-54451::INFO::2014-05-16 17:42:00,448::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54451::INFO::2014-05-16 17:42:00,448::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54451::DEBUG::2014-05-16 17:42:00,448::task::1168::TaskManager.Task::(prepare) Task=`8c170f91-7545-452a-b001-e2abd28638dc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54451::DEBUG::2014-05-16 17:42:00,448::task::579::TaskManager.Task::(_updateState) Task=`8c170f91-7545-452a-b001-e2abd28638dc`::moving from state preparing -> state finished >Thread-54451::DEBUG::2014-05-16 17:42:00,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54451::DEBUG::2014-05-16 17:42:00,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54451::DEBUG::2014-05-16 17:42:00,449::task::974::TaskManager.Task::(_decref) Task=`8c170f91-7545-452a-b001-e2abd28638dc`::ref 0 aborting False >Thread-54452::DEBUG::2014-05-16 17:42:00,458::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54452::DEBUG::2014-05-16 17:42:00,458::task::579::TaskManager.Task::(_updateState) Task=`fe55e555-a6cc-40e3-812b-af43e5050826`::moving from state init -> state preparing >Thread-54452::INFO::2014-05-16 17:42:00,458::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54452::DEBUG::2014-05-16 17:42:00,458::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9258a631-f3fc-49c9-b2db-262e58d21136`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54452::DEBUG::2014-05-16 17:42:00,459::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54452::DEBUG::2014-05-16 17:42:00,459::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54452::DEBUG::2014-05-16 17:42:00,459::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9258a631-f3fc-49c9-b2db-262e58d21136`::Granted request >Thread-54452::DEBUG::2014-05-16 17:42:00,459::task::811::TaskManager.Task::(resourceAcquired) Task=`fe55e555-a6cc-40e3-812b-af43e5050826`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54452::DEBUG::2014-05-16 17:42:00,460::task::974::TaskManager.Task::(_decref) Task=`fe55e555-a6cc-40e3-812b-af43e5050826`::ref 1 aborting False >Thread-54452::INFO::2014-05-16 17:42:00,460::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54452::DEBUG::2014-05-16 17:42:00,460::task::1168::TaskManager.Task::(prepare) Task=`fe55e555-a6cc-40e3-812b-af43e5050826`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54452::DEBUG::2014-05-16 17:42:00,461::task::579::TaskManager.Task::(_updateState) Task=`fe55e555-a6cc-40e3-812b-af43e5050826`::moving from state preparing -> state finished >Thread-54452::DEBUG::2014-05-16 17:42:00,461::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54452::DEBUG::2014-05-16 17:42:00,461::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54452::DEBUG::2014-05-16 17:42:00,461::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54452::DEBUG::2014-05-16 17:42:00,461::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54452::DEBUG::2014-05-16 17:42:00,461::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54452::DEBUG::2014-05-16 17:42:00,462::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54452::DEBUG::2014-05-16 17:42:00,462::task::974::TaskManager.Task::(_decref) Task=`fe55e555-a6cc-40e3-812b-af43e5050826`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:42:01,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:01,365::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360303 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:03,377::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:03,448::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311468 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:05,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:05,526::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311284 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:07,538::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:07,609::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354721 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:42:07,783::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:42:07,793::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000825614 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:09,621::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:09,687::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304156 s, 33.7 MB/s\n'; <rc> = 0 >Thread-54457::DEBUG::2014-05-16 17:42:10,499::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54457::DEBUG::2014-05-16 17:42:10,499::task::579::TaskManager.Task::(_updateState) Task=`bb26175c-b7db-46bb-b3b7-4fc58b17bb97`::moving from state init -> state preparing >Thread-54457::INFO::2014-05-16 17:42:10,499::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54457::INFO::2014-05-16 17:42:10,499::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54457::DEBUG::2014-05-16 17:42:10,500::task::1168::TaskManager.Task::(prepare) Task=`bb26175c-b7db-46bb-b3b7-4fc58b17bb97`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54457::DEBUG::2014-05-16 17:42:10,500::task::579::TaskManager.Task::(_updateState) Task=`bb26175c-b7db-46bb-b3b7-4fc58b17bb97`::moving from state preparing -> state finished >Thread-54457::DEBUG::2014-05-16 17:42:10,500::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54457::DEBUG::2014-05-16 17:42:10,500::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54457::DEBUG::2014-05-16 17:42:10,500::task::974::TaskManager.Task::(_decref) Task=`bb26175c-b7db-46bb-b3b7-4fc58b17bb97`::ref 0 aborting False >Thread-54458::DEBUG::2014-05-16 17:42:10,508::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54458::DEBUG::2014-05-16 17:42:10,509::task::579::TaskManager.Task::(_updateState) Task=`aa574e78-28a2-4372-904b-31a1259e952f`::moving from state init -> state preparing >Thread-54458::INFO::2014-05-16 17:42:10,509::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54458::DEBUG::2014-05-16 17:42:10,509::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d15f9a1f-8835-43bb-b33a-860a7a2ca71b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54458::DEBUG::2014-05-16 17:42:10,509::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54458::DEBUG::2014-05-16 17:42:10,510::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54458::DEBUG::2014-05-16 17:42:10,510::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d15f9a1f-8835-43bb-b33a-860a7a2ca71b`::Granted request >Thread-54458::DEBUG::2014-05-16 17:42:10,510::task::811::TaskManager.Task::(resourceAcquired) Task=`aa574e78-28a2-4372-904b-31a1259e952f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54458::DEBUG::2014-05-16 17:42:10,510::task::974::TaskManager.Task::(_decref) Task=`aa574e78-28a2-4372-904b-31a1259e952f`::ref 1 aborting False >Thread-54458::INFO::2014-05-16 17:42:10,511::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54458::DEBUG::2014-05-16 17:42:10,511::task::1168::TaskManager.Task::(prepare) Task=`aa574e78-28a2-4372-904b-31a1259e952f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54458::DEBUG::2014-05-16 17:42:10,511::task::579::TaskManager.Task::(_updateState) Task=`aa574e78-28a2-4372-904b-31a1259e952f`::moving from state preparing -> state finished >Thread-54458::DEBUG::2014-05-16 17:42:10,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54458::DEBUG::2014-05-16 17:42:10,512::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54458::DEBUG::2014-05-16 17:42:10,512::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54458::DEBUG::2014-05-16 17:42:10,512::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54458::DEBUG::2014-05-16 17:42:10,512::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54458::DEBUG::2014-05-16 17:42:10,512::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54458::DEBUG::2014-05-16 17:42:10,512::task::974::TaskManager.Task::(_decref) Task=`aa574e78-28a2-4372-904b-31a1259e952f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:42:11,698::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:11,781::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316326 s, 32.4 MB/s\n'; <rc> = 0 >Thread-54459::DEBUG::2014-05-16 17:42:13,184::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 6487649.000000 / 8.012152 / 262500000.000000 = 0.308467 >Thread-54459::DEBUG::2014-05-16 17:42:13,185::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0078660515104699985, 'statsAge': 1.4157278537750244, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.30846710680647238, 'rxDropped': 0} >Thread-54459::DEBUG::2014-05-16 17:42:13,185::task::579::TaskManager.Task::(_updateState) Task=`38e3b671-8d93-47fe-9ed0-30441e8cbd09`::moving from state init -> state preparing >Thread-54459::INFO::2014-05-16 17:42:13,185::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54459::INFO::2014-05-16 17:42:13,186::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000825614', 'lastCheck': '5.4', 'valid': True}} >Thread-54459::DEBUG::2014-05-16 17:42:13,186::task::1168::TaskManager.Task::(prepare) Task=`38e3b671-8d93-47fe-9ed0-30441e8cbd09`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000825614', 'lastCheck': '5.4', 'valid': True}} >Thread-54459::DEBUG::2014-05-16 17:42:13,186::task::579::TaskManager.Task::(_updateState) Task=`38e3b671-8d93-47fe-9ed0-30441e8cbd09`::moving from state preparing -> state finished >Thread-54459::DEBUG::2014-05-16 17:42:13,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54459::DEBUG::2014-05-16 17:42:13,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54459::DEBUG::2014-05-16 17:42:13,186::task::974::TaskManager.Task::(_decref) Task=`38e3b671-8d93-47fe-9ed0-30441e8cbd09`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:42:13,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:13,866::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355834 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:15,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:15,945::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318924 s, 32.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:42:17,826::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:42:17,836::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000905265 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:17,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:18,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344819 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:20,039::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:20,107::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313655 s, 32.6 MB/s\n'; <rc> = 0 >Thread-54463::DEBUG::2014-05-16 17:42:20,543::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54463::DEBUG::2014-05-16 17:42:20,544::task::579::TaskManager.Task::(_updateState) Task=`f9447b94-ae9b-4f0b-9c46-4780541a64d6`::moving from state init -> state preparing >Thread-54463::INFO::2014-05-16 17:42:20,544::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54463::INFO::2014-05-16 17:42:20,544::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54463::DEBUG::2014-05-16 17:42:20,544::task::1168::TaskManager.Task::(prepare) Task=`f9447b94-ae9b-4f0b-9c46-4780541a64d6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54463::DEBUG::2014-05-16 17:42:20,544::task::579::TaskManager.Task::(_updateState) Task=`f9447b94-ae9b-4f0b-9c46-4780541a64d6`::moving from state preparing -> state finished >Thread-54463::DEBUG::2014-05-16 17:42:20,545::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54463::DEBUG::2014-05-16 17:42:20,545::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54463::DEBUG::2014-05-16 17:42:20,545::task::974::TaskManager.Task::(_decref) Task=`f9447b94-ae9b-4f0b-9c46-4780541a64d6`::ref 0 aborting False >Thread-54464::DEBUG::2014-05-16 17:42:20,555::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54464::DEBUG::2014-05-16 17:42:20,556::task::579::TaskManager.Task::(_updateState) Task=`e5c76be5-6f78-41c6-9565-c2de730b496a`::moving from state init -> state preparing >Thread-54464::INFO::2014-05-16 17:42:20,556::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54464::DEBUG::2014-05-16 17:42:20,556::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`93228914-fff0-4250-a6c6-56e5ebcaf6fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54464::DEBUG::2014-05-16 17:42:20,556::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54464::DEBUG::2014-05-16 17:42:20,556::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54464::DEBUG::2014-05-16 17:42:20,557::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`93228914-fff0-4250-a6c6-56e5ebcaf6fb`::Granted request >Thread-54464::DEBUG::2014-05-16 17:42:20,557::task::811::TaskManager.Task::(resourceAcquired) Task=`e5c76be5-6f78-41c6-9565-c2de730b496a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54464::DEBUG::2014-05-16 17:42:20,557::task::974::TaskManager.Task::(_decref) Task=`e5c76be5-6f78-41c6-9565-c2de730b496a`::ref 1 aborting False >Thread-54464::INFO::2014-05-16 17:42:20,558::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54464::DEBUG::2014-05-16 17:42:20,558::task::1168::TaskManager.Task::(prepare) Task=`e5c76be5-6f78-41c6-9565-c2de730b496a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54464::DEBUG::2014-05-16 17:42:20,558::task::579::TaskManager.Task::(_updateState) Task=`e5c76be5-6f78-41c6-9565-c2de730b496a`::moving from state preparing -> state finished >Thread-54464::DEBUG::2014-05-16 17:42:20,558::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54464::DEBUG::2014-05-16 17:42:20,558::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54464::DEBUG::2014-05-16 17:42:20,559::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54464::DEBUG::2014-05-16 17:42:20,559::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54464::DEBUG::2014-05-16 17:42:20,559::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54464::DEBUG::2014-05-16 17:42:20,559::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54464::DEBUG::2014-05-16 17:42:20,559::task::974::TaskManager.Task::(_decref) Task=`e5c76be5-6f78-41c6-9565-c2de730b496a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:42:22,119::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:22,190::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359714 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:24,202::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:24,268::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299749 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:26,280::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:26,347::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031254 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:42:27,873::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:42:27,884::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108377 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:28,359::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:28,429::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345473 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:30,441::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:30,508::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313863 s, 32.6 MB/s\n'; <rc> = 0 >Thread-54466::DEBUG::2014-05-16 17:42:30,618::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54466::DEBUG::2014-05-16 17:42:30,618::task::579::TaskManager.Task::(_updateState) Task=`2b39997d-d974-4541-b330-273286979437`::moving from state init -> state preparing >Thread-54466::INFO::2014-05-16 17:42:30,618::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54466::INFO::2014-05-16 17:42:30,619::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54466::DEBUG::2014-05-16 17:42:30,619::task::1168::TaskManager.Task::(prepare) Task=`2b39997d-d974-4541-b330-273286979437`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54466::DEBUG::2014-05-16 17:42:30,619::task::579::TaskManager.Task::(_updateState) Task=`2b39997d-d974-4541-b330-273286979437`::moving from state preparing -> state finished >Thread-54466::DEBUG::2014-05-16 17:42:30,619::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54466::DEBUG::2014-05-16 17:42:30,619::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54466::DEBUG::2014-05-16 17:42:30,620::task::974::TaskManager.Task::(_decref) Task=`2b39997d-d974-4541-b330-273286979437`::ref 0 aborting False >Thread-54467::DEBUG::2014-05-16 17:42:30,628::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54467::DEBUG::2014-05-16 17:42:30,629::task::579::TaskManager.Task::(_updateState) Task=`553c6db3-57d9-4564-8e18-492055638e22`::moving from state init -> state preparing >Thread-54467::INFO::2014-05-16 17:42:30,629::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54467::DEBUG::2014-05-16 17:42:30,629::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4e27f25f-fd18-40ae-a045-d509be768ef1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54467::DEBUG::2014-05-16 17:42:30,630::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54467::DEBUG::2014-05-16 17:42:30,630::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54467::DEBUG::2014-05-16 17:42:30,630::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4e27f25f-fd18-40ae-a045-d509be768ef1`::Granted request >Thread-54467::DEBUG::2014-05-16 17:42:30,630::task::811::TaskManager.Task::(resourceAcquired) Task=`553c6db3-57d9-4564-8e18-492055638e22`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54467::DEBUG::2014-05-16 17:42:30,630::task::974::TaskManager.Task::(_decref) Task=`553c6db3-57d9-4564-8e18-492055638e22`::ref 1 aborting False >Thread-54467::INFO::2014-05-16 17:42:30,631::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54467::DEBUG::2014-05-16 17:42:30,631::task::1168::TaskManager.Task::(prepare) Task=`553c6db3-57d9-4564-8e18-492055638e22`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54467::DEBUG::2014-05-16 17:42:30,631::task::579::TaskManager.Task::(_updateState) Task=`553c6db3-57d9-4564-8e18-492055638e22`::moving from state preparing -> state finished >Thread-54467::DEBUG::2014-05-16 17:42:30,632::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54467::DEBUG::2014-05-16 17:42:30,632::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54467::DEBUG::2014-05-16 17:42:30,632::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54467::DEBUG::2014-05-16 17:42:30,632::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54467::DEBUG::2014-05-16 17:42:30,632::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54467::DEBUG::2014-05-16 17:42:30,632::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54467::DEBUG::2014-05-16 17:42:30,633::task::974::TaskManager.Task::(_decref) Task=`553c6db3-57d9-4564-8e18-492055638e22`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:42:32,520::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:32,586::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301655 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:34,598::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:34,669::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347333 s, 29.5 MB/s\n'; <rc> = 0 >Thread-54469::DEBUG::2014-05-16 17:42:34,975::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4312817.000000 / 8.008279 / 262500000.000000 = 0.205160 >Thread-54469::DEBUG::2014-05-16 17:42:34,975::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052942353575419756, 'statsAge': 1.1789629459381104, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2051599210380444, 'rxDropped': 0} >Thread-54469::DEBUG::2014-05-16 17:42:34,976::task::579::TaskManager.Task::(_updateState) Task=`49ebf6ba-3bb4-40d1-bde4-26717d95d367`::moving from state init -> state preparing >Thread-54469::INFO::2014-05-16 17:42:34,976::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54469::INFO::2014-05-16 17:42:34,976::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108377', 'lastCheck': '7.1', 'valid': True}} >Thread-54469::DEBUG::2014-05-16 17:42:34,976::task::1168::TaskManager.Task::(prepare) Task=`49ebf6ba-3bb4-40d1-bde4-26717d95d367`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108377', 'lastCheck': '7.1', 'valid': True}} >Thread-54469::DEBUG::2014-05-16 17:42:34,977::task::579::TaskManager.Task::(_updateState) Task=`49ebf6ba-3bb4-40d1-bde4-26717d95d367`::moving from state preparing -> state finished >Thread-54469::DEBUG::2014-05-16 17:42:34,977::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54469::DEBUG::2014-05-16 17:42:34,977::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54469::DEBUG::2014-05-16 17:42:34,977::task::974::TaskManager.Task::(_decref) Task=`49ebf6ba-3bb4-40d1-bde4-26717d95d367`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:42:36,680::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:36,747::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311395 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:42:37,921::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:42:37,931::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616473 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:38,759::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:38,825::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300369 s, 34.1 MB/s\n'; <rc> = 0 >Thread-54472::DEBUG::2014-05-16 17:42:40,666::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54472::DEBUG::2014-05-16 17:42:40,667::task::579::TaskManager.Task::(_updateState) Task=`c36d97e2-0070-402e-91ba-7c06da60bfc0`::moving from state init -> state preparing >Thread-54472::INFO::2014-05-16 17:42:40,667::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54472::INFO::2014-05-16 17:42:40,668::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54472::DEBUG::2014-05-16 17:42:40,668::task::1168::TaskManager.Task::(prepare) Task=`c36d97e2-0070-402e-91ba-7c06da60bfc0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54472::DEBUG::2014-05-16 17:42:40,668::task::579::TaskManager.Task::(_updateState) Task=`c36d97e2-0070-402e-91ba-7c06da60bfc0`::moving from state preparing -> state finished >Thread-54472::DEBUG::2014-05-16 17:42:40,668::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54472::DEBUG::2014-05-16 17:42:40,668::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54472::DEBUG::2014-05-16 17:42:40,668::task::974::TaskManager.Task::(_decref) Task=`c36d97e2-0070-402e-91ba-7c06da60bfc0`::ref 0 aborting False >Thread-54473::DEBUG::2014-05-16 17:42:40,677::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54473::DEBUG::2014-05-16 17:42:40,677::task::579::TaskManager.Task::(_updateState) Task=`5501ae23-71a4-48e5-a569-2adb10241d34`::moving from state init -> state preparing >Thread-54473::INFO::2014-05-16 17:42:40,677::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54473::DEBUG::2014-05-16 17:42:40,678::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dcfee46f-4de0-4c51-885f-e8023e2fe669`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54473::DEBUG::2014-05-16 17:42:40,678::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54473::DEBUG::2014-05-16 17:42:40,678::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54473::DEBUG::2014-05-16 17:42:40,678::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dcfee46f-4de0-4c51-885f-e8023e2fe669`::Granted request >Thread-54473::DEBUG::2014-05-16 17:42:40,679::task::811::TaskManager.Task::(resourceAcquired) Task=`5501ae23-71a4-48e5-a569-2adb10241d34`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54473::DEBUG::2014-05-16 17:42:40,679::task::974::TaskManager.Task::(_decref) Task=`5501ae23-71a4-48e5-a569-2adb10241d34`::ref 1 aborting False >Thread-54473::INFO::2014-05-16 17:42:40,680::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54473::DEBUG::2014-05-16 17:42:40,680::task::1168::TaskManager.Task::(prepare) Task=`5501ae23-71a4-48e5-a569-2adb10241d34`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54473::DEBUG::2014-05-16 17:42:40,680::task::579::TaskManager.Task::(_updateState) Task=`5501ae23-71a4-48e5-a569-2adb10241d34`::moving from state preparing -> state finished >Thread-54473::DEBUG::2014-05-16 17:42:40,680::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54473::DEBUG::2014-05-16 17:42:40,680::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54473::DEBUG::2014-05-16 17:42:40,680::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54473::DEBUG::2014-05-16 17:42:40,681::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54473::DEBUG::2014-05-16 17:42:40,681::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54473::DEBUG::2014-05-16 17:42:40,681::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54473::DEBUG::2014-05-16 17:42:40,681::task::974::TaskManager.Task::(_decref) Task=`5501ae23-71a4-48e5-a569-2adb10241d34`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:42:40,837::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:40,908::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359177 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:42,920::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:42,991::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350993 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:45,003::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:45,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303517 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:47,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:47,148::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313428 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:42:47,965::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:42:47,975::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000786145 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:49,160::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:49,231::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035493 s, 28.9 MB/s\n'; <rc> = 0 >Thread-54477::DEBUG::2014-05-16 17:42:50,207::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5407727.000000 / 8.008275 / 262500000.000000 = 0.257245 >Thread-54477::DEBUG::2014-05-16 17:42:50,207::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.006314706295620435, 'statsAge': 0.39434599876403809, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25724472098516427, 'rxDropped': 0} >Thread-54477::DEBUG::2014-05-16 17:42:50,208::task::579::TaskManager.Task::(_updateState) Task=`98f345e6-827c-4624-8906-8962c4277471`::moving from state init -> state preparing >Thread-54477::INFO::2014-05-16 17:42:50,208::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54477::INFO::2014-05-16 17:42:50,208::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000786145', 'lastCheck': '2.2', 'valid': True}} >Thread-54477::DEBUG::2014-05-16 17:42:50,208::task::1168::TaskManager.Task::(prepare) Task=`98f345e6-827c-4624-8906-8962c4277471`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000786145', 'lastCheck': '2.2', 'valid': True}} >Thread-54477::DEBUG::2014-05-16 17:42:50,209::task::579::TaskManager.Task::(_updateState) Task=`98f345e6-827c-4624-8906-8962c4277471`::moving from state preparing -> state finished >Thread-54477::DEBUG::2014-05-16 17:42:50,209::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54477::DEBUG::2014-05-16 17:42:50,209::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54477::DEBUG::2014-05-16 17:42:50,209::task::974::TaskManager.Task::(_decref) Task=`98f345e6-827c-4624-8906-8962c4277471`::ref 0 aborting False >Thread-54479::DEBUG::2014-05-16 17:42:50,759::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54479::DEBUG::2014-05-16 17:42:50,759::task::579::TaskManager.Task::(_updateState) Task=`46ab13fd-5939-4965-bcef-e8ab3ebbd411`::moving from state init -> state preparing >Thread-54479::INFO::2014-05-16 17:42:50,759::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54479::INFO::2014-05-16 17:42:50,760::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54479::DEBUG::2014-05-16 17:42:50,760::task::1168::TaskManager.Task::(prepare) Task=`46ab13fd-5939-4965-bcef-e8ab3ebbd411`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54479::DEBUG::2014-05-16 17:42:50,760::task::579::TaskManager.Task::(_updateState) Task=`46ab13fd-5939-4965-bcef-e8ab3ebbd411`::moving from state preparing -> state finished >Thread-54479::DEBUG::2014-05-16 17:42:50,760::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54479::DEBUG::2014-05-16 17:42:50,760::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54479::DEBUG::2014-05-16 17:42:50,760::task::974::TaskManager.Task::(_decref) Task=`46ab13fd-5939-4965-bcef-e8ab3ebbd411`::ref 0 aborting False >Thread-54480::DEBUG::2014-05-16 17:42:50,768::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54480::DEBUG::2014-05-16 17:42:50,769::task::579::TaskManager.Task::(_updateState) Task=`8d044518-f11e-42d7-ae79-d88c1ab789ec`::moving from state init -> state preparing >Thread-54480::INFO::2014-05-16 17:42:50,769::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54480::DEBUG::2014-05-16 17:42:50,769::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`782a25b9-1d22-48a4-b086-c746246eb977`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54480::DEBUG::2014-05-16 17:42:50,769::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54480::DEBUG::2014-05-16 17:42:50,770::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54480::DEBUG::2014-05-16 17:42:50,770::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`782a25b9-1d22-48a4-b086-c746246eb977`::Granted request >Thread-54480::DEBUG::2014-05-16 17:42:50,770::task::811::TaskManager.Task::(resourceAcquired) Task=`8d044518-f11e-42d7-ae79-d88c1ab789ec`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54480::DEBUG::2014-05-16 17:42:50,770::task::974::TaskManager.Task::(_decref) Task=`8d044518-f11e-42d7-ae79-d88c1ab789ec`::ref 1 aborting False >Thread-54480::INFO::2014-05-16 17:42:50,771::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54480::DEBUG::2014-05-16 17:42:50,771::task::1168::TaskManager.Task::(prepare) Task=`8d044518-f11e-42d7-ae79-d88c1ab789ec`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54480::DEBUG::2014-05-16 17:42:50,771::task::579::TaskManager.Task::(_updateState) Task=`8d044518-f11e-42d7-ae79-d88c1ab789ec`::moving from state preparing -> state finished >Thread-54480::DEBUG::2014-05-16 17:42:50,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54480::DEBUG::2014-05-16 17:42:50,771::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54480::DEBUG::2014-05-16 17:42:50,771::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54480::DEBUG::2014-05-16 17:42:50,772::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54480::DEBUG::2014-05-16 17:42:50,772::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54480::DEBUG::2014-05-16 17:42:50,772::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54480::DEBUG::2014-05-16 17:42:50,772::task::974::TaskManager.Task::(_decref) Task=`8d044518-f11e-42d7-ae79-d88c1ab789ec`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:42:51,243::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:51,310::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311356 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:53,321::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:53,389::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315656 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:55,400::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:55,472::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354145 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:57,484::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:57,555::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350052 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:42:58,013::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:42:58,023::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000806426 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:42:59,566::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:42:59,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306296 s, 33.4 MB/s\n'; <rc> = 0 >Thread-54484::DEBUG::2014-05-16 17:43:00,853::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54484::DEBUG::2014-05-16 17:43:00,853::task::579::TaskManager.Task::(_updateState) Task=`a401fe4a-5bb9-4231-9c11-d62abce96294`::moving from state init -> state preparing >Thread-54484::INFO::2014-05-16 17:43:00,853::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54484::INFO::2014-05-16 17:43:00,854::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54484::DEBUG::2014-05-16 17:43:00,854::task::1168::TaskManager.Task::(prepare) Task=`a401fe4a-5bb9-4231-9c11-d62abce96294`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54484::DEBUG::2014-05-16 17:43:00,854::task::579::TaskManager.Task::(_updateState) Task=`a401fe4a-5bb9-4231-9c11-d62abce96294`::moving from state preparing -> state finished >Thread-54484::DEBUG::2014-05-16 17:43:00,854::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54484::DEBUG::2014-05-16 17:43:00,854::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54484::DEBUG::2014-05-16 17:43:00,854::task::974::TaskManager.Task::(_decref) Task=`a401fe4a-5bb9-4231-9c11-d62abce96294`::ref 0 aborting False >Thread-54485::DEBUG::2014-05-16 17:43:00,863::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54485::DEBUG::2014-05-16 17:43:00,864::task::579::TaskManager.Task::(_updateState) Task=`ddf31d54-6d24-41a1-b8ca-e79b5da8ac4f`::moving from state init -> state preparing >Thread-54485::INFO::2014-05-16 17:43:00,864::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54485::DEBUG::2014-05-16 17:43:00,864::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c6b360ad-d762-4e41-832f-26ac95cd986c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54485::DEBUG::2014-05-16 17:43:00,864::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54485::DEBUG::2014-05-16 17:43:00,865::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54485::DEBUG::2014-05-16 17:43:00,865::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c6b360ad-d762-4e41-832f-26ac95cd986c`::Granted request >Thread-54485::DEBUG::2014-05-16 17:43:00,865::task::811::TaskManager.Task::(resourceAcquired) Task=`ddf31d54-6d24-41a1-b8ca-e79b5da8ac4f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54485::DEBUG::2014-05-16 17:43:00,865::task::974::TaskManager.Task::(_decref) Task=`ddf31d54-6d24-41a1-b8ca-e79b5da8ac4f`::ref 1 aborting False >Thread-54485::INFO::2014-05-16 17:43:00,866::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54485::DEBUG::2014-05-16 17:43:00,866::task::1168::TaskManager.Task::(prepare) Task=`ddf31d54-6d24-41a1-b8ca-e79b5da8ac4f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54485::DEBUG::2014-05-16 17:43:00,866::task::579::TaskManager.Task::(_updateState) Task=`ddf31d54-6d24-41a1-b8ca-e79b5da8ac4f`::moving from state preparing -> state finished >Thread-54485::DEBUG::2014-05-16 17:43:00,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54485::DEBUG::2014-05-16 17:43:00,867::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54485::DEBUG::2014-05-16 17:43:00,867::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54485::DEBUG::2014-05-16 17:43:00,867::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54485::DEBUG::2014-05-16 17:43:00,867::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54485::DEBUG::2014-05-16 17:43:00,867::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54485::DEBUG::2014-05-16 17:43:00,867::task::974::TaskManager.Task::(_decref) Task=`ddf31d54-6d24-41a1-b8ca-e79b5da8ac4f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:43:01,645::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:01,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354348 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:03,728::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:03,800::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349115 s, 29.3 MB/s\n'; <rc> = 0 >Thread-54487::DEBUG::2014-05-16 17:43:05,361::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315601.000000 / 8.008657 / 262500000.000000 = 0.205283 >Thread-54487::DEBUG::2014-05-16 17:43:05,361::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053981585321336454, 'statsAge': 1.531494140625, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20528266856503555, 'rxDropped': 0} >Thread-54487::DEBUG::2014-05-16 17:43:05,361::task::579::TaskManager.Task::(_updateState) Task=`49e69c04-9ea2-4b7e-9dc2-ec2eafd2f202`::moving from state init -> state preparing >Thread-54487::INFO::2014-05-16 17:43:05,361::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54487::INFO::2014-05-16 17:43:05,362::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806426', 'lastCheck': '7.3', 'valid': True}} >Thread-54487::DEBUG::2014-05-16 17:43:05,362::task::1168::TaskManager.Task::(prepare) Task=`49e69c04-9ea2-4b7e-9dc2-ec2eafd2f202`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806426', 'lastCheck': '7.3', 'valid': True}} >Thread-54487::DEBUG::2014-05-16 17:43:05,362::task::579::TaskManager.Task::(_updateState) Task=`49e69c04-9ea2-4b7e-9dc2-ec2eafd2f202`::moving from state preparing -> state finished >Thread-54487::DEBUG::2014-05-16 17:43:05,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54487::DEBUG::2014-05-16 17:43:05,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54487::DEBUG::2014-05-16 17:43:05,362::task::974::TaskManager.Task::(_decref) Task=`49e69c04-9ea2-4b7e-9dc2-ec2eafd2f202`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:43:05,812::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:05,880::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328056 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:07,892::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:07,963::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351767 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:43:08,058::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:43:08,069::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000829717 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:09,972::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:10,049::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377974 s, 27.1 MB/s\n'; <rc> = 0 >Thread-54490::DEBUG::2014-05-16 17:43:11,029::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54490::DEBUG::2014-05-16 17:43:11,030::task::579::TaskManager.Task::(_updateState) Task=`93ae850b-2de3-4d41-b293-b798ff70be22`::moving from state init -> state preparing >Thread-54490::INFO::2014-05-16 17:43:11,030::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54490::INFO::2014-05-16 17:43:11,030::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54490::DEBUG::2014-05-16 17:43:11,030::task::1168::TaskManager.Task::(prepare) Task=`93ae850b-2de3-4d41-b293-b798ff70be22`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54490::DEBUG::2014-05-16 17:43:11,031::task::579::TaskManager.Task::(_updateState) Task=`93ae850b-2de3-4d41-b293-b798ff70be22`::moving from state preparing -> state finished >Thread-54490::DEBUG::2014-05-16 17:43:11,031::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54490::DEBUG::2014-05-16 17:43:11,031::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54490::DEBUG::2014-05-16 17:43:11,031::task::974::TaskManager.Task::(_decref) Task=`93ae850b-2de3-4d41-b293-b798ff70be22`::ref 0 aborting False >Thread-54491::DEBUG::2014-05-16 17:43:11,041::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54491::DEBUG::2014-05-16 17:43:11,041::task::579::TaskManager.Task::(_updateState) Task=`34e876d5-e7fc-42cc-9928-c51cf421e78f`::moving from state init -> state preparing >Thread-54491::INFO::2014-05-16 17:43:11,041::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54491::DEBUG::2014-05-16 17:43:11,041::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d63a51df-2ebc-49de-a6d1-860ec364a467`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54491::DEBUG::2014-05-16 17:43:11,041::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54491::DEBUG::2014-05-16 17:43:11,042::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54491::DEBUG::2014-05-16 17:43:11,042::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d63a51df-2ebc-49de-a6d1-860ec364a467`::Granted request >Thread-54491::DEBUG::2014-05-16 17:43:11,042::task::811::TaskManager.Task::(resourceAcquired) Task=`34e876d5-e7fc-42cc-9928-c51cf421e78f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54491::DEBUG::2014-05-16 17:43:11,042::task::974::TaskManager.Task::(_decref) Task=`34e876d5-e7fc-42cc-9928-c51cf421e78f`::ref 1 aborting False >Thread-54491::INFO::2014-05-16 17:43:11,043::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54491::DEBUG::2014-05-16 17:43:11,043::task::1168::TaskManager.Task::(prepare) Task=`34e876d5-e7fc-42cc-9928-c51cf421e78f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54491::DEBUG::2014-05-16 17:43:11,043::task::579::TaskManager.Task::(_updateState) Task=`34e876d5-e7fc-42cc-9928-c51cf421e78f`::moving from state preparing -> state finished >Thread-54491::DEBUG::2014-05-16 17:43:11,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54491::DEBUG::2014-05-16 17:43:11,043::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54491::DEBUG::2014-05-16 17:43:11,044::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54491::DEBUG::2014-05-16 17:43:11,044::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54491::DEBUG::2014-05-16 17:43:11,044::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54491::DEBUG::2014-05-16 17:43:11,044::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54491::DEBUG::2014-05-16 17:43:11,044::task::974::TaskManager.Task::(_decref) Task=`34e876d5-e7fc-42cc-9928-c51cf421e78f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:43:12,061::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:12,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361468 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:14,146::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:14,212::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303073 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:16,224::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:16,295::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353695 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:43:18,105::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:43:18,115::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990659 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:18,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:18,378::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348952 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:20,389::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:20,457::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316204 s, 32.4 MB/s\n'; <rc> = 0 >Thread-54495::DEBUG::2014-05-16 17:43:20,506::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4311463.000000 / 8.008359 / 262500000.000000 = 0.205093 >Thread-54495::DEBUG::2014-05-16 17:43:20,506::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0050140942595579196, 'statsAge': 0.65924310684204102, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20509346601328546, 'rxDropped': 0} >Thread-54495::DEBUG::2014-05-16 17:43:20,507::task::579::TaskManager.Task::(_updateState) Task=`060791eb-0641-44d9-a61e-1f20f2e3d0fd`::moving from state init -> state preparing >Thread-54495::INFO::2014-05-16 17:43:20,507::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54495::INFO::2014-05-16 17:43:20,507::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000990659', 'lastCheck': '2.4', 'valid': True}} >Thread-54495::DEBUG::2014-05-16 17:43:20,507::task::1168::TaskManager.Task::(prepare) Task=`060791eb-0641-44d9-a61e-1f20f2e3d0fd`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000990659', 'lastCheck': '2.4', 'valid': True}} >Thread-54495::DEBUG::2014-05-16 17:43:20,508::task::579::TaskManager.Task::(_updateState) Task=`060791eb-0641-44d9-a61e-1f20f2e3d0fd`::moving from state preparing -> state finished >Thread-54495::DEBUG::2014-05-16 17:43:20,508::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54495::DEBUG::2014-05-16 17:43:20,508::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54495::DEBUG::2014-05-16 17:43:20,508::task::974::TaskManager.Task::(_decref) Task=`060791eb-0641-44d9-a61e-1f20f2e3d0fd`::ref 0 aborting False >Thread-54497::DEBUG::2014-05-16 17:43:21,103::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54497::DEBUG::2014-05-16 17:43:21,103::task::579::TaskManager.Task::(_updateState) Task=`f8e62aa4-f338-4292-a515-774c4dac80eb`::moving from state init -> state preparing >Thread-54497::INFO::2014-05-16 17:43:21,103::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54497::INFO::2014-05-16 17:43:21,104::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54497::DEBUG::2014-05-16 17:43:21,104::task::1168::TaskManager.Task::(prepare) Task=`f8e62aa4-f338-4292-a515-774c4dac80eb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54497::DEBUG::2014-05-16 17:43:21,104::task::579::TaskManager.Task::(_updateState) Task=`f8e62aa4-f338-4292-a515-774c4dac80eb`::moving from state preparing -> state finished >Thread-54497::DEBUG::2014-05-16 17:43:21,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54497::DEBUG::2014-05-16 17:43:21,104::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54497::DEBUG::2014-05-16 17:43:21,104::task::974::TaskManager.Task::(_decref) Task=`f8e62aa4-f338-4292-a515-774c4dac80eb`::ref 0 aborting False >Thread-54498::DEBUG::2014-05-16 17:43:21,113::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54498::DEBUG::2014-05-16 17:43:21,113::task::579::TaskManager.Task::(_updateState) Task=`84dc9d77-fe9c-4a9e-a0ac-745a862dcdfa`::moving from state init -> state preparing >Thread-54498::INFO::2014-05-16 17:43:21,113::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54498::DEBUG::2014-05-16 17:43:21,114::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a191930b-3d45-4c77-9d20-1bef8d3a508e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54498::DEBUG::2014-05-16 17:43:21,114::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54498::DEBUG::2014-05-16 17:43:21,114::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54498::DEBUG::2014-05-16 17:43:21,114::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a191930b-3d45-4c77-9d20-1bef8d3a508e`::Granted request >Thread-54498::DEBUG::2014-05-16 17:43:21,115::task::811::TaskManager.Task::(resourceAcquired) Task=`84dc9d77-fe9c-4a9e-a0ac-745a862dcdfa`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54498::DEBUG::2014-05-16 17:43:21,115::task::974::TaskManager.Task::(_decref) Task=`84dc9d77-fe9c-4a9e-a0ac-745a862dcdfa`::ref 1 aborting False >Thread-54498::INFO::2014-05-16 17:43:21,115::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54498::DEBUG::2014-05-16 17:43:21,116::task::1168::TaskManager.Task::(prepare) Task=`84dc9d77-fe9c-4a9e-a0ac-745a862dcdfa`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54498::DEBUG::2014-05-16 17:43:21,116::task::579::TaskManager.Task::(_updateState) Task=`84dc9d77-fe9c-4a9e-a0ac-745a862dcdfa`::moving from state preparing -> state finished >Thread-54498::DEBUG::2014-05-16 17:43:21,116::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54498::DEBUG::2014-05-16 17:43:21,116::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54498::DEBUG::2014-05-16 17:43:21,116::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54498::DEBUG::2014-05-16 17:43:21,117::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54498::DEBUG::2014-05-16 17:43:21,117::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54498::DEBUG::2014-05-16 17:43:21,117::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54498::DEBUG::2014-05-16 17:43:21,117::task::974::TaskManager.Task::(_decref) Task=`84dc9d77-fe9c-4a9e-a0ac-745a862dcdfa`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:43:22,469::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:22,540::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359452 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:24,552::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:24,620::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312798 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:26,632::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:26,699::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309333 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:43:28,153::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:43:28,163::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000992875 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:28,711::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:28,783::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365814 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:30,795::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:30,863::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315288 s, 32.5 MB/s\n'; <rc> = 0 >Thread-54502::DEBUG::2014-05-16 17:43:31,158::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54502::DEBUG::2014-05-16 17:43:31,159::task::579::TaskManager.Task::(_updateState) Task=`9209933f-e9ec-4bda-82f6-fbbdae0528ce`::moving from state init -> state preparing >Thread-54502::INFO::2014-05-16 17:43:31,159::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54502::INFO::2014-05-16 17:43:31,159::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54502::DEBUG::2014-05-16 17:43:31,159::task::1168::TaskManager.Task::(prepare) Task=`9209933f-e9ec-4bda-82f6-fbbdae0528ce`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54502::DEBUG::2014-05-16 17:43:31,160::task::579::TaskManager.Task::(_updateState) Task=`9209933f-e9ec-4bda-82f6-fbbdae0528ce`::moving from state preparing -> state finished >Thread-54502::DEBUG::2014-05-16 17:43:31,160::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54502::DEBUG::2014-05-16 17:43:31,160::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54502::DEBUG::2014-05-16 17:43:31,160::task::974::TaskManager.Task::(_decref) Task=`9209933f-e9ec-4bda-82f6-fbbdae0528ce`::ref 0 aborting False >Thread-54503::DEBUG::2014-05-16 17:43:31,168::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54503::DEBUG::2014-05-16 17:43:31,168::task::579::TaskManager.Task::(_updateState) Task=`5d339975-e5d8-4cef-9579-4c1f9e633dc0`::moving from state init -> state preparing >Thread-54503::INFO::2014-05-16 17:43:31,169::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54503::DEBUG::2014-05-16 17:43:31,169::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`75d50ebc-a8c8-4df9-8953-9991f67e0fc3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54503::DEBUG::2014-05-16 17:43:31,169::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54503::DEBUG::2014-05-16 17:43:31,169::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54503::DEBUG::2014-05-16 17:43:31,170::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`75d50ebc-a8c8-4df9-8953-9991f67e0fc3`::Granted request >Thread-54503::DEBUG::2014-05-16 17:43:31,170::task::811::TaskManager.Task::(resourceAcquired) Task=`5d339975-e5d8-4cef-9579-4c1f9e633dc0`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54503::DEBUG::2014-05-16 17:43:31,170::task::974::TaskManager.Task::(_decref) Task=`5d339975-e5d8-4cef-9579-4c1f9e633dc0`::ref 1 aborting False >Thread-54503::INFO::2014-05-16 17:43:31,171::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54503::DEBUG::2014-05-16 17:43:31,171::task::1168::TaskManager.Task::(prepare) Task=`5d339975-e5d8-4cef-9579-4c1f9e633dc0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54503::DEBUG::2014-05-16 17:43:31,171::task::579::TaskManager.Task::(_updateState) Task=`5d339975-e5d8-4cef-9579-4c1f9e633dc0`::moving from state preparing -> state finished >Thread-54503::DEBUG::2014-05-16 17:43:31,171::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54503::DEBUG::2014-05-16 17:43:31,171::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54503::DEBUG::2014-05-16 17:43:31,172::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54503::DEBUG::2014-05-16 17:43:31,172::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54503::DEBUG::2014-05-16 17:43:31,172::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54503::DEBUG::2014-05-16 17:43:31,172::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54503::DEBUG::2014-05-16 17:43:31,172::task::974::TaskManager.Task::(_decref) Task=`5d339975-e5d8-4cef-9579-4c1f9e633dc0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:43:32,874::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:32,946::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352825 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:34,958::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:35,029::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035131 s, 29.1 MB/s\n'; <rc> = 0 >Thread-54505::DEBUG::2014-05-16 17:43:35,689::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314015.000000 / 8.008299 / 262500000.000000 = 0.205216 >Thread-54505::DEBUG::2014-05-16 17:43:35,690::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053861269371807338, 'statsAge': 1.8279690742492676, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20521640258334428, 'rxDropped': 0} >Thread-54505::DEBUG::2014-05-16 17:43:35,690::task::579::TaskManager.Task::(_updateState) Task=`71a01e3d-fb39-4b3c-a654-2c7cada15a99`::moving from state init -> state preparing >Thread-54505::INFO::2014-05-16 17:43:35,690::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54505::INFO::2014-05-16 17:43:35,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000992875', 'lastCheck': '7.5', 'valid': True}} >Thread-54505::DEBUG::2014-05-16 17:43:35,691::task::1168::TaskManager.Task::(prepare) Task=`71a01e3d-fb39-4b3c-a654-2c7cada15a99`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000992875', 'lastCheck': '7.5', 'valid': True}} >Thread-54505::DEBUG::2014-05-16 17:43:35,691::task::579::TaskManager.Task::(_updateState) Task=`71a01e3d-fb39-4b3c-a654-2c7cada15a99`::moving from state preparing -> state finished >Thread-54505::DEBUG::2014-05-16 17:43:35,691::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54505::DEBUG::2014-05-16 17:43:35,691::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54505::DEBUG::2014-05-16 17:43:35,691::task::974::TaskManager.Task::(_decref) Task=`71a01e3d-fb39-4b3c-a654-2c7cada15a99`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:43:37,041::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:37,112::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352075 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:43:38,198::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:43:38,208::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000689272 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:39,123::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:39,194::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351309 s, 29.1 MB/s\n'; <rc> = 0 >Thread-54508::DEBUG::2014-05-16 17:43:41,201::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54508::DEBUG::2014-05-16 17:43:41,201::task::579::TaskManager.Task::(_updateState) Task=`b050f7d6-1afc-41bc-97cc-f2d96f87e318`::moving from state init -> state preparing >Thread-54508::INFO::2014-05-16 17:43:41,201::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54508::INFO::2014-05-16 17:43:41,202::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54508::DEBUG::2014-05-16 17:43:41,202::task::1168::TaskManager.Task::(prepare) Task=`b050f7d6-1afc-41bc-97cc-f2d96f87e318`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54508::DEBUG::2014-05-16 17:43:41,202::task::579::TaskManager.Task::(_updateState) Task=`b050f7d6-1afc-41bc-97cc-f2d96f87e318`::moving from state preparing -> state finished >Thread-54508::DEBUG::2014-05-16 17:43:41,202::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54508::DEBUG::2014-05-16 17:43:41,202::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54508::DEBUG::2014-05-16 17:43:41,202::task::974::TaskManager.Task::(_decref) Task=`b050f7d6-1afc-41bc-97cc-f2d96f87e318`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:43:41,206::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54509::DEBUG::2014-05-16 17:43:41,219::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54509::DEBUG::2014-05-16 17:43:41,219::task::579::TaskManager.Task::(_updateState) Task=`aa9925cb-30a3-49db-943d-ce2f0775674b`::moving from state init -> state preparing >Thread-54509::INFO::2014-05-16 17:43:41,220::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54509::DEBUG::2014-05-16 17:43:41,220::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f75996c3-87df-4103-a63c-7afcc1d35745`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54509::DEBUG::2014-05-16 17:43:41,220::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54509::DEBUG::2014-05-16 17:43:41,220::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54509::DEBUG::2014-05-16 17:43:41,221::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f75996c3-87df-4103-a63c-7afcc1d35745`::Granted request >Thread-54509::DEBUG::2014-05-16 17:43:41,221::task::811::TaskManager.Task::(resourceAcquired) Task=`aa9925cb-30a3-49db-943d-ce2f0775674b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54509::DEBUG::2014-05-16 17:43:41,221::task::974::TaskManager.Task::(_decref) Task=`aa9925cb-30a3-49db-943d-ce2f0775674b`::ref 1 aborting False >Thread-54509::INFO::2014-05-16 17:43:41,222::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54509::DEBUG::2014-05-16 17:43:41,222::task::1168::TaskManager.Task::(prepare) Task=`aa9925cb-30a3-49db-943d-ce2f0775674b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54509::DEBUG::2014-05-16 17:43:41,222::task::579::TaskManager.Task::(_updateState) Task=`aa9925cb-30a3-49db-943d-ce2f0775674b`::moving from state preparing -> state finished >Thread-54509::DEBUG::2014-05-16 17:43:41,222::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54509::DEBUG::2014-05-16 17:43:41,222::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54509::DEBUG::2014-05-16 17:43:41,222::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54509::DEBUG::2014-05-16 17:43:41,223::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54509::DEBUG::2014-05-16 17:43:41,223::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54509::DEBUG::2014-05-16 17:43:41,223::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54509::DEBUG::2014-05-16 17:43:41,223::task::974::TaskManager.Task::(_decref) Task=`aa9925cb-30a3-49db-943d-ce2f0775674b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:43:41,275::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324239 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:43,286::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:43,358::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035487 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:45,370::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:45,437::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312842 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:47,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:47,520::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349081 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:43:48,245::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:43:48,255::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765596 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:49,532::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:49,602::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342014 s, 29.9 MB/s\n'; <rc> = 0 >Thread-54513::DEBUG::2014-05-16 17:43:50,844::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5410667.000000 / 8.008662 / 262500000.000000 = 0.257372 >Thread-54513::DEBUG::2014-05-16 17:43:50,844::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0064255189715384667, 'statsAge': 0.96568107604980469, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25737214030868005, 'rxDropped': 0} >Thread-54513::DEBUG::2014-05-16 17:43:50,845::task::579::TaskManager.Task::(_updateState) Task=`41cb5efd-64bf-458d-bb49-3fbe1d549ccb`::moving from state init -> state preparing >Thread-54513::INFO::2014-05-16 17:43:50,845::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54513::INFO::2014-05-16 17:43:50,845::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765596', 'lastCheck': '2.6', 'valid': True}} >Thread-54513::DEBUG::2014-05-16 17:43:50,845::task::1168::TaskManager.Task::(prepare) Task=`41cb5efd-64bf-458d-bb49-3fbe1d549ccb`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765596', 'lastCheck': '2.6', 'valid': True}} >Thread-54513::DEBUG::2014-05-16 17:43:50,846::task::579::TaskManager.Task::(_updateState) Task=`41cb5efd-64bf-458d-bb49-3fbe1d549ccb`::moving from state preparing -> state finished >Thread-54513::DEBUG::2014-05-16 17:43:50,846::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54513::DEBUG::2014-05-16 17:43:50,846::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54513::DEBUG::2014-05-16 17:43:50,846::task::974::TaskManager.Task::(_decref) Task=`41cb5efd-64bf-458d-bb49-3fbe1d549ccb`::ref 0 aborting False >Thread-54515::DEBUG::2014-05-16 17:43:51,276::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54515::DEBUG::2014-05-16 17:43:51,277::task::579::TaskManager.Task::(_updateState) Task=`ecf9c21b-ae0a-47b1-8766-870126c705de`::moving from state init -> state preparing >Thread-54515::INFO::2014-05-16 17:43:51,277::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54515::INFO::2014-05-16 17:43:51,277::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54515::DEBUG::2014-05-16 17:43:51,277::task::1168::TaskManager.Task::(prepare) Task=`ecf9c21b-ae0a-47b1-8766-870126c705de`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54515::DEBUG::2014-05-16 17:43:51,277::task::579::TaskManager.Task::(_updateState) Task=`ecf9c21b-ae0a-47b1-8766-870126c705de`::moving from state preparing -> state finished >Thread-54515::DEBUG::2014-05-16 17:43:51,277::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54515::DEBUG::2014-05-16 17:43:51,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54515::DEBUG::2014-05-16 17:43:51,278::task::974::TaskManager.Task::(_decref) Task=`ecf9c21b-ae0a-47b1-8766-870126c705de`::ref 0 aborting False >Thread-54516::DEBUG::2014-05-16 17:43:51,286::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54516::DEBUG::2014-05-16 17:43:51,286::task::579::TaskManager.Task::(_updateState) Task=`72c7b2db-4c55-4924-ab91-13d370de0e24`::moving from state init -> state preparing >Thread-54516::INFO::2014-05-16 17:43:51,287::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54516::DEBUG::2014-05-16 17:43:51,287::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d0f1173c-81aa-4348-b287-579754d60b6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54516::DEBUG::2014-05-16 17:43:51,287::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54516::DEBUG::2014-05-16 17:43:51,287::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54516::DEBUG::2014-05-16 17:43:51,287::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d0f1173c-81aa-4348-b287-579754d60b6c`::Granted request >Thread-54516::DEBUG::2014-05-16 17:43:51,288::task::811::TaskManager.Task::(resourceAcquired) Task=`72c7b2db-4c55-4924-ab91-13d370de0e24`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54516::DEBUG::2014-05-16 17:43:51,288::task::974::TaskManager.Task::(_decref) Task=`72c7b2db-4c55-4924-ab91-13d370de0e24`::ref 1 aborting False >Thread-54516::INFO::2014-05-16 17:43:51,288::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54516::DEBUG::2014-05-16 17:43:51,288::task::1168::TaskManager.Task::(prepare) Task=`72c7b2db-4c55-4924-ab91-13d370de0e24`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54516::DEBUG::2014-05-16 17:43:51,289::task::579::TaskManager.Task::(_updateState) Task=`72c7b2db-4c55-4924-ab91-13d370de0e24`::moving from state preparing -> state finished >Thread-54516::DEBUG::2014-05-16 17:43:51,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54516::DEBUG::2014-05-16 17:43:51,289::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54516::DEBUG::2014-05-16 17:43:51,289::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54516::DEBUG::2014-05-16 17:43:51,289::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54516::DEBUG::2014-05-16 17:43:51,289::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54516::DEBUG::2014-05-16 17:43:51,289::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54516::DEBUG::2014-05-16 17:43:51,290::task::974::TaskManager.Task::(_decref) Task=`72c7b2db-4c55-4924-ab91-13d370de0e24`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:43:51,613::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:51,680::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310547 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:53,692::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:53,759::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304853 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:55,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:55,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362328 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:57,857::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:43:57,932::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0393515 s, 26.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:43:58,293::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:43:58,303::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000763267 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:43:59,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:00,013::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345375 s, 29.6 MB/s\n'; <rc> = 0 >Thread-54520::DEBUG::2014-05-16 17:44:01,362::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54520::DEBUG::2014-05-16 17:44:01,363::task::579::TaskManager.Task::(_updateState) Task=`3b24de5d-e5a8-41e2-b3a8-ea6cf6c31ad0`::moving from state init -> state preparing >Thread-54520::INFO::2014-05-16 17:44:01,363::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54520::INFO::2014-05-16 17:44:01,363::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54520::DEBUG::2014-05-16 17:44:01,364::task::1168::TaskManager.Task::(prepare) Task=`3b24de5d-e5a8-41e2-b3a8-ea6cf6c31ad0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54520::DEBUG::2014-05-16 17:44:01,364::task::579::TaskManager.Task::(_updateState) Task=`3b24de5d-e5a8-41e2-b3a8-ea6cf6c31ad0`::moving from state preparing -> state finished >Thread-54520::DEBUG::2014-05-16 17:44:01,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54520::DEBUG::2014-05-16 17:44:01,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54520::DEBUG::2014-05-16 17:44:01,364::task::974::TaskManager.Task::(_decref) Task=`3b24de5d-e5a8-41e2-b3a8-ea6cf6c31ad0`::ref 0 aborting False >Thread-54521::DEBUG::2014-05-16 17:44:01,372::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54521::DEBUG::2014-05-16 17:44:01,373::task::579::TaskManager.Task::(_updateState) Task=`d05cadb2-a614-46dd-8639-e71e9f624f49`::moving from state init -> state preparing >Thread-54521::INFO::2014-05-16 17:44:01,373::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54521::DEBUG::2014-05-16 17:44:01,373::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f2c6566e-f727-4c17-9960-aeb472188b82`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54521::DEBUG::2014-05-16 17:44:01,373::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54521::DEBUG::2014-05-16 17:44:01,374::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54521::DEBUG::2014-05-16 17:44:01,374::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f2c6566e-f727-4c17-9960-aeb472188b82`::Granted request >Thread-54521::DEBUG::2014-05-16 17:44:01,374::task::811::TaskManager.Task::(resourceAcquired) Task=`d05cadb2-a614-46dd-8639-e71e9f624f49`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54521::DEBUG::2014-05-16 17:44:01,374::task::974::TaskManager.Task::(_decref) Task=`d05cadb2-a614-46dd-8639-e71e9f624f49`::ref 1 aborting False >Thread-54521::INFO::2014-05-16 17:44:01,375::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54521::DEBUG::2014-05-16 17:44:01,375::task::1168::TaskManager.Task::(prepare) Task=`d05cadb2-a614-46dd-8639-e71e9f624f49`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54521::DEBUG::2014-05-16 17:44:01,375::task::579::TaskManager.Task::(_updateState) Task=`d05cadb2-a614-46dd-8639-e71e9f624f49`::moving from state preparing -> state finished >Thread-54521::DEBUG::2014-05-16 17:44:01,375::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54521::DEBUG::2014-05-16 17:44:01,375::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54521::DEBUG::2014-05-16 17:44:01,376::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54521::DEBUG::2014-05-16 17:44:01,376::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54521::DEBUG::2014-05-16 17:44:01,376::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54521::DEBUG::2014-05-16 17:44:01,376::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54521::DEBUG::2014-05-16 17:44:01,376::task::974::TaskManager.Task::(_decref) Task=`d05cadb2-a614-46dd-8639-e71e9f624f49`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:44:02,025::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:02,092::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031456 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:04,104::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:04,174::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343977 s, 29.8 MB/s\n'; <rc> = 0 >Thread-54523::DEBUG::2014-05-16 17:44:06,010::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315790.000000 / 8.010995 / 262500000.000000 = 0.205232 >Thread-54523::DEBUG::2014-05-16 17:44:06,010::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005314029922448487, 'statsAge': 0.1121821403503418, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20523174642055297, 'rxDropped': 0} >Thread-54523::DEBUG::2014-05-16 17:44:06,011::task::579::TaskManager.Task::(_updateState) Task=`ad0df817-cae8-4a72-970f-3e44e1373289`::moving from state init -> state preparing >Thread-54523::INFO::2014-05-16 17:44:06,011::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54523::INFO::2014-05-16 17:44:06,011::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000763267', 'lastCheck': '7.7', 'valid': True}} >Thread-54523::DEBUG::2014-05-16 17:44:06,011::task::1168::TaskManager.Task::(prepare) Task=`ad0df817-cae8-4a72-970f-3e44e1373289`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000763267', 'lastCheck': '7.7', 'valid': True}} >Thread-54523::DEBUG::2014-05-16 17:44:06,012::task::579::TaskManager.Task::(_updateState) Task=`ad0df817-cae8-4a72-970f-3e44e1373289`::moving from state preparing -> state finished >Thread-54523::DEBUG::2014-05-16 17:44:06,012::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54523::DEBUG::2014-05-16 17:44:06,012::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54523::DEBUG::2014-05-16 17:44:06,012::task::974::TaskManager.Task::(_decref) Task=`ad0df817-cae8-4a72-970f-3e44e1373289`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:44:06,186::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:06,253::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03156 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:08,265::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:08,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03186 s, 32.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:44:08,462::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:44:08,485::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647138 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:10,578::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:10,651::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361252 s, 28.3 MB/s\n'; <rc> = 0 >Thread-54526::DEBUG::2014-05-16 17:44:11,422::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54526::DEBUG::2014-05-16 17:44:11,422::task::579::TaskManager.Task::(_updateState) Task=`12771beb-7f83-46b9-9e52-363d4b4365b4`::moving from state init -> state preparing >Thread-54526::INFO::2014-05-16 17:44:11,422::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54526::INFO::2014-05-16 17:44:11,423::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54526::DEBUG::2014-05-16 17:44:11,423::task::1168::TaskManager.Task::(prepare) Task=`12771beb-7f83-46b9-9e52-363d4b4365b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54526::DEBUG::2014-05-16 17:44:11,423::task::579::TaskManager.Task::(_updateState) Task=`12771beb-7f83-46b9-9e52-363d4b4365b4`::moving from state preparing -> state finished >Thread-54526::DEBUG::2014-05-16 17:44:11,423::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54526::DEBUG::2014-05-16 17:44:11,423::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54526::DEBUG::2014-05-16 17:44:11,423::task::974::TaskManager.Task::(_decref) Task=`12771beb-7f83-46b9-9e52-363d4b4365b4`::ref 0 aborting False >Thread-54527::DEBUG::2014-05-16 17:44:11,431::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54527::DEBUG::2014-05-16 17:44:11,432::task::579::TaskManager.Task::(_updateState) Task=`459af7b5-4bd3-4342-81fd-a3c68851fd76`::moving from state init -> state preparing >Thread-54527::INFO::2014-05-16 17:44:11,432::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54527::DEBUG::2014-05-16 17:44:11,432::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d7ef8f61-1153-45fe-a266-71fa79f4bf2f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54527::DEBUG::2014-05-16 17:44:11,432::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54527::DEBUG::2014-05-16 17:44:11,433::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54527::DEBUG::2014-05-16 17:44:11,433::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d7ef8f61-1153-45fe-a266-71fa79f4bf2f`::Granted request >Thread-54527::DEBUG::2014-05-16 17:44:11,433::task::811::TaskManager.Task::(resourceAcquired) Task=`459af7b5-4bd3-4342-81fd-a3c68851fd76`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54527::DEBUG::2014-05-16 17:44:11,433::task::974::TaskManager.Task::(_decref) Task=`459af7b5-4bd3-4342-81fd-a3c68851fd76`::ref 1 aborting False >Thread-54527::INFO::2014-05-16 17:44:11,434::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54527::DEBUG::2014-05-16 17:44:11,434::task::1168::TaskManager.Task::(prepare) Task=`459af7b5-4bd3-4342-81fd-a3c68851fd76`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54527::DEBUG::2014-05-16 17:44:11,434::task::579::TaskManager.Task::(_updateState) Task=`459af7b5-4bd3-4342-81fd-a3c68851fd76`::moving from state preparing -> state finished >Thread-54527::DEBUG::2014-05-16 17:44:11,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54527::DEBUG::2014-05-16 17:44:11,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54527::DEBUG::2014-05-16 17:44:11,435::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54527::DEBUG::2014-05-16 17:44:11,435::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54527::DEBUG::2014-05-16 17:44:11,435::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54527::DEBUG::2014-05-16 17:44:11,435::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54527::DEBUG::2014-05-16 17:44:11,435::task::974::TaskManager.Task::(_decref) Task=`459af7b5-4bd3-4342-81fd-a3c68851fd76`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:44:12,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:12,733::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349543 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:14,745::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:14,812::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309968 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:16,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:16,896::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356955 s, 28.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:44:18,592::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:44:18,603::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010484 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:18,908::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:18,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354008 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:20,991::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:21,058::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313769 s, 32.6 MB/s\n'; <rc> = 0 >Thread-54531::DEBUG::2014-05-16 17:44:21,178::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319320.000000 / 8.008414 / 262500000.000000 = 0.205466 >Thread-54531::DEBUG::2014-05-16 17:44:21,179::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051389760150377514, 'statsAge': 1.2656171321868896, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20546580532872538, 'rxDropped': 0} >Thread-54531::DEBUG::2014-05-16 17:44:21,179::task::579::TaskManager.Task::(_updateState) Task=`acdeca98-e190-46c1-a256-1ed1ebc5ad90`::moving from state init -> state preparing >Thread-54531::INFO::2014-05-16 17:44:21,179::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54531::INFO::2014-05-16 17:44:21,180::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010484', 'lastCheck': '2.6', 'valid': True}} >Thread-54531::DEBUG::2014-05-16 17:44:21,180::task::1168::TaskManager.Task::(prepare) Task=`acdeca98-e190-46c1-a256-1ed1ebc5ad90`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010484', 'lastCheck': '2.6', 'valid': True}} >Thread-54531::DEBUG::2014-05-16 17:44:21,180::task::579::TaskManager.Task::(_updateState) Task=`acdeca98-e190-46c1-a256-1ed1ebc5ad90`::moving from state preparing -> state finished >Thread-54531::DEBUG::2014-05-16 17:44:21,180::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54531::DEBUG::2014-05-16 17:44:21,180::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54531::DEBUG::2014-05-16 17:44:21,180::task::974::TaskManager.Task::(_decref) Task=`acdeca98-e190-46c1-a256-1ed1ebc5ad90`::ref 0 aborting False >Thread-54533::DEBUG::2014-05-16 17:44:21,487::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54533::DEBUG::2014-05-16 17:44:21,487::task::579::TaskManager.Task::(_updateState) Task=`854d6e0a-25f1-40c9-8b92-65efb2c55f5e`::moving from state init -> state preparing >Thread-54533::INFO::2014-05-16 17:44:21,487::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54533::INFO::2014-05-16 17:44:21,488::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54533::DEBUG::2014-05-16 17:44:21,488::task::1168::TaskManager.Task::(prepare) Task=`854d6e0a-25f1-40c9-8b92-65efb2c55f5e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54533::DEBUG::2014-05-16 17:44:21,488::task::579::TaskManager.Task::(_updateState) Task=`854d6e0a-25f1-40c9-8b92-65efb2c55f5e`::moving from state preparing -> state finished >Thread-54533::DEBUG::2014-05-16 17:44:21,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54533::DEBUG::2014-05-16 17:44:21,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54533::DEBUG::2014-05-16 17:44:21,488::task::974::TaskManager.Task::(_decref) Task=`854d6e0a-25f1-40c9-8b92-65efb2c55f5e`::ref 0 aborting False >Thread-54534::DEBUG::2014-05-16 17:44:21,497::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54534::DEBUG::2014-05-16 17:44:21,498::task::579::TaskManager.Task::(_updateState) Task=`ce6784f1-e7de-45b1-8487-eecbdaae3013`::moving from state init -> state preparing >Thread-54534::INFO::2014-05-16 17:44:21,498::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54534::DEBUG::2014-05-16 17:44:21,498::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cda1c4d0-c544-4911-a021-d77106919760`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54534::DEBUG::2014-05-16 17:44:21,498::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54534::DEBUG::2014-05-16 17:44:21,499::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54534::DEBUG::2014-05-16 17:44:21,499::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cda1c4d0-c544-4911-a021-d77106919760`::Granted request >Thread-54534::DEBUG::2014-05-16 17:44:21,499::task::811::TaskManager.Task::(resourceAcquired) Task=`ce6784f1-e7de-45b1-8487-eecbdaae3013`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54534::DEBUG::2014-05-16 17:44:21,499::task::974::TaskManager.Task::(_decref) Task=`ce6784f1-e7de-45b1-8487-eecbdaae3013`::ref 1 aborting False >Thread-54534::INFO::2014-05-16 17:44:21,500::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54534::DEBUG::2014-05-16 17:44:21,500::task::1168::TaskManager.Task::(prepare) Task=`ce6784f1-e7de-45b1-8487-eecbdaae3013`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54534::DEBUG::2014-05-16 17:44:21,500::task::579::TaskManager.Task::(_updateState) Task=`ce6784f1-e7de-45b1-8487-eecbdaae3013`::moving from state preparing -> state finished >Thread-54534::DEBUG::2014-05-16 17:44:21,500::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54534::DEBUG::2014-05-16 17:44:21,501::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54534::DEBUG::2014-05-16 17:44:21,501::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54534::DEBUG::2014-05-16 17:44:21,501::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54534::DEBUG::2014-05-16 17:44:21,501::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54534::DEBUG::2014-05-16 17:44:21,501::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54534::DEBUG::2014-05-16 17:44:21,501::task::974::TaskManager.Task::(_decref) Task=`ce6784f1-e7de-45b1-8487-eecbdaae3013`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:44:23,070::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:23,139::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314673 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:25,151::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:25,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355311 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:27,234::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:27,301::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302289 s, 33.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:44:28,640::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:44:28,651::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100633 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:29,316::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:29,383::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307575 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:31,395::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:31,467::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356961 s, 28.7 MB/s\n'; <rc> = 0 >Thread-54538::DEBUG::2014-05-16 17:44:31,536::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54538::DEBUG::2014-05-16 17:44:31,537::task::579::TaskManager.Task::(_updateState) Task=`3e435195-c63a-49b9-921b-2e5df3b6200e`::moving from state init -> state preparing >Thread-54538::INFO::2014-05-16 17:44:31,537::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54538::INFO::2014-05-16 17:44:31,537::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54538::DEBUG::2014-05-16 17:44:31,537::task::1168::TaskManager.Task::(prepare) Task=`3e435195-c63a-49b9-921b-2e5df3b6200e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54538::DEBUG::2014-05-16 17:44:31,538::task::579::TaskManager.Task::(_updateState) Task=`3e435195-c63a-49b9-921b-2e5df3b6200e`::moving from state preparing -> state finished >Thread-54538::DEBUG::2014-05-16 17:44:31,538::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54538::DEBUG::2014-05-16 17:44:31,538::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54538::DEBUG::2014-05-16 17:44:31,538::task::974::TaskManager.Task::(_decref) Task=`3e435195-c63a-49b9-921b-2e5df3b6200e`::ref 0 aborting False >Thread-54539::DEBUG::2014-05-16 17:44:31,547::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54539::DEBUG::2014-05-16 17:44:31,547::task::579::TaskManager.Task::(_updateState) Task=`6a8c840c-926c-4200-af66-0d5c6642b3c7`::moving from state init -> state preparing >Thread-54539::INFO::2014-05-16 17:44:31,547::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54539::DEBUG::2014-05-16 17:44:31,548::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`72463f98-75ae-4222-a9e9-6ad4df9cb3e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54539::DEBUG::2014-05-16 17:44:31,548::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54539::DEBUG::2014-05-16 17:44:31,548::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54539::DEBUG::2014-05-16 17:44:31,548::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`72463f98-75ae-4222-a9e9-6ad4df9cb3e8`::Granted request >Thread-54539::DEBUG::2014-05-16 17:44:31,549::task::811::TaskManager.Task::(resourceAcquired) Task=`6a8c840c-926c-4200-af66-0d5c6642b3c7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54539::DEBUG::2014-05-16 17:44:31,549::task::974::TaskManager.Task::(_decref) Task=`6a8c840c-926c-4200-af66-0d5c6642b3c7`::ref 1 aborting False >Thread-54539::INFO::2014-05-16 17:44:31,549::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54539::DEBUG::2014-05-16 17:44:31,550::task::1168::TaskManager.Task::(prepare) Task=`6a8c840c-926c-4200-af66-0d5c6642b3c7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54539::DEBUG::2014-05-16 17:44:31,550::task::579::TaskManager.Task::(_updateState) Task=`6a8c840c-926c-4200-af66-0d5c6642b3c7`::moving from state preparing -> state finished >Thread-54539::DEBUG::2014-05-16 17:44:31,550::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54539::DEBUG::2014-05-16 17:44:31,550::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54539::DEBUG::2014-05-16 17:44:31,550::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54539::DEBUG::2014-05-16 17:44:31,550::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54539::DEBUG::2014-05-16 17:44:31,551::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54539::DEBUG::2014-05-16 17:44:31,551::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54539::DEBUG::2014-05-16 17:44:31,551::task::974::TaskManager.Task::(_decref) Task=`6a8c840c-926c-4200-af66-0d5c6642b3c7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:44:33,479::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:33,550::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351426 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:35,562::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:35,630::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031568 s, 32.4 MB/s\n'; <rc> = 0 >Thread-54541::DEBUG::2014-05-16 17:44:36,370::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316935.000000 / 8.008551 / 262500000.000000 = 0.205349 >Thread-54541::DEBUG::2014-05-16 17:44:36,370::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052767408536090613, 'statsAge': 0.44061017036437988, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20534884410776919, 'rxDropped': 0} >Thread-54541::DEBUG::2014-05-16 17:44:36,371::task::579::TaskManager.Task::(_updateState) Task=`5d9ede9c-e727-48f8-9ce8-9cf49cd9020c`::moving from state init -> state preparing >Thread-54541::INFO::2014-05-16 17:44:36,371::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54541::INFO::2014-05-16 17:44:36,371::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100633', 'lastCheck': '7.7', 'valid': True}} >Thread-54541::DEBUG::2014-05-16 17:44:36,372::task::1168::TaskManager.Task::(prepare) Task=`5d9ede9c-e727-48f8-9ce8-9cf49cd9020c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100633', 'lastCheck': '7.7', 'valid': True}} >Thread-54541::DEBUG::2014-05-16 17:44:36,372::task::579::TaskManager.Task::(_updateState) Task=`5d9ede9c-e727-48f8-9ce8-9cf49cd9020c`::moving from state preparing -> state finished >Thread-54541::DEBUG::2014-05-16 17:44:36,372::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54541::DEBUG::2014-05-16 17:44:36,372::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54541::DEBUG::2014-05-16 17:44:36,372::task::974::TaskManager.Task::(_decref) Task=`5d9ede9c-e727-48f8-9ce8-9cf49cd9020c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:44:37,641::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:37,712::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346505 s, 29.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:44:38,685::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:44:38,695::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000743498 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:39,724::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:39,795::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357438 s, 28.6 MB/s\n'; <rc> = 0 >Thread-54544::DEBUG::2014-05-16 17:44:41,614::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54544::DEBUG::2014-05-16 17:44:41,614::task::579::TaskManager.Task::(_updateState) Task=`e0dd8439-f086-4f4a-91c4-80a697c24f53`::moving from state init -> state preparing >Thread-54544::INFO::2014-05-16 17:44:41,614::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54544::INFO::2014-05-16 17:44:41,615::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54544::DEBUG::2014-05-16 17:44:41,615::task::1168::TaskManager.Task::(prepare) Task=`e0dd8439-f086-4f4a-91c4-80a697c24f53`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54544::DEBUG::2014-05-16 17:44:41,615::task::579::TaskManager.Task::(_updateState) Task=`e0dd8439-f086-4f4a-91c4-80a697c24f53`::moving from state preparing -> state finished >Thread-54544::DEBUG::2014-05-16 17:44:41,615::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54544::DEBUG::2014-05-16 17:44:41,615::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54544::DEBUG::2014-05-16 17:44:41,615::task::974::TaskManager.Task::(_decref) Task=`e0dd8439-f086-4f4a-91c4-80a697c24f53`::ref 0 aborting False >Thread-54545::DEBUG::2014-05-16 17:44:41,625::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54545::DEBUG::2014-05-16 17:44:41,625::task::579::TaskManager.Task::(_updateState) Task=`68489739-8d4a-4cde-8970-7f5d25a96ca6`::moving from state init -> state preparing >Thread-54545::INFO::2014-05-16 17:44:41,626::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54545::DEBUG::2014-05-16 17:44:41,626::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1e325055-d007-44e9-a74f-79306c6880eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54545::DEBUG::2014-05-16 17:44:41,626::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54545::DEBUG::2014-05-16 17:44:41,626::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54545::DEBUG::2014-05-16 17:44:41,626::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1e325055-d007-44e9-a74f-79306c6880eb`::Granted request >Thread-54545::DEBUG::2014-05-16 17:44:41,627::task::811::TaskManager.Task::(resourceAcquired) Task=`68489739-8d4a-4cde-8970-7f5d25a96ca6`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54545::DEBUG::2014-05-16 17:44:41,627::task::974::TaskManager.Task::(_decref) Task=`68489739-8d4a-4cde-8970-7f5d25a96ca6`::ref 1 aborting False >Thread-54545::INFO::2014-05-16 17:44:41,627::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54545::DEBUG::2014-05-16 17:44:41,627::task::1168::TaskManager.Task::(prepare) Task=`68489739-8d4a-4cde-8970-7f5d25a96ca6`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54545::DEBUG::2014-05-16 17:44:41,628::task::579::TaskManager.Task::(_updateState) Task=`68489739-8d4a-4cde-8970-7f5d25a96ca6`::moving from state preparing -> state finished >Thread-54545::DEBUG::2014-05-16 17:44:41,628::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54545::DEBUG::2014-05-16 17:44:41,628::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54545::DEBUG::2014-05-16 17:44:41,628::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54545::DEBUG::2014-05-16 17:44:41,628::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54545::DEBUG::2014-05-16 17:44:41,628::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54545::DEBUG::2014-05-16 17:44:41,628::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54545::DEBUG::2014-05-16 17:44:41,629::task::974::TaskManager.Task::(_decref) Task=`68489739-8d4a-4cde-8970-7f5d25a96ca6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:44:41,807::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:41,874::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311256 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:43,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:43,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351403 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:45,974::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:46,042::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318945 s, 32.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:48,054::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:48,124::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342387 s, 29.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:44:48,731::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:44:48,741::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741908 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:50,136::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:50,203::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313047 s, 32.7 MB/s\n'; <rc> = 0 >Thread-54549::DEBUG::2014-05-16 17:44:51,532::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5420565.000000 / 8.011312 / 262500000.000000 = 0.257758 >Thread-54549::DEBUG::2014-05-16 17:44:51,533::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065093671769519213, 'statsAge': 1.5848469734191895, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25775767325249754, 'rxDropped': 0} >Thread-54549::DEBUG::2014-05-16 17:44:51,534::task::579::TaskManager.Task::(_updateState) Task=`7eb2d0c8-0a8b-49ae-9c35-28587ba58cf3`::moving from state init -> state preparing >Thread-54549::INFO::2014-05-16 17:44:51,534::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54549::INFO::2014-05-16 17:44:51,534::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741908', 'lastCheck': '2.8', 'valid': True}} >Thread-54549::DEBUG::2014-05-16 17:44:51,535::task::1168::TaskManager.Task::(prepare) Task=`7eb2d0c8-0a8b-49ae-9c35-28587ba58cf3`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741908', 'lastCheck': '2.8', 'valid': True}} >Thread-54549::DEBUG::2014-05-16 17:44:51,535::task::579::TaskManager.Task::(_updateState) Task=`7eb2d0c8-0a8b-49ae-9c35-28587ba58cf3`::moving from state preparing -> state finished >Thread-54549::DEBUG::2014-05-16 17:44:51,535::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54549::DEBUG::2014-05-16 17:44:51,535::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54549::DEBUG::2014-05-16 17:44:51,535::task::974::TaskManager.Task::(_decref) Task=`7eb2d0c8-0a8b-49ae-9c35-28587ba58cf3`::ref 0 aborting False >Thread-54551::DEBUG::2014-05-16 17:44:51,664::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54551::DEBUG::2014-05-16 17:44:51,664::task::579::TaskManager.Task::(_updateState) Task=`60c86ebd-20c5-40b4-928f-b01972fd760e`::moving from state init -> state preparing >Thread-54551::INFO::2014-05-16 17:44:51,664::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54551::INFO::2014-05-16 17:44:51,665::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54551::DEBUG::2014-05-16 17:44:51,665::task::1168::TaskManager.Task::(prepare) Task=`60c86ebd-20c5-40b4-928f-b01972fd760e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54551::DEBUG::2014-05-16 17:44:51,665::task::579::TaskManager.Task::(_updateState) Task=`60c86ebd-20c5-40b4-928f-b01972fd760e`::moving from state preparing -> state finished >Thread-54551::DEBUG::2014-05-16 17:44:51,665::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54551::DEBUG::2014-05-16 17:44:51,665::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54551::DEBUG::2014-05-16 17:44:51,666::task::974::TaskManager.Task::(_decref) Task=`60c86ebd-20c5-40b4-928f-b01972fd760e`::ref 0 aborting False >Thread-54552::DEBUG::2014-05-16 17:44:51,674::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54552::DEBUG::2014-05-16 17:44:51,674::task::579::TaskManager.Task::(_updateState) Task=`40db2d83-6d08-459a-859c-714a6d6e060b`::moving from state init -> state preparing >Thread-54552::INFO::2014-05-16 17:44:51,674::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54552::DEBUG::2014-05-16 17:44:51,675::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5fea9718-1bdc-4310-ada9-e765607f3a36`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54552::DEBUG::2014-05-16 17:44:51,675::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54552::DEBUG::2014-05-16 17:44:51,675::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54552::DEBUG::2014-05-16 17:44:51,675::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5fea9718-1bdc-4310-ada9-e765607f3a36`::Granted request >Thread-54552::DEBUG::2014-05-16 17:44:51,676::task::811::TaskManager.Task::(resourceAcquired) Task=`40db2d83-6d08-459a-859c-714a6d6e060b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54552::DEBUG::2014-05-16 17:44:51,676::task::974::TaskManager.Task::(_decref) Task=`40db2d83-6d08-459a-859c-714a6d6e060b`::ref 1 aborting False >Thread-54552::INFO::2014-05-16 17:44:51,676::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54552::DEBUG::2014-05-16 17:44:51,677::task::1168::TaskManager.Task::(prepare) Task=`40db2d83-6d08-459a-859c-714a6d6e060b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54552::DEBUG::2014-05-16 17:44:51,677::task::579::TaskManager.Task::(_updateState) Task=`40db2d83-6d08-459a-859c-714a6d6e060b`::moving from state preparing -> state finished >Thread-54552::DEBUG::2014-05-16 17:44:51,677::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54552::DEBUG::2014-05-16 17:44:51,677::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54552::DEBUG::2014-05-16 17:44:51,677::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54552::DEBUG::2014-05-16 17:44:51,678::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54552::DEBUG::2014-05-16 17:44:51,678::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54552::DEBUG::2014-05-16 17:44:51,678::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54552::DEBUG::2014-05-16 17:44:51,678::task::974::TaskManager.Task::(_decref) Task=`40db2d83-6d08-459a-859c-714a6d6e060b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:44:52,215::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:52,286::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350721 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:54,298::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:54,365::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308436 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:56,376::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:56,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311779 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:44:58,456::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:44:58,526::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347191 s, 29.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:44:58,779::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:44:58,789::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000787381 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:00,538::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:00,605::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311024 s, 32.9 MB/s\n'; <rc> = 0 >Thread-54556::DEBUG::2014-05-16 17:45:01,758::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54556::DEBUG::2014-05-16 17:45:01,758::task::579::TaskManager.Task::(_updateState) Task=`1b1abc8b-eeca-4f45-89ed-ed5c1ce31695`::moving from state init -> state preparing >Thread-54556::INFO::2014-05-16 17:45:01,759::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54556::INFO::2014-05-16 17:45:01,759::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54556::DEBUG::2014-05-16 17:45:01,759::task::1168::TaskManager.Task::(prepare) Task=`1b1abc8b-eeca-4f45-89ed-ed5c1ce31695`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54556::DEBUG::2014-05-16 17:45:01,759::task::579::TaskManager.Task::(_updateState) Task=`1b1abc8b-eeca-4f45-89ed-ed5c1ce31695`::moving from state preparing -> state finished >Thread-54556::DEBUG::2014-05-16 17:45:01,759::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54556::DEBUG::2014-05-16 17:45:01,760::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54556::DEBUG::2014-05-16 17:45:01,760::task::974::TaskManager.Task::(_decref) Task=`1b1abc8b-eeca-4f45-89ed-ed5c1ce31695`::ref 0 aborting False >Thread-54557::DEBUG::2014-05-16 17:45:01,768::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54557::DEBUG::2014-05-16 17:45:01,768::task::579::TaskManager.Task::(_updateState) Task=`89919049-5490-4cbd-9cf1-16088f2f8a95`::moving from state init -> state preparing >Thread-54557::INFO::2014-05-16 17:45:01,769::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54557::DEBUG::2014-05-16 17:45:01,769::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a780259a-0a0e-4ddf-ae26-82fe123031af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54557::DEBUG::2014-05-16 17:45:01,769::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54557::DEBUG::2014-05-16 17:45:01,769::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54557::DEBUG::2014-05-16 17:45:01,770::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a780259a-0a0e-4ddf-ae26-82fe123031af`::Granted request >Thread-54557::DEBUG::2014-05-16 17:45:01,770::task::811::TaskManager.Task::(resourceAcquired) Task=`89919049-5490-4cbd-9cf1-16088f2f8a95`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54557::DEBUG::2014-05-16 17:45:01,770::task::974::TaskManager.Task::(_decref) Task=`89919049-5490-4cbd-9cf1-16088f2f8a95`::ref 1 aborting False >Thread-54557::INFO::2014-05-16 17:45:01,771::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54557::DEBUG::2014-05-16 17:45:01,771::task::1168::TaskManager.Task::(prepare) Task=`89919049-5490-4cbd-9cf1-16088f2f8a95`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54557::DEBUG::2014-05-16 17:45:01,771::task::579::TaskManager.Task::(_updateState) Task=`89919049-5490-4cbd-9cf1-16088f2f8a95`::moving from state preparing -> state finished >Thread-54557::DEBUG::2014-05-16 17:45:01,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54557::DEBUG::2014-05-16 17:45:01,771::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54557::DEBUG::2014-05-16 17:45:01,772::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54557::DEBUG::2014-05-16 17:45:01,772::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54557::DEBUG::2014-05-16 17:45:01,772::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54557::DEBUG::2014-05-16 17:45:01,772::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54557::DEBUG::2014-05-16 17:45:01,772::task::974::TaskManager.Task::(_decref) Task=`89919049-5490-4cbd-9cf1-16088f2f8a95`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:45:02,617::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:02,689::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357147 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:04,701::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:04,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352579 s, 29.0 MB/s\n'; <rc> = 0 >Thread-54559::DEBUG::2014-05-16 17:45:06,682::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319841.000000 / 8.008122 / 262500000.000000 = 0.205498 >Thread-54559::DEBUG::2014-05-16 17:45:06,682::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053272581895544525, 'statsAge': 0.71808290481567383, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20549808319632001, 'rxDropped': 0} >Thread-54559::DEBUG::2014-05-16 17:45:06,683::task::579::TaskManager.Task::(_updateState) Task=`b51a3bec-4efa-4a5f-b23e-d87e9c83b0ef`::moving from state init -> state preparing >Thread-54559::INFO::2014-05-16 17:45:06,683::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54559::INFO::2014-05-16 17:45:06,683::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787381', 'lastCheck': '7.9', 'valid': True}} >Thread-54559::DEBUG::2014-05-16 17:45:06,683::task::1168::TaskManager.Task::(prepare) Task=`b51a3bec-4efa-4a5f-b23e-d87e9c83b0ef`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787381', 'lastCheck': '7.9', 'valid': True}} >Thread-54559::DEBUG::2014-05-16 17:45:06,683::task::579::TaskManager.Task::(_updateState) Task=`b51a3bec-4efa-4a5f-b23e-d87e9c83b0ef`::moving from state preparing -> state finished >Thread-54559::DEBUG::2014-05-16 17:45:06,683::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54559::DEBUG::2014-05-16 17:45:06,684::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54559::DEBUG::2014-05-16 17:45:06,684::task::974::TaskManager.Task::(_decref) Task=`b51a3bec-4efa-4a5f-b23e-d87e9c83b0ef`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:45:06,784::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:06,851::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03165 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:45:08,824::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:45:08,834::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597174 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:08,863::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:08,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346123 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:10,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:11,019::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360743 s, 28.4 MB/s\n'; <rc> = 0 >Thread-54562::DEBUG::2014-05-16 17:45:11,809::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54562::DEBUG::2014-05-16 17:45:11,809::task::579::TaskManager.Task::(_updateState) Task=`de9beecd-9ca6-4fc6-8c9f-0c98fa5ff774`::moving from state init -> state preparing >Thread-54562::INFO::2014-05-16 17:45:11,809::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54562::INFO::2014-05-16 17:45:11,810::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54562::DEBUG::2014-05-16 17:45:11,810::task::1168::TaskManager.Task::(prepare) Task=`de9beecd-9ca6-4fc6-8c9f-0c98fa5ff774`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54562::DEBUG::2014-05-16 17:45:11,810::task::579::TaskManager.Task::(_updateState) Task=`de9beecd-9ca6-4fc6-8c9f-0c98fa5ff774`::moving from state preparing -> state finished >Thread-54562::DEBUG::2014-05-16 17:45:11,810::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54562::DEBUG::2014-05-16 17:45:11,810::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54562::DEBUG::2014-05-16 17:45:11,810::task::974::TaskManager.Task::(_decref) Task=`de9beecd-9ca6-4fc6-8c9f-0c98fa5ff774`::ref 0 aborting False >Thread-54563::DEBUG::2014-05-16 17:45:11,819::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54563::DEBUG::2014-05-16 17:45:11,819::task::579::TaskManager.Task::(_updateState) Task=`1b206876-b87e-4aa8-abbe-4db35c0af714`::moving from state init -> state preparing >Thread-54563::INFO::2014-05-16 17:45:11,819::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54563::DEBUG::2014-05-16 17:45:11,820::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`34fda360-1d8a-45ec-9389-226a6e558513`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54563::DEBUG::2014-05-16 17:45:11,820::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54563::DEBUG::2014-05-16 17:45:11,820::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54563::DEBUG::2014-05-16 17:45:11,820::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`34fda360-1d8a-45ec-9389-226a6e558513`::Granted request >Thread-54563::DEBUG::2014-05-16 17:45:11,820::task::811::TaskManager.Task::(resourceAcquired) Task=`1b206876-b87e-4aa8-abbe-4db35c0af714`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54563::DEBUG::2014-05-16 17:45:11,821::task::974::TaskManager.Task::(_decref) Task=`1b206876-b87e-4aa8-abbe-4db35c0af714`::ref 1 aborting False >Thread-54563::INFO::2014-05-16 17:45:11,821::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54563::DEBUG::2014-05-16 17:45:11,821::task::1168::TaskManager.Task::(prepare) Task=`1b206876-b87e-4aa8-abbe-4db35c0af714`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54563::DEBUG::2014-05-16 17:45:11,821::task::579::TaskManager.Task::(_updateState) Task=`1b206876-b87e-4aa8-abbe-4db35c0af714`::moving from state preparing -> state finished >Thread-54563::DEBUG::2014-05-16 17:45:11,822::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54563::DEBUG::2014-05-16 17:45:11,822::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54563::DEBUG::2014-05-16 17:45:11,822::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54563::DEBUG::2014-05-16 17:45:11,822::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54563::DEBUG::2014-05-16 17:45:11,822::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54563::DEBUG::2014-05-16 17:45:11,822::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54563::DEBUG::2014-05-16 17:45:11,822::task::974::TaskManager.Task::(_decref) Task=`1b206876-b87e-4aa8-abbe-4db35c0af714`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:45:13,031::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:13,102::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348572 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:15,114::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:15,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304805 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:17,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:17,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313154 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:45:18,873::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:45:18,883::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000921883 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:19,272::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:19,344::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358098 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:21,356::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:21,422::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305987 s, 33.5 MB/s\n'; <rc> = 0 >Thread-54567::DEBUG::2014-05-16 17:45:21,818::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319884.000000 / 8.008461 / 262500000.000000 = 0.205491 >Thread-54567::DEBUG::2014-05-16 17:45:21,819::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053866838618478966, 'statsAge': 1.8399820327758789, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20549142906971865, 'rxDropped': 0} >Thread-54567::DEBUG::2014-05-16 17:45:21,819::task::579::TaskManager.Task::(_updateState) Task=`18a2597a-7dc0-452b-b1b5-d21311a084f4`::moving from state init -> state preparing >Thread-54567::INFO::2014-05-16 17:45:21,819::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54567::INFO::2014-05-16 17:45:21,820::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000921883', 'lastCheck': '2.9', 'valid': True}} >Thread-54567::DEBUG::2014-05-16 17:45:21,820::task::1168::TaskManager.Task::(prepare) Task=`18a2597a-7dc0-452b-b1b5-d21311a084f4`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000921883', 'lastCheck': '2.9', 'valid': True}} >Thread-54567::DEBUG::2014-05-16 17:45:21,820::task::579::TaskManager.Task::(_updateState) Task=`18a2597a-7dc0-452b-b1b5-d21311a084f4`::moving from state preparing -> state finished >Thread-54567::DEBUG::2014-05-16 17:45:21,820::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54567::DEBUG::2014-05-16 17:45:21,820::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54567::DEBUG::2014-05-16 17:45:21,820::task::974::TaskManager.Task::(_decref) Task=`18a2597a-7dc0-452b-b1b5-d21311a084f4`::ref 0 aborting False >Thread-54569::DEBUG::2014-05-16 17:45:21,879::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54569::DEBUG::2014-05-16 17:45:21,879::task::579::TaskManager.Task::(_updateState) Task=`45c3b13e-9389-4cea-b63e-328121f988f1`::moving from state init -> state preparing >Thread-54569::INFO::2014-05-16 17:45:21,879::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54569::INFO::2014-05-16 17:45:21,879::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54569::DEBUG::2014-05-16 17:45:21,879::task::1168::TaskManager.Task::(prepare) Task=`45c3b13e-9389-4cea-b63e-328121f988f1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54569::DEBUG::2014-05-16 17:45:21,880::task::579::TaskManager.Task::(_updateState) Task=`45c3b13e-9389-4cea-b63e-328121f988f1`::moving from state preparing -> state finished >Thread-54569::DEBUG::2014-05-16 17:45:21,880::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54569::DEBUG::2014-05-16 17:45:21,880::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54569::DEBUG::2014-05-16 17:45:21,880::task::974::TaskManager.Task::(_decref) Task=`45c3b13e-9389-4cea-b63e-328121f988f1`::ref 0 aborting False >Thread-54570::DEBUG::2014-05-16 17:45:21,889::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54570::DEBUG::2014-05-16 17:45:21,889::task::579::TaskManager.Task::(_updateState) Task=`a941bd43-d8e3-4814-b383-2c008f4c3f4f`::moving from state init -> state preparing >Thread-54570::INFO::2014-05-16 17:45:21,889::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54570::DEBUG::2014-05-16 17:45:21,890::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`80bc689f-4f5c-42bd-a7d3-4afaff3a5909`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54570::DEBUG::2014-05-16 17:45:21,890::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54570::DEBUG::2014-05-16 17:45:21,890::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54570::DEBUG::2014-05-16 17:45:21,890::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`80bc689f-4f5c-42bd-a7d3-4afaff3a5909`::Granted request >Thread-54570::DEBUG::2014-05-16 17:45:21,891::task::811::TaskManager.Task::(resourceAcquired) Task=`a941bd43-d8e3-4814-b383-2c008f4c3f4f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54570::DEBUG::2014-05-16 17:45:21,891::task::974::TaskManager.Task::(_decref) Task=`a941bd43-d8e3-4814-b383-2c008f4c3f4f`::ref 1 aborting False >Thread-54570::INFO::2014-05-16 17:45:21,891::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54570::DEBUG::2014-05-16 17:45:21,892::task::1168::TaskManager.Task::(prepare) Task=`a941bd43-d8e3-4814-b383-2c008f4c3f4f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54570::DEBUG::2014-05-16 17:45:21,892::task::579::TaskManager.Task::(_updateState) Task=`a941bd43-d8e3-4814-b383-2c008f4c3f4f`::moving from state preparing -> state finished >Thread-54570::DEBUG::2014-05-16 17:45:21,892::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54570::DEBUG::2014-05-16 17:45:21,892::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54570::DEBUG::2014-05-16 17:45:21,892::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54570::DEBUG::2014-05-16 17:45:21,893::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54570::DEBUG::2014-05-16 17:45:21,893::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54570::DEBUG::2014-05-16 17:45:21,893::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54570::DEBUG::2014-05-16 17:45:21,893::task::974::TaskManager.Task::(_decref) Task=`a941bd43-d8e3-4814-b383-2c008f4c3f4f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:45:23,434::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:23,626::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305281 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:25,647::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:25,719::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359253 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:27,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:27,802::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349996 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:45:28,920::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:45:28,930::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000606731 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:29,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:29,879::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300522 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:31,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54574::DEBUG::2014-05-16 17:45:31,925::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54574::DEBUG::2014-05-16 17:45:31,927::task::579::TaskManager.Task::(_updateState) Task=`793389b0-6c15-4d8f-a22f-eae1532ec3e2`::moving from state init -> state preparing >Thread-54574::INFO::2014-05-16 17:45:31,928::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54574::INFO::2014-05-16 17:45:31,929::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54574::DEBUG::2014-05-16 17:45:31,930::task::1168::TaskManager.Task::(prepare) Task=`793389b0-6c15-4d8f-a22f-eae1532ec3e2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54574::DEBUG::2014-05-16 17:45:31,931::task::579::TaskManager.Task::(_updateState) Task=`793389b0-6c15-4d8f-a22f-eae1532ec3e2`::moving from state preparing -> state finished >Thread-54574::DEBUG::2014-05-16 17:45:31,932::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54574::DEBUG::2014-05-16 17:45:31,933::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54574::DEBUG::2014-05-16 17:45:31,934::task::974::TaskManager.Task::(_decref) Task=`793389b0-6c15-4d8f-a22f-eae1532ec3e2`::ref 0 aborting False >Thread-54575::DEBUG::2014-05-16 17:45:31,946::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54575::DEBUG::2014-05-16 17:45:31,947::task::579::TaskManager.Task::(_updateState) Task=`5d2db0b0-8397-455e-9175-6c763bcb013e`::moving from state init -> state preparing >Thread-54575::INFO::2014-05-16 17:45:31,948::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54575::DEBUG::2014-05-16 17:45:31,950::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6bfec5dd-5e66-42b5-8556-4fafa3ea7b17`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54575::DEBUG::2014-05-16 17:45:31,951::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54575::DEBUG::2014-05-16 17:45:31,952::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54575::DEBUG::2014-05-16 17:45:31,953::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6bfec5dd-5e66-42b5-8556-4fafa3ea7b17`::Granted request >Thread-54575::DEBUG::2014-05-16 17:45:31,955::task::811::TaskManager.Task::(resourceAcquired) Task=`5d2db0b0-8397-455e-9175-6c763bcb013e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54575::DEBUG::2014-05-16 17:45:31,956::task::974::TaskManager.Task::(_decref) Task=`5d2db0b0-8397-455e-9175-6c763bcb013e`::ref 1 aborting False >Thread-54575::INFO::2014-05-16 17:45:31,959::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54575::DEBUG::2014-05-16 17:45:31,960::task::1168::TaskManager.Task::(prepare) Task=`5d2db0b0-8397-455e-9175-6c763bcb013e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54575::DEBUG::2014-05-16 17:45:31,961::task::579::TaskManager.Task::(_updateState) Task=`5d2db0b0-8397-455e-9175-6c763bcb013e`::moving from state preparing -> state finished >Thread-54575::DEBUG::2014-05-16 17:45:31,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54575::DEBUG::2014-05-16 17:45:31,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54575::DEBUG::2014-05-16 17:45:31,964::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54575::DEBUG::2014-05-16 17:45:31,965::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54575::DEBUG::2014-05-16 17:45:31,966::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54575::DEBUG::2014-05-16 17:45:31,967::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54575::DEBUG::2014-05-16 17:45:31,968::task::974::TaskManager.Task::(_decref) Task=`5d2db0b0-8397-455e-9175-6c763bcb013e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:45:32,008::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0741633 s, 13.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:34,020::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:34,090::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345236 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:36,102::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:36,170::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319861 s, 32.0 MB/s\n'; <rc> = 0 >Thread-54577::DEBUG::2014-05-16 17:45:36,996::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4343608.000000 / 8.010894 / 262500000.000000 = 0.206557 >Thread-54577::DEBUG::2014-05-16 17:45:36,997::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054395450396063933, 'statsAge': 0.99856400489807129, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20655719537700981, 'rxDropped': 0} >Thread-54577::DEBUG::2014-05-16 17:45:36,998::task::579::TaskManager.Task::(_updateState) Task=`63191126-7c3e-4d7b-a892-b44955d15bbf`::moving from state init -> state preparing >Thread-54577::INFO::2014-05-16 17:45:36,998::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54577::INFO::2014-05-16 17:45:36,998::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606731', 'lastCheck': '8.0', 'valid': True}} >Thread-54577::DEBUG::2014-05-16 17:45:36,999::task::1168::TaskManager.Task::(prepare) Task=`63191126-7c3e-4d7b-a892-b44955d15bbf`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606731', 'lastCheck': '8.0', 'valid': True}} >Thread-54577::DEBUG::2014-05-16 17:45:36,999::task::579::TaskManager.Task::(_updateState) Task=`63191126-7c3e-4d7b-a892-b44955d15bbf`::moving from state preparing -> state finished >Thread-54577::DEBUG::2014-05-16 17:45:36,999::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54577::DEBUG::2014-05-16 17:45:36,999::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54577::DEBUG::2014-05-16 17:45:36,999::task::974::TaskManager.Task::(_decref) Task=`63191126-7c3e-4d7b-a892-b44955d15bbf`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:45:38,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:38,249::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312762 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:45:38,968::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:45:38,978::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000813246 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:40,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:40,332::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353068 s, 29.0 MB/s\n'; <rc> = 0 >Thread-54580::DEBUG::2014-05-16 17:45:42,009::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54580::DEBUG::2014-05-16 17:45:42,009::task::579::TaskManager.Task::(_updateState) Task=`020a6ff8-a9e0-497a-89ec-8fc67dbaf654`::moving from state init -> state preparing >Thread-54580::INFO::2014-05-16 17:45:42,010::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54580::INFO::2014-05-16 17:45:42,010::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54580::DEBUG::2014-05-16 17:45:42,010::task::1168::TaskManager.Task::(prepare) Task=`020a6ff8-a9e0-497a-89ec-8fc67dbaf654`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54580::DEBUG::2014-05-16 17:45:42,010::task::579::TaskManager.Task::(_updateState) Task=`020a6ff8-a9e0-497a-89ec-8fc67dbaf654`::moving from state preparing -> state finished >Thread-54580::DEBUG::2014-05-16 17:45:42,010::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54580::DEBUG::2014-05-16 17:45:42,010::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54580::DEBUG::2014-05-16 17:45:42,010::task::974::TaskManager.Task::(_decref) Task=`020a6ff8-a9e0-497a-89ec-8fc67dbaf654`::ref 0 aborting False >Thread-54581::DEBUG::2014-05-16 17:45:42,020::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54581::DEBUG::2014-05-16 17:45:42,020::task::579::TaskManager.Task::(_updateState) Task=`fc0f5a81-f3bd-4bbe-b0f1-0d713cfa2903`::moving from state init -> state preparing >Thread-54581::INFO::2014-05-16 17:45:42,020::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54581::DEBUG::2014-05-16 17:45:42,020::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f7893318-a6ad-43f2-9456-61aa87266030`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54581::DEBUG::2014-05-16 17:45:42,020::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54581::DEBUG::2014-05-16 17:45:42,021::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54581::DEBUG::2014-05-16 17:45:42,021::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f7893318-a6ad-43f2-9456-61aa87266030`::Granted request >Thread-54581::DEBUG::2014-05-16 17:45:42,021::task::811::TaskManager.Task::(resourceAcquired) Task=`fc0f5a81-f3bd-4bbe-b0f1-0d713cfa2903`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54581::DEBUG::2014-05-16 17:45:42,021::task::974::TaskManager.Task::(_decref) Task=`fc0f5a81-f3bd-4bbe-b0f1-0d713cfa2903`::ref 1 aborting False >Thread-54581::INFO::2014-05-16 17:45:42,022::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54581::DEBUG::2014-05-16 17:45:42,022::task::1168::TaskManager.Task::(prepare) Task=`fc0f5a81-f3bd-4bbe-b0f1-0d713cfa2903`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54581::DEBUG::2014-05-16 17:45:42,022::task::579::TaskManager.Task::(_updateState) Task=`fc0f5a81-f3bd-4bbe-b0f1-0d713cfa2903`::moving from state preparing -> state finished >Thread-54581::DEBUG::2014-05-16 17:45:42,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54581::DEBUG::2014-05-16 17:45:42,022::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54581::DEBUG::2014-05-16 17:45:42,023::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54581::DEBUG::2014-05-16 17:45:42,023::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54581::DEBUG::2014-05-16 17:45:42,023::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54581::DEBUG::2014-05-16 17:45:42,023::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54581::DEBUG::2014-05-16 17:45:42,023::task::974::TaskManager.Task::(_decref) Task=`fc0f5a81-f3bd-4bbe-b0f1-0d713cfa2903`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:45:42,344::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:42,411::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031053 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:44,423::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:44,490::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314065 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:46,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:46,578::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040993 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:48,590::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:48,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355108 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:45:49,014::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:45:49,024::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0007879 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:50,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:50,742::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314501 s, 32.6 MB/s\n'; <rc> = 0 >Thread-54585::DEBUG::2014-05-16 17:45:52,081::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54585::DEBUG::2014-05-16 17:45:52,082::task::579::TaskManager.Task::(_updateState) Task=`8fc1a629-2358-4e3d-a4c8-3d9aa46676d8`::moving from state init -> state preparing >Thread-54585::INFO::2014-05-16 17:45:52,082::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54585::INFO::2014-05-16 17:45:52,082::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54585::DEBUG::2014-05-16 17:45:52,083::task::1168::TaskManager.Task::(prepare) Task=`8fc1a629-2358-4e3d-a4c8-3d9aa46676d8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54585::DEBUG::2014-05-16 17:45:52,083::task::579::TaskManager.Task::(_updateState) Task=`8fc1a629-2358-4e3d-a4c8-3d9aa46676d8`::moving from state preparing -> state finished >Thread-54585::DEBUG::2014-05-16 17:45:52,083::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54585::DEBUG::2014-05-16 17:45:52,083::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54585::DEBUG::2014-05-16 17:45:52,083::task::974::TaskManager.Task::(_decref) Task=`8fc1a629-2358-4e3d-a4c8-3d9aa46676d8`::ref 0 aborting False >Thread-54586::DEBUG::2014-05-16 17:45:52,092::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54586::DEBUG::2014-05-16 17:45:52,092::task::579::TaskManager.Task::(_updateState) Task=`30a3a5a3-1541-4ac3-a6da-ee816e062d30`::moving from state init -> state preparing >Thread-54586::INFO::2014-05-16 17:45:52,092::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54586::DEBUG::2014-05-16 17:45:52,092::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a61556bd-e76e-48b7-81b6-def7a3f49a96`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54586::DEBUG::2014-05-16 17:45:52,093::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54586::DEBUG::2014-05-16 17:45:52,093::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54586::DEBUG::2014-05-16 17:45:52,093::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a61556bd-e76e-48b7-81b6-def7a3f49a96`::Granted request >Thread-54586::DEBUG::2014-05-16 17:45:52,093::task::811::TaskManager.Task::(resourceAcquired) Task=`30a3a5a3-1541-4ac3-a6da-ee816e062d30`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54586::DEBUG::2014-05-16 17:45:52,093::task::974::TaskManager.Task::(_decref) Task=`30a3a5a3-1541-4ac3-a6da-ee816e062d30`::ref 1 aborting False >Thread-54586::INFO::2014-05-16 17:45:52,094::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54586::DEBUG::2014-05-16 17:45:52,094::task::1168::TaskManager.Task::(prepare) Task=`30a3a5a3-1541-4ac3-a6da-ee816e062d30`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54586::DEBUG::2014-05-16 17:45:52,094::task::579::TaskManager.Task::(_updateState) Task=`30a3a5a3-1541-4ac3-a6da-ee816e062d30`::moving from state preparing -> state finished >Thread-54586::DEBUG::2014-05-16 17:45:52,095::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54586::DEBUG::2014-05-16 17:45:52,095::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54586::DEBUG::2014-05-16 17:45:52,095::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54586::DEBUG::2014-05-16 17:45:52,095::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54586::DEBUG::2014-05-16 17:45:52,095::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54586::DEBUG::2014-05-16 17:45:52,095::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54586::DEBUG::2014-05-16 17:45:52,096::task::974::TaskManager.Task::(_decref) Task=`30a3a5a3-1541-4ac3-a6da-ee816e062d30`::ref 0 aborting False >Thread-54587::DEBUG::2014-05-16 17:45:52,146::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5412610.000000 / 8.008580 / 262500000.000000 = 0.257467 >Thread-54587::DEBUG::2014-05-16 17:45:52,146::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0063324465705079831, 'statsAge': 0.13126301765441895, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25746720074514901, 'rxDropped': 0} >Thread-54587::DEBUG::2014-05-16 17:45:52,147::task::579::TaskManager.Task::(_updateState) Task=`1b5df148-b0a6-4308-9a05-90384abecc75`::moving from state init -> state preparing >Thread-54587::INFO::2014-05-16 17:45:52,147::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54587::INFO::2014-05-16 17:45:52,147::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0007879', 'lastCheck': '3.1', 'valid': True}} >Thread-54587::DEBUG::2014-05-16 17:45:52,147::task::1168::TaskManager.Task::(prepare) Task=`1b5df148-b0a6-4308-9a05-90384abecc75`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0007879', 'lastCheck': '3.1', 'valid': True}} >Thread-54587::DEBUG::2014-05-16 17:45:52,147::task::579::TaskManager.Task::(_updateState) Task=`1b5df148-b0a6-4308-9a05-90384abecc75`::moving from state preparing -> state finished >Thread-54587::DEBUG::2014-05-16 17:45:52,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54587::DEBUG::2014-05-16 17:45:52,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54587::DEBUG::2014-05-16 17:45:52,148::task::974::TaskManager.Task::(_decref) Task=`1b5df148-b0a6-4308-9a05-90384abecc75`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:45:52,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:52,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354837 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:54,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:54,915::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312229 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:56,929::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:45:56,997::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314177 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:59,008::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 17:45:59,119::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:45:59,152::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749087 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:45:59,286::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.149779 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:01,298::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:01,370::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359706 s, 28.5 MB/s\n'; <rc> = 0 >Thread-54592::DEBUG::2014-05-16 17:46:02,171::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54592::DEBUG::2014-05-16 17:46:02,172::task::579::TaskManager.Task::(_updateState) Task=`0088547f-6089-456b-b929-2e73d9317a9a`::moving from state init -> state preparing >Thread-54592::INFO::2014-05-16 17:46:02,172::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54592::INFO::2014-05-16 17:46:02,172::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54592::DEBUG::2014-05-16 17:46:02,172::task::1168::TaskManager.Task::(prepare) Task=`0088547f-6089-456b-b929-2e73d9317a9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54592::DEBUG::2014-05-16 17:46:02,172::task::579::TaskManager.Task::(_updateState) Task=`0088547f-6089-456b-b929-2e73d9317a9a`::moving from state preparing -> state finished >Thread-54592::DEBUG::2014-05-16 17:46:02,173::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54592::DEBUG::2014-05-16 17:46:02,173::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54592::DEBUG::2014-05-16 17:46:02,173::task::974::TaskManager.Task::(_decref) Task=`0088547f-6089-456b-b929-2e73d9317a9a`::ref 0 aborting False >Thread-54593::DEBUG::2014-05-16 17:46:02,181::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54593::DEBUG::2014-05-16 17:46:02,181::task::579::TaskManager.Task::(_updateState) Task=`c77e55e1-c1d6-48df-8e54-847117d0140a`::moving from state init -> state preparing >Thread-54593::INFO::2014-05-16 17:46:02,181::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54593::DEBUG::2014-05-16 17:46:02,181::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b38b6402-4ba6-4ce2-8939-1751c4f0cee6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54593::DEBUG::2014-05-16 17:46:02,182::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54593::DEBUG::2014-05-16 17:46:02,182::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54593::DEBUG::2014-05-16 17:46:02,182::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b38b6402-4ba6-4ce2-8939-1751c4f0cee6`::Granted request >Thread-54593::DEBUG::2014-05-16 17:46:02,182::task::811::TaskManager.Task::(resourceAcquired) Task=`c77e55e1-c1d6-48df-8e54-847117d0140a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54593::DEBUG::2014-05-16 17:46:02,182::task::974::TaskManager.Task::(_decref) Task=`c77e55e1-c1d6-48df-8e54-847117d0140a`::ref 1 aborting False >Thread-54593::INFO::2014-05-16 17:46:02,183::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54593::DEBUG::2014-05-16 17:46:02,183::task::1168::TaskManager.Task::(prepare) Task=`c77e55e1-c1d6-48df-8e54-847117d0140a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54593::DEBUG::2014-05-16 17:46:02,183::task::579::TaskManager.Task::(_updateState) Task=`c77e55e1-c1d6-48df-8e54-847117d0140a`::moving from state preparing -> state finished >Thread-54593::DEBUG::2014-05-16 17:46:02,183::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54593::DEBUG::2014-05-16 17:46:02,183::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54593::DEBUG::2014-05-16 17:46:02,184::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54593::DEBUG::2014-05-16 17:46:02,184::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54593::DEBUG::2014-05-16 17:46:02,184::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54593::DEBUG::2014-05-16 17:46:02,184::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54593::DEBUG::2014-05-16 17:46:02,184::task::974::TaskManager.Task::(_decref) Task=`c77e55e1-c1d6-48df-8e54-847117d0140a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:46:03,381::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:03,452::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348726 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:05,464::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:05,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316243 s, 32.4 MB/s\n'; <rc> = 0 >Thread-54595::DEBUG::2014-05-16 17:46:07,287::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319830.000000 / 8.008582 / 262500000.000000 = 0.205486 >Thread-54595::DEBUG::2014-05-16 17:46:07,287::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053776596096619294, 'statsAge': 1.2570300102233887, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2054857526766965, 'rxDropped': 0} >Thread-54595::DEBUG::2014-05-16 17:46:07,287::task::579::TaskManager.Task::(_updateState) Task=`d08d5ba1-7ffd-4936-8b78-103841c601bc`::moving from state init -> state preparing >Thread-54595::INFO::2014-05-16 17:46:07,288::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54595::INFO::2014-05-16 17:46:07,288::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749087', 'lastCheck': '8.0', 'valid': True}} >Thread-54595::DEBUG::2014-05-16 17:46:07,288::task::1168::TaskManager.Task::(prepare) Task=`d08d5ba1-7ffd-4936-8b78-103841c601bc`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749087', 'lastCheck': '8.0', 'valid': True}} >Thread-54595::DEBUG::2014-05-16 17:46:07,288::task::579::TaskManager.Task::(_updateState) Task=`d08d5ba1-7ffd-4936-8b78-103841c601bc`::moving from state preparing -> state finished >Thread-54595::DEBUG::2014-05-16 17:46:07,288::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54595::DEBUG::2014-05-16 17:46:07,289::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54595::DEBUG::2014-05-16 17:46:07,289::task::974::TaskManager.Task::(_decref) Task=`d08d5ba1-7ffd-4936-8b78-103841c601bc`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:46:07,543::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:07,613::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348782 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:46:09,277::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:46:09,288::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000977521 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:09,625::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:09,695::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342314 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:11,707::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:11,775::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312881 s, 32.7 MB/s\n'; <rc> = 0 >Thread-54598::DEBUG::2014-05-16 17:46:12,218::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54598::DEBUG::2014-05-16 17:46:12,219::task::579::TaskManager.Task::(_updateState) Task=`d5c20a08-cc48-4b72-9576-de9bca7dcb14`::moving from state init -> state preparing >Thread-54598::INFO::2014-05-16 17:46:12,219::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54598::INFO::2014-05-16 17:46:12,219::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54598::DEBUG::2014-05-16 17:46:12,219::task::1168::TaskManager.Task::(prepare) Task=`d5c20a08-cc48-4b72-9576-de9bca7dcb14`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54598::DEBUG::2014-05-16 17:46:12,220::task::579::TaskManager.Task::(_updateState) Task=`d5c20a08-cc48-4b72-9576-de9bca7dcb14`::moving from state preparing -> state finished >Thread-54598::DEBUG::2014-05-16 17:46:12,220::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54598::DEBUG::2014-05-16 17:46:12,220::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54598::DEBUG::2014-05-16 17:46:12,220::task::974::TaskManager.Task::(_decref) Task=`d5c20a08-cc48-4b72-9576-de9bca7dcb14`::ref 0 aborting False >Thread-54599::DEBUG::2014-05-16 17:46:12,229::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54599::DEBUG::2014-05-16 17:46:12,229::task::579::TaskManager.Task::(_updateState) Task=`eafcb4c1-896d-4089-a7f3-f6ccd4f5946c`::moving from state init -> state preparing >Thread-54599::INFO::2014-05-16 17:46:12,230::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54599::DEBUG::2014-05-16 17:46:12,230::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1bf489fb-b2c9-4d54-b6de-79d7824ab509`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54599::DEBUG::2014-05-16 17:46:12,230::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54599::DEBUG::2014-05-16 17:46:12,230::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54599::DEBUG::2014-05-16 17:46:12,231::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1bf489fb-b2c9-4d54-b6de-79d7824ab509`::Granted request >Thread-54599::DEBUG::2014-05-16 17:46:12,231::task::811::TaskManager.Task::(resourceAcquired) Task=`eafcb4c1-896d-4089-a7f3-f6ccd4f5946c`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54599::DEBUG::2014-05-16 17:46:12,231::task::974::TaskManager.Task::(_decref) Task=`eafcb4c1-896d-4089-a7f3-f6ccd4f5946c`::ref 1 aborting False >Thread-54599::INFO::2014-05-16 17:46:12,232::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54599::DEBUG::2014-05-16 17:46:12,232::task::1168::TaskManager.Task::(prepare) Task=`eafcb4c1-896d-4089-a7f3-f6ccd4f5946c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54599::DEBUG::2014-05-16 17:46:12,232::task::579::TaskManager.Task::(_updateState) Task=`eafcb4c1-896d-4089-a7f3-f6ccd4f5946c`::moving from state preparing -> state finished >Thread-54599::DEBUG::2014-05-16 17:46:12,232::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54599::DEBUG::2014-05-16 17:46:12,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54599::DEBUG::2014-05-16 17:46:12,233::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54599::DEBUG::2014-05-16 17:46:12,233::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54599::DEBUG::2014-05-16 17:46:12,233::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54599::DEBUG::2014-05-16 17:46:12,234::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54599::DEBUG::2014-05-16 17:46:12,234::task::974::TaskManager.Task::(_decref) Task=`eafcb4c1-896d-4089-a7f3-f6ccd4f5946c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:46:13,787::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:13,859::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356171 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:15,871::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:15,939::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314765 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:17,950::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:18,022::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349171 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:46:19,324::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:46:19,335::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100172 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:20,034::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:20,105::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350328 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:22,116::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:22,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312133 s, 32.8 MB/s\n'; <rc> = 0 >Thread-54603::DEBUG::2014-05-16 17:46:22,262::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54603::DEBUG::2014-05-16 17:46:22,262::task::579::TaskManager.Task::(_updateState) Task=`c3a9ba00-7948-4822-a574-cd0ecdf79c87`::moving from state init -> state preparing >Thread-54603::INFO::2014-05-16 17:46:22,263::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54603::INFO::2014-05-16 17:46:22,263::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54603::DEBUG::2014-05-16 17:46:22,263::task::1168::TaskManager.Task::(prepare) Task=`c3a9ba00-7948-4822-a574-cd0ecdf79c87`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54603::DEBUG::2014-05-16 17:46:22,263::task::579::TaskManager.Task::(_updateState) Task=`c3a9ba00-7948-4822-a574-cd0ecdf79c87`::moving from state preparing -> state finished >Thread-54603::DEBUG::2014-05-16 17:46:22,263::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54603::DEBUG::2014-05-16 17:46:22,264::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54603::DEBUG::2014-05-16 17:46:22,264::task::974::TaskManager.Task::(_decref) Task=`c3a9ba00-7948-4822-a574-cd0ecdf79c87`::ref 0 aborting False >Thread-54604::DEBUG::2014-05-16 17:46:22,272::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54604::DEBUG::2014-05-16 17:46:22,273::task::579::TaskManager.Task::(_updateState) Task=`217b87f3-1abd-4aa9-a7ad-14b46ae31416`::moving from state init -> state preparing >Thread-54604::INFO::2014-05-16 17:46:22,273::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54604::DEBUG::2014-05-16 17:46:22,273::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`089583cd-b5a7-40f4-a6d8-c731d04e0030`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54604::DEBUG::2014-05-16 17:46:22,273::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54604::DEBUG::2014-05-16 17:46:22,274::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54604::DEBUG::2014-05-16 17:46:22,274::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`089583cd-b5a7-40f4-a6d8-c731d04e0030`::Granted request >Thread-54604::DEBUG::2014-05-16 17:46:22,274::task::811::TaskManager.Task::(resourceAcquired) Task=`217b87f3-1abd-4aa9-a7ad-14b46ae31416`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54604::DEBUG::2014-05-16 17:46:22,274::task::974::TaskManager.Task::(_decref) Task=`217b87f3-1abd-4aa9-a7ad-14b46ae31416`::ref 1 aborting False >Thread-54604::INFO::2014-05-16 17:46:22,275::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54604::DEBUG::2014-05-16 17:46:22,275::task::1168::TaskManager.Task::(prepare) Task=`217b87f3-1abd-4aa9-a7ad-14b46ae31416`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54604::DEBUG::2014-05-16 17:46:22,275::task::579::TaskManager.Task::(_updateState) Task=`217b87f3-1abd-4aa9-a7ad-14b46ae31416`::moving from state preparing -> state finished >Thread-54604::DEBUG::2014-05-16 17:46:22,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54604::DEBUG::2014-05-16 17:46:22,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54604::DEBUG::2014-05-16 17:46:22,276::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54604::DEBUG::2014-05-16 17:46:22,276::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54604::DEBUG::2014-05-16 17:46:22,276::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54604::DEBUG::2014-05-16 17:46:22,276::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54604::DEBUG::2014-05-16 17:46:22,277::task::974::TaskManager.Task::(_decref) Task=`217b87f3-1abd-4aa9-a7ad-14b46ae31416`::ref 0 aborting False >Thread-54605::DEBUG::2014-05-16 17:46:22,427::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314221.000000 / 8.008580 / 262500000.000000 = 0.205219 >Thread-54605::DEBUG::2014-05-16 17:46:22,427::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0050618091734034943, 'statsAge': 0.37978696823120117, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20521899253740175, 'rxDropped': 0} >Thread-54605::DEBUG::2014-05-16 17:46:22,427::task::579::TaskManager.Task::(_updateState) Task=`74aebf60-45fe-4b10-9b49-c10fb0b0060d`::moving from state init -> state preparing >Thread-54605::INFO::2014-05-16 17:46:22,427::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54605::INFO::2014-05-16 17:46:22,427::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100172', 'lastCheck': '3.1', 'valid': True}} >Thread-54605::DEBUG::2014-05-16 17:46:22,428::task::1168::TaskManager.Task::(prepare) Task=`74aebf60-45fe-4b10-9b49-c10fb0b0060d`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100172', 'lastCheck': '3.1', 'valid': True}} >Thread-54605::DEBUG::2014-05-16 17:46:22,428::task::579::TaskManager.Task::(_updateState) Task=`74aebf60-45fe-4b10-9b49-c10fb0b0060d`::moving from state preparing -> state finished >Thread-54605::DEBUG::2014-05-16 17:46:22,428::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54605::DEBUG::2014-05-16 17:46:22,428::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54605::DEBUG::2014-05-16 17:46:22,428::task::974::TaskManager.Task::(_decref) Task=`74aebf60-45fe-4b10-9b49-c10fb0b0060d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:46:24,195::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:24,262::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304273 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:26,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:26,342::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031608 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:28,354::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:28,425::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035095 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:46:29,354::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 17:46:29,355::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:46:29,370::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:46:29,378::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000792449 s, 2.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:46:29,379::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000792449 s, 2.6 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 17:46:29,379::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 17:46:29,379::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 17:46:29,379::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:46:29,380::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:46:29,380::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:46:29,380::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:46:29,380::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:46:29,381::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:46:29,381::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:46:29,532::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:46:29,535::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:46:29,535::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 17:46:29,536::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 17:46:29,536::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 17:46:29,536::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 17:46:29,537::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:46:29,678::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:46:29,699::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:46:29,709::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000572056 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:30,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:30,507::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346618 s, 29.5 MB/s\n'; <rc> = 0 >Thread-54610::DEBUG::2014-05-16 17:46:32,309::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54610::DEBUG::2014-05-16 17:46:32,310::task::579::TaskManager.Task::(_updateState) Task=`fa126c37-b7ff-4567-b1b5-bcd2e7dc3e0e`::moving from state init -> state preparing >Thread-54610::INFO::2014-05-16 17:46:32,310::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54610::INFO::2014-05-16 17:46:32,310::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54610::DEBUG::2014-05-16 17:46:32,310::task::1168::TaskManager.Task::(prepare) Task=`fa126c37-b7ff-4567-b1b5-bcd2e7dc3e0e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54610::DEBUG::2014-05-16 17:46:32,311::task::579::TaskManager.Task::(_updateState) Task=`fa126c37-b7ff-4567-b1b5-bcd2e7dc3e0e`::moving from state preparing -> state finished >Thread-54610::DEBUG::2014-05-16 17:46:32,311::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54610::DEBUG::2014-05-16 17:46:32,311::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54610::DEBUG::2014-05-16 17:46:32,311::task::974::TaskManager.Task::(_decref) Task=`fa126c37-b7ff-4567-b1b5-bcd2e7dc3e0e`::ref 0 aborting False >Thread-54611::DEBUG::2014-05-16 17:46:32,319::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54611::DEBUG::2014-05-16 17:46:32,319::task::579::TaskManager.Task::(_updateState) Task=`9988ce67-e755-487b-9e4b-9878f8aa89b9`::moving from state init -> state preparing >Thread-54611::INFO::2014-05-16 17:46:32,319::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54611::DEBUG::2014-05-16 17:46:32,320::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`43da598a-b572-48bc-aed6-2d9bbdf5147d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54611::DEBUG::2014-05-16 17:46:32,320::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54611::DEBUG::2014-05-16 17:46:32,320::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54611::DEBUG::2014-05-16 17:46:32,320::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`43da598a-b572-48bc-aed6-2d9bbdf5147d`::Granted request >Thread-54611::DEBUG::2014-05-16 17:46:32,320::task::811::TaskManager.Task::(resourceAcquired) Task=`9988ce67-e755-487b-9e4b-9878f8aa89b9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54611::DEBUG::2014-05-16 17:46:32,321::task::974::TaskManager.Task::(_decref) Task=`9988ce67-e755-487b-9e4b-9878f8aa89b9`::ref 1 aborting False >Thread-54611::INFO::2014-05-16 17:46:32,321::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54611::DEBUG::2014-05-16 17:46:32,321::task::1168::TaskManager.Task::(prepare) Task=`9988ce67-e755-487b-9e4b-9878f8aa89b9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54611::DEBUG::2014-05-16 17:46:32,321::task::579::TaskManager.Task::(_updateState) Task=`9988ce67-e755-487b-9e4b-9878f8aa89b9`::moving from state preparing -> state finished >Thread-54611::DEBUG::2014-05-16 17:46:32,322::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54611::DEBUG::2014-05-16 17:46:32,322::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54611::DEBUG::2014-05-16 17:46:32,322::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54611::DEBUG::2014-05-16 17:46:32,322::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54611::DEBUG::2014-05-16 17:46:32,322::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54611::DEBUG::2014-05-16 17:46:32,322::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54611::DEBUG::2014-05-16 17:46:32,322::task::974::TaskManager.Task::(_decref) Task=`9988ce67-e755-487b-9e4b-9878f8aa89b9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:46:32,519::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:32,586::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314361 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:34,598::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:34,670::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352584 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:36,681::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:36,748::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316185 s, 32.4 MB/s\n'; <rc> = 0 >Thread-54613::DEBUG::2014-05-16 17:46:37,586::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5535787.000000 / 8.008420 / 262500000.000000 = 0.263332 >Thread-54613::DEBUG::2014-05-16 17:46:37,586::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0071623663797599655, 'statsAge': 1.5247859954833984, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2633317484081098, 'rxDropped': 0} >Thread-54613::DEBUG::2014-05-16 17:46:37,587::task::579::TaskManager.Task::(_updateState) Task=`733bee33-2b63-4ff9-9493-367c101e1f0c`::moving from state init -> state preparing >Thread-54613::INFO::2014-05-16 17:46:37,587::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54613::INFO::2014-05-16 17:46:37,587::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572056', 'lastCheck': '7.9', 'valid': True}} >Thread-54613::DEBUG::2014-05-16 17:46:37,588::task::1168::TaskManager.Task::(prepare) Task=`733bee33-2b63-4ff9-9493-367c101e1f0c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572056', 'lastCheck': '7.9', 'valid': True}} >Thread-54613::DEBUG::2014-05-16 17:46:37,588::task::579::TaskManager.Task::(_updateState) Task=`733bee33-2b63-4ff9-9493-367c101e1f0c`::moving from state preparing -> state finished >Thread-54613::DEBUG::2014-05-16 17:46:37,588::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54613::DEBUG::2014-05-16 17:46:37,588::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54613::DEBUG::2014-05-16 17:46:37,588::task::974::TaskManager.Task::(_decref) Task=`733bee33-2b63-4ff9-9493-367c101e1f0c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:46:38,760::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:38,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309418 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:46:39,745::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:46:39,755::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000877507 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:40,838::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:40,910::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358535 s, 28.6 MB/s\n'; <rc> = 0 >Thread-54616::DEBUG::2014-05-16 17:46:42,351::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54616::DEBUG::2014-05-16 17:46:42,351::task::579::TaskManager.Task::(_updateState) Task=`67e734db-7129-44a2-bbe6-9445cd9f5fc4`::moving from state init -> state preparing >Thread-54616::INFO::2014-05-16 17:46:42,351::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54616::INFO::2014-05-16 17:46:42,352::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54616::DEBUG::2014-05-16 17:46:42,352::task::1168::TaskManager.Task::(prepare) Task=`67e734db-7129-44a2-bbe6-9445cd9f5fc4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54616::DEBUG::2014-05-16 17:46:42,352::task::579::TaskManager.Task::(_updateState) Task=`67e734db-7129-44a2-bbe6-9445cd9f5fc4`::moving from state preparing -> state finished >Thread-54616::DEBUG::2014-05-16 17:46:42,352::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54616::DEBUG::2014-05-16 17:46:42,352::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54616::DEBUG::2014-05-16 17:46:42,352::task::974::TaskManager.Task::(_decref) Task=`67e734db-7129-44a2-bbe6-9445cd9f5fc4`::ref 0 aborting False >Thread-54617::DEBUG::2014-05-16 17:46:42,361::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54617::DEBUG::2014-05-16 17:46:42,361::task::579::TaskManager.Task::(_updateState) Task=`f9a2d02c-499a-4b47-afc6-d20ff210cb5a`::moving from state init -> state preparing >Thread-54617::INFO::2014-05-16 17:46:42,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54617::DEBUG::2014-05-16 17:46:42,361::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ff61e265-ab56-4c1e-9f05-f3eff6d792b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54617::DEBUG::2014-05-16 17:46:42,362::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54617::DEBUG::2014-05-16 17:46:42,362::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54617::DEBUG::2014-05-16 17:46:42,362::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ff61e265-ab56-4c1e-9f05-f3eff6d792b6`::Granted request >Thread-54617::DEBUG::2014-05-16 17:46:42,362::task::811::TaskManager.Task::(resourceAcquired) Task=`f9a2d02c-499a-4b47-afc6-d20ff210cb5a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54617::DEBUG::2014-05-16 17:46:42,362::task::974::TaskManager.Task::(_decref) Task=`f9a2d02c-499a-4b47-afc6-d20ff210cb5a`::ref 1 aborting False >Thread-54617::INFO::2014-05-16 17:46:42,363::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54617::DEBUG::2014-05-16 17:46:42,363::task::1168::TaskManager.Task::(prepare) Task=`f9a2d02c-499a-4b47-afc6-d20ff210cb5a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54617::DEBUG::2014-05-16 17:46:42,363::task::579::TaskManager.Task::(_updateState) Task=`f9a2d02c-499a-4b47-afc6-d20ff210cb5a`::moving from state preparing -> state finished >Thread-54617::DEBUG::2014-05-16 17:46:42,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54617::DEBUG::2014-05-16 17:46:42,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54617::DEBUG::2014-05-16 17:46:42,364::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54617::DEBUG::2014-05-16 17:46:42,364::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54617::DEBUG::2014-05-16 17:46:42,364::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54617::DEBUG::2014-05-16 17:46:42,364::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54617::DEBUG::2014-05-16 17:46:42,364::task::974::TaskManager.Task::(_decref) Task=`f9a2d02c-499a-4b47-afc6-d20ff210cb5a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:46:42,922::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:42,993::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354437 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:45,005::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:45,072::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308562 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:47,083::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:47,156::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351717 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:49,168::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:49,238::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347958 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:46:49,792::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:46:49,802::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756826 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:51,250::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:51,316::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298374 s, 34.3 MB/s\n'; <rc> = 0 >Thread-54621::DEBUG::2014-05-16 17:46:52,395::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54621::DEBUG::2014-05-16 17:46:52,396::task::579::TaskManager.Task::(_updateState) Task=`14188517-4d40-4c4f-bb00-f5daee9183cd`::moving from state init -> state preparing >Thread-54621::INFO::2014-05-16 17:46:52,396::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54621::INFO::2014-05-16 17:46:52,396::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54621::DEBUG::2014-05-16 17:46:52,396::task::1168::TaskManager.Task::(prepare) Task=`14188517-4d40-4c4f-bb00-f5daee9183cd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54621::DEBUG::2014-05-16 17:46:52,397::task::579::TaskManager.Task::(_updateState) Task=`14188517-4d40-4c4f-bb00-f5daee9183cd`::moving from state preparing -> state finished >Thread-54621::DEBUG::2014-05-16 17:46:52,397::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54621::DEBUG::2014-05-16 17:46:52,397::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54621::DEBUG::2014-05-16 17:46:52,397::task::974::TaskManager.Task::(_decref) Task=`14188517-4d40-4c4f-bb00-f5daee9183cd`::ref 0 aborting False >Thread-54622::DEBUG::2014-05-16 17:46:52,407::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54622::DEBUG::2014-05-16 17:46:52,407::task::579::TaskManager.Task::(_updateState) Task=`986d255d-9e5a-4a48-8c83-325377391611`::moving from state init -> state preparing >Thread-54622::INFO::2014-05-16 17:46:52,408::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54622::DEBUG::2014-05-16 17:46:52,408::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`264d0491-2b4b-4fdb-b6e1-c599c507ccaa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54622::DEBUG::2014-05-16 17:46:52,408::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54622::DEBUG::2014-05-16 17:46:52,408::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54622::DEBUG::2014-05-16 17:46:52,409::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`264d0491-2b4b-4fdb-b6e1-c599c507ccaa`::Granted request >Thread-54622::DEBUG::2014-05-16 17:46:52,409::task::811::TaskManager.Task::(resourceAcquired) Task=`986d255d-9e5a-4a48-8c83-325377391611`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54622::DEBUG::2014-05-16 17:46:52,409::task::974::TaskManager.Task::(_decref) Task=`986d255d-9e5a-4a48-8c83-325377391611`::ref 1 aborting False >Thread-54622::INFO::2014-05-16 17:46:52,410::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54622::DEBUG::2014-05-16 17:46:52,410::task::1168::TaskManager.Task::(prepare) Task=`986d255d-9e5a-4a48-8c83-325377391611`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54622::DEBUG::2014-05-16 17:46:52,410::task::579::TaskManager.Task::(_updateState) Task=`986d255d-9e5a-4a48-8c83-325377391611`::moving from state preparing -> state finished >Thread-54622::DEBUG::2014-05-16 17:46:52,410::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54622::DEBUG::2014-05-16 17:46:52,410::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54622::DEBUG::2014-05-16 17:46:52,411::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54622::DEBUG::2014-05-16 17:46:52,411::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54622::DEBUG::2014-05-16 17:46:52,411::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54622::DEBUG::2014-05-16 17:46:52,411::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54622::DEBUG::2014-05-16 17:46:52,411::task::974::TaskManager.Task::(_decref) Task=`986d255d-9e5a-4a48-8c83-325377391611`::ref 0 aborting False >Thread-54623::DEBUG::2014-05-16 17:46:52,735::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5414496.000000 / 8.008486 / 262500000.000000 = 0.257560 >Thread-54623::DEBUG::2014-05-16 17:46:52,735::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0063228170441035599, 'statsAge': 0.65648412704467773, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25755994277784039, 'rxDropped': 0} >Thread-54623::DEBUG::2014-05-16 17:46:52,735::task::579::TaskManager.Task::(_updateState) Task=`44443828-dace-44d8-9b67-2cf205bb6bf7`::moving from state init -> state preparing >Thread-54623::INFO::2014-05-16 17:46:52,735::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54623::INFO::2014-05-16 17:46:52,736::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756826', 'lastCheck': '2.9', 'valid': True}} >Thread-54623::DEBUG::2014-05-16 17:46:52,736::task::1168::TaskManager.Task::(prepare) Task=`44443828-dace-44d8-9b67-2cf205bb6bf7`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756826', 'lastCheck': '2.9', 'valid': True}} >Thread-54623::DEBUG::2014-05-16 17:46:52,736::task::579::TaskManager.Task::(_updateState) Task=`44443828-dace-44d8-9b67-2cf205bb6bf7`::moving from state preparing -> state finished >Thread-54623::DEBUG::2014-05-16 17:46:52,736::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54623::DEBUG::2014-05-16 17:46:52,736::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54623::DEBUG::2014-05-16 17:46:52,736::task::974::TaskManager.Task::(_decref) Task=`44443828-dace-44d8-9b67-2cf205bb6bf7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:46:53,327::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:53,394::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307085 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:55,405::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:55,477::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346685 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:57,489::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:57,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308725 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:46:59,567::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:46:59,634::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303889 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:46:59,839::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:46:59,849::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079673 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:01,646::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:01,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355098 s, 28.8 MB/s\n'; <rc> = 0 >Thread-54628::DEBUG::2014-05-16 17:47:02,455::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [62fee17b] >Thread-54628::DEBUG::2014-05-16 17:47:02,455::task::579::TaskManager.Task::(_updateState) Task=`aeb4cec0-eec6-47a0-b8b8-ff43a5a33ca7`::moving from state init -> state preparing >Thread-54628::INFO::2014-05-16 17:47:02,455::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54628::INFO::2014-05-16 17:47:02,456::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54628::DEBUG::2014-05-16 17:47:02,456::task::1168::TaskManager.Task::(prepare) Task=`aeb4cec0-eec6-47a0-b8b8-ff43a5a33ca7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54628::DEBUG::2014-05-16 17:47:02,456::task::579::TaskManager.Task::(_updateState) Task=`aeb4cec0-eec6-47a0-b8b8-ff43a5a33ca7`::moving from state preparing -> state finished >Thread-54628::DEBUG::2014-05-16 17:47:02,456::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54628::DEBUG::2014-05-16 17:47:02,456::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54628::DEBUG::2014-05-16 17:47:02,456::task::974::TaskManager.Task::(_decref) Task=`aeb4cec0-eec6-47a0-b8b8-ff43a5a33ca7`::ref 0 aborting False >Thread-54629::DEBUG::2014-05-16 17:47:02,465::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [62fee17b] >Thread-54629::DEBUG::2014-05-16 17:47:02,465::task::579::TaskManager.Task::(_updateState) Task=`efd621c5-7ec9-42c5-b4df-dd5c1cd170e3`::moving from state init -> state preparing >Thread-54629::INFO::2014-05-16 17:47:02,465::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54629::DEBUG::2014-05-16 17:47:02,465::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ab8b1d99-993a-45d2-85a9-c5759c9c336e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54629::DEBUG::2014-05-16 17:47:02,466::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54629::DEBUG::2014-05-16 17:47:02,466::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54629::DEBUG::2014-05-16 17:47:02,466::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ab8b1d99-993a-45d2-85a9-c5759c9c336e`::Granted request >Thread-54629::DEBUG::2014-05-16 17:47:02,466::task::811::TaskManager.Task::(resourceAcquired) Task=`efd621c5-7ec9-42c5-b4df-dd5c1cd170e3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54629::DEBUG::2014-05-16 17:47:02,466::task::974::TaskManager.Task::(_decref) Task=`efd621c5-7ec9-42c5-b4df-dd5c1cd170e3`::ref 1 aborting False >Thread-54629::INFO::2014-05-16 17:47:02,467::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54629::DEBUG::2014-05-16 17:47:02,467::task::1168::TaskManager.Task::(prepare) Task=`efd621c5-7ec9-42c5-b4df-dd5c1cd170e3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54629::DEBUG::2014-05-16 17:47:02,467::task::579::TaskManager.Task::(_updateState) Task=`efd621c5-7ec9-42c5-b4df-dd5c1cd170e3`::moving from state preparing -> state finished >Thread-54629::DEBUG::2014-05-16 17:47:02,467::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54629::DEBUG::2014-05-16 17:47:02,468::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54629::DEBUG::2014-05-16 17:47:02,468::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54629::DEBUG::2014-05-16 17:47:02,468::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54629::DEBUG::2014-05-16 17:47:02,468::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54629::DEBUG::2014-05-16 17:47:02,468::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54629::DEBUG::2014-05-16 17:47:02,468::task::974::TaskManager.Task::(_decref) Task=`efd621c5-7ec9-42c5-b4df-dd5c1cd170e3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:47:03,729::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:03,800::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347699 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:05,811::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:05,879::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317014 s, 32.3 MB/s\n'; <rc> = 0 >Thread-54631::DEBUG::2014-05-16 17:47:07,883::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3245577.000000 / 8.008393 / 262500000.000000 = 0.154389 >Thread-54631::DEBUG::2014-05-16 17:47:07,883::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041877970526377553, 'statsAge': 1.7901930809020996, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15438931567437059, 'rxDropped': 0} >Thread-54631::DEBUG::2014-05-16 17:47:07,884::task::579::TaskManager.Task::(_updateState) Task=`67e36ec8-16b6-4741-8040-75346d2e23b1`::moving from state init -> state preparing >Thread-54631::INFO::2014-05-16 17:47:07,884::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54631::INFO::2014-05-16 17:47:07,884::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079673', 'lastCheck': '8.0', 'valid': True}} >Thread-54631::DEBUG::2014-05-16 17:47:07,885::task::1168::TaskManager.Task::(prepare) Task=`67e36ec8-16b6-4741-8040-75346d2e23b1`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079673', 'lastCheck': '8.0', 'valid': True}} >Thread-54631::DEBUG::2014-05-16 17:47:07,885::task::579::TaskManager.Task::(_updateState) Task=`67e36ec8-16b6-4741-8040-75346d2e23b1`::moving from state preparing -> state finished >Thread-54631::DEBUG::2014-05-16 17:47:07,885::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54631::DEBUG::2014-05-16 17:47:07,885::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54631::DEBUG::2014-05-16 17:47:07,885::task::974::TaskManager.Task::(_decref) Task=`67e36ec8-16b6-4741-8040-75346d2e23b1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:47:07,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:07,966::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0399653 s, 25.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:47:09,882::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:47:09,893::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109103 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:09,978::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:10,048::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345177 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:12,060::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:12,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298436 s, 34.3 MB/s\n'; <rc> = 0 >Thread-54634::DEBUG::2014-05-16 17:47:12,506::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54634::DEBUG::2014-05-16 17:47:12,506::task::579::TaskManager.Task::(_updateState) Task=`12269aae-1ab4-475a-90a7-8cdb3cf08d60`::moving from state init -> state preparing >Thread-54634::INFO::2014-05-16 17:47:12,507::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54634::INFO::2014-05-16 17:47:12,507::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54634::DEBUG::2014-05-16 17:47:12,507::task::1168::TaskManager.Task::(prepare) Task=`12269aae-1ab4-475a-90a7-8cdb3cf08d60`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54634::DEBUG::2014-05-16 17:47:12,507::task::579::TaskManager.Task::(_updateState) Task=`12269aae-1ab4-475a-90a7-8cdb3cf08d60`::moving from state preparing -> state finished >Thread-54634::DEBUG::2014-05-16 17:47:12,507::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54634::DEBUG::2014-05-16 17:47:12,508::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54634::DEBUG::2014-05-16 17:47:12,508::task::974::TaskManager.Task::(_decref) Task=`12269aae-1ab4-475a-90a7-8cdb3cf08d60`::ref 0 aborting False >Thread-54635::DEBUG::2014-05-16 17:47:12,516::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54635::DEBUG::2014-05-16 17:47:12,516::task::579::TaskManager.Task::(_updateState) Task=`151707be-15ef-4343-892f-af9827fa1efa`::moving from state init -> state preparing >Thread-54635::INFO::2014-05-16 17:47:12,516::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54635::DEBUG::2014-05-16 17:47:12,517::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5dcd8c31-ece5-44f4-bc22-93c2f935eaf9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54635::DEBUG::2014-05-16 17:47:12,517::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54635::DEBUG::2014-05-16 17:47:12,517::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54635::DEBUG::2014-05-16 17:47:12,517::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5dcd8c31-ece5-44f4-bc22-93c2f935eaf9`::Granted request >Thread-54635::DEBUG::2014-05-16 17:47:12,518::task::811::TaskManager.Task::(resourceAcquired) Task=`151707be-15ef-4343-892f-af9827fa1efa`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54635::DEBUG::2014-05-16 17:47:12,518::task::974::TaskManager.Task::(_decref) Task=`151707be-15ef-4343-892f-af9827fa1efa`::ref 1 aborting False >Thread-54635::INFO::2014-05-16 17:47:12,519::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54635::DEBUG::2014-05-16 17:47:12,519::task::1168::TaskManager.Task::(prepare) Task=`151707be-15ef-4343-892f-af9827fa1efa`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54635::DEBUG::2014-05-16 17:47:12,519::task::579::TaskManager.Task::(_updateState) Task=`151707be-15ef-4343-892f-af9827fa1efa`::moving from state preparing -> state finished >Thread-54635::DEBUG::2014-05-16 17:47:12,519::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54635::DEBUG::2014-05-16 17:47:12,519::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54635::DEBUG::2014-05-16 17:47:12,519::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54635::DEBUG::2014-05-16 17:47:12,520::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54635::DEBUG::2014-05-16 17:47:12,520::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54635::DEBUG::2014-05-16 17:47:12,520::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54635::DEBUG::2014-05-16 17:47:12,520::task::974::TaskManager.Task::(_decref) Task=`151707be-15ef-4343-892f-af9827fa1efa`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:47:14,142::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:14,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350566 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:16,224::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:16,292::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311116 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:18,303::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:18,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355342 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:47:19,932::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:47:19,943::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104079 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:20,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:20,452::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304182 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:22,463::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:22,534::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346291 s, 29.6 MB/s\n'; <rc> = 0 >Thread-54639::DEBUG::2014-05-16 17:47:22,550::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54639::DEBUG::2014-05-16 17:47:22,552::task::579::TaskManager.Task::(_updateState) Task=`8d9120d4-1028-45bb-a8ea-b98c629cf141`::moving from state init -> state preparing >Thread-54639::INFO::2014-05-16 17:47:22,552::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54639::INFO::2014-05-16 17:47:22,552::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54639::DEBUG::2014-05-16 17:47:22,552::task::1168::TaskManager.Task::(prepare) Task=`8d9120d4-1028-45bb-a8ea-b98c629cf141`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54639::DEBUG::2014-05-16 17:47:22,552::task::579::TaskManager.Task::(_updateState) Task=`8d9120d4-1028-45bb-a8ea-b98c629cf141`::moving from state preparing -> state finished >Thread-54639::DEBUG::2014-05-16 17:47:22,553::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54639::DEBUG::2014-05-16 17:47:22,553::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54639::DEBUG::2014-05-16 17:47:22,553::task::974::TaskManager.Task::(_decref) Task=`8d9120d4-1028-45bb-a8ea-b98c629cf141`::ref 0 aborting False >Thread-54640::DEBUG::2014-05-16 17:47:22,561::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54640::DEBUG::2014-05-16 17:47:22,562::task::579::TaskManager.Task::(_updateState) Task=`acd44297-b1bb-4b64-b3c1-6e85f1779730`::moving from state init -> state preparing >Thread-54640::INFO::2014-05-16 17:47:22,562::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54640::DEBUG::2014-05-16 17:47:22,562::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c48d8696-d700-4fcb-922a-52aa1663590e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54640::DEBUG::2014-05-16 17:47:22,562::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54640::DEBUG::2014-05-16 17:47:22,563::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54640::DEBUG::2014-05-16 17:47:22,563::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c48d8696-d700-4fcb-922a-52aa1663590e`::Granted request >Thread-54640::DEBUG::2014-05-16 17:47:22,563::task::811::TaskManager.Task::(resourceAcquired) Task=`acd44297-b1bb-4b64-b3c1-6e85f1779730`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54640::DEBUG::2014-05-16 17:47:22,563::task::974::TaskManager.Task::(_decref) Task=`acd44297-b1bb-4b64-b3c1-6e85f1779730`::ref 1 aborting False >Thread-54640::INFO::2014-05-16 17:47:22,564::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54640::DEBUG::2014-05-16 17:47:22,564::task::1168::TaskManager.Task::(prepare) Task=`acd44297-b1bb-4b64-b3c1-6e85f1779730`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54640::DEBUG::2014-05-16 17:47:22,564::task::579::TaskManager.Task::(_updateState) Task=`acd44297-b1bb-4b64-b3c1-6e85f1779730`::moving from state preparing -> state finished >Thread-54640::DEBUG::2014-05-16 17:47:22,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54640::DEBUG::2014-05-16 17:47:22,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54640::DEBUG::2014-05-16 17:47:22,565::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54640::DEBUG::2014-05-16 17:47:22,565::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54640::DEBUG::2014-05-16 17:47:22,565::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54640::DEBUG::2014-05-16 17:47:22,565::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54640::DEBUG::2014-05-16 17:47:22,565::task::974::TaskManager.Task::(_decref) Task=`acd44297-b1bb-4b64-b3c1-6e85f1779730`::ref 0 aborting False >Thread-54641::DEBUG::2014-05-16 17:47:23,051::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313268.000000 / 8.008428 / 262500000.000000 = 0.205178 >Thread-54641::DEBUG::2014-05-16 17:47:23,051::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051161339005727285, 'statsAge': 0.93762302398681641, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20517755724724346, 'rxDropped': 0} >Thread-54641::DEBUG::2014-05-16 17:47:23,051::task::579::TaskManager.Task::(_updateState) Task=`426bf707-a818-477e-b06e-f5d25f456ab2`::moving from state init -> state preparing >Thread-54641::INFO::2014-05-16 17:47:23,052::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54641::INFO::2014-05-16 17:47:23,052::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104079', 'lastCheck': '3.1', 'valid': True}} >Thread-54641::DEBUG::2014-05-16 17:47:23,052::task::1168::TaskManager.Task::(prepare) Task=`426bf707-a818-477e-b06e-f5d25f456ab2`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104079', 'lastCheck': '3.1', 'valid': True}} >Thread-54641::DEBUG::2014-05-16 17:47:23,052::task::579::TaskManager.Task::(_updateState) Task=`426bf707-a818-477e-b06e-f5d25f456ab2`::moving from state preparing -> state finished >Thread-54641::DEBUG::2014-05-16 17:47:23,052::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54641::DEBUG::2014-05-16 17:47:23,052::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54641::DEBUG::2014-05-16 17:47:23,053::task::974::TaskManager.Task::(_decref) Task=`426bf707-a818-477e-b06e-f5d25f456ab2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:47:24,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:24,612::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030424 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:26,624::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:26,698::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378497 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:28,710::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:28,781::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348922 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:47:29,977::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:47:29,988::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105756 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:30,792::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:30,863::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354206 s, 28.9 MB/s\n'; <rc> = 0 >Thread-54646::DEBUG::2014-05-16 17:47:32,600::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54646::DEBUG::2014-05-16 17:47:32,601::task::579::TaskManager.Task::(_updateState) Task=`646565bc-248f-4339-8d9c-55856fa74f73`::moving from state init -> state preparing >Thread-54646::INFO::2014-05-16 17:47:32,601::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54646::INFO::2014-05-16 17:47:32,601::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54646::DEBUG::2014-05-16 17:47:32,601::task::1168::TaskManager.Task::(prepare) Task=`646565bc-248f-4339-8d9c-55856fa74f73`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54646::DEBUG::2014-05-16 17:47:32,601::task::579::TaskManager.Task::(_updateState) Task=`646565bc-248f-4339-8d9c-55856fa74f73`::moving from state preparing -> state finished >Thread-54646::DEBUG::2014-05-16 17:47:32,602::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54646::DEBUG::2014-05-16 17:47:32,602::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54646::DEBUG::2014-05-16 17:47:32,602::task::974::TaskManager.Task::(_decref) Task=`646565bc-248f-4339-8d9c-55856fa74f73`::ref 0 aborting False >Thread-54647::DEBUG::2014-05-16 17:47:32,612::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54647::DEBUG::2014-05-16 17:47:32,612::task::579::TaskManager.Task::(_updateState) Task=`2f79390f-9e54-4c28-a020-958ee9659ad3`::moving from state init -> state preparing >Thread-54647::INFO::2014-05-16 17:47:32,612::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54647::DEBUG::2014-05-16 17:47:32,612::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6acf2f37-2f88-4c14-b6c4-b2b61e470eab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54647::DEBUG::2014-05-16 17:47:32,613::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54647::DEBUG::2014-05-16 17:47:32,613::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54647::DEBUG::2014-05-16 17:47:32,613::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6acf2f37-2f88-4c14-b6c4-b2b61e470eab`::Granted request >Thread-54647::DEBUG::2014-05-16 17:47:32,613::task::811::TaskManager.Task::(resourceAcquired) Task=`2f79390f-9e54-4c28-a020-958ee9659ad3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54647::DEBUG::2014-05-16 17:47:32,613::task::974::TaskManager.Task::(_decref) Task=`2f79390f-9e54-4c28-a020-958ee9659ad3`::ref 1 aborting False >Thread-54647::INFO::2014-05-16 17:47:32,614::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54647::DEBUG::2014-05-16 17:47:32,614::task::1168::TaskManager.Task::(prepare) Task=`2f79390f-9e54-4c28-a020-958ee9659ad3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54647::DEBUG::2014-05-16 17:47:32,614::task::579::TaskManager.Task::(_updateState) Task=`2f79390f-9e54-4c28-a020-958ee9659ad3`::moving from state preparing -> state finished >Thread-54647::DEBUG::2014-05-16 17:47:32,614::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54647::DEBUG::2014-05-16 17:47:32,614::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54647::DEBUG::2014-05-16 17:47:32,615::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54647::DEBUG::2014-05-16 17:47:32,615::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54647::DEBUG::2014-05-16 17:47:32,615::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54647::DEBUG::2014-05-16 17:47:32,615::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54647::DEBUG::2014-05-16 17:47:32,615::task::974::TaskManager.Task::(_decref) Task=`2f79390f-9e54-4c28-a020-958ee9659ad3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:47:32,875::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:32,942::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303741 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:34,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:35,025::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351343 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:37,037::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:37,104::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313177 s, 32.7 MB/s\n'; <rc> = 0 >Thread-54649::DEBUG::2014-05-16 17:47:38,223::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5416386.000000 / 8.008459 / 262500000.000000 = 0.257651 >Thread-54649::DEBUG::2014-05-16 17:47:38,223::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065770455215244383, 'statsAge': 0.092586040496826172, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25765070650456856, 'rxDropped': 0} >Thread-54649::DEBUG::2014-05-16 17:47:38,224::task::579::TaskManager.Task::(_updateState) Task=`4d95b710-92e5-4c31-b1e5-315c38f9a3da`::moving from state init -> state preparing >Thread-54649::INFO::2014-05-16 17:47:38,224::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54649::INFO::2014-05-16 17:47:38,224::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105756', 'lastCheck': '8.2', 'valid': True}} >Thread-54649::DEBUG::2014-05-16 17:47:38,224::task::1168::TaskManager.Task::(prepare) Task=`4d95b710-92e5-4c31-b1e5-315c38f9a3da`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105756', 'lastCheck': '8.2', 'valid': True}} >Thread-54649::DEBUG::2014-05-16 17:47:38,224::task::579::TaskManager.Task::(_updateState) Task=`4d95b710-92e5-4c31-b1e5-315c38f9a3da`::moving from state preparing -> state finished >Thread-54649::DEBUG::2014-05-16 17:47:38,225::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54649::DEBUG::2014-05-16 17:47:38,225::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54649::DEBUG::2014-05-16 17:47:38,225::task::974::TaskManager.Task::(_decref) Task=`4d95b710-92e5-4c31-b1e5-315c38f9a3da`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:47:39,116::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:39,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308722 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:47:40,025::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:47:40,035::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00080913 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:41,194::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:41,266::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352069 s, 29.1 MB/s\n'; <rc> = 0 >Thread-54652::DEBUG::2014-05-16 17:47:42,644::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54652::DEBUG::2014-05-16 17:47:42,644::task::579::TaskManager.Task::(_updateState) Task=`f458038e-21c2-4517-aa12-0b135bfb4cd9`::moving from state init -> state preparing >Thread-54652::INFO::2014-05-16 17:47:42,645::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54652::INFO::2014-05-16 17:47:42,645::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54652::DEBUG::2014-05-16 17:47:42,645::task::1168::TaskManager.Task::(prepare) Task=`f458038e-21c2-4517-aa12-0b135bfb4cd9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54652::DEBUG::2014-05-16 17:47:42,645::task::579::TaskManager.Task::(_updateState) Task=`f458038e-21c2-4517-aa12-0b135bfb4cd9`::moving from state preparing -> state finished >Thread-54652::DEBUG::2014-05-16 17:47:42,645::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54652::DEBUG::2014-05-16 17:47:42,645::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54652::DEBUG::2014-05-16 17:47:42,646::task::974::TaskManager.Task::(_decref) Task=`f458038e-21c2-4517-aa12-0b135bfb4cd9`::ref 0 aborting False >Thread-54653::DEBUG::2014-05-16 17:47:42,654::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54653::DEBUG::2014-05-16 17:47:42,654::task::579::TaskManager.Task::(_updateState) Task=`b0460ff7-5bbe-4a4d-bef1-cf7f3e54dc91`::moving from state init -> state preparing >Thread-54653::INFO::2014-05-16 17:47:42,654::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54653::DEBUG::2014-05-16 17:47:42,655::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a5319d07-87c7-4aa7-89c8-8d5262aac475`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54653::DEBUG::2014-05-16 17:47:42,655::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54653::DEBUG::2014-05-16 17:47:42,655::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54653::DEBUG::2014-05-16 17:47:42,655::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a5319d07-87c7-4aa7-89c8-8d5262aac475`::Granted request >Thread-54653::DEBUG::2014-05-16 17:47:42,655::task::811::TaskManager.Task::(resourceAcquired) Task=`b0460ff7-5bbe-4a4d-bef1-cf7f3e54dc91`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54653::DEBUG::2014-05-16 17:47:42,656::task::974::TaskManager.Task::(_decref) Task=`b0460ff7-5bbe-4a4d-bef1-cf7f3e54dc91`::ref 1 aborting False >Thread-54653::INFO::2014-05-16 17:47:42,656::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54653::DEBUG::2014-05-16 17:47:42,656::task::1168::TaskManager.Task::(prepare) Task=`b0460ff7-5bbe-4a4d-bef1-cf7f3e54dc91`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54653::DEBUG::2014-05-16 17:47:42,656::task::579::TaskManager.Task::(_updateState) Task=`b0460ff7-5bbe-4a4d-bef1-cf7f3e54dc91`::moving from state preparing -> state finished >Thread-54653::DEBUG::2014-05-16 17:47:42,657::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54653::DEBUG::2014-05-16 17:47:42,657::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54653::DEBUG::2014-05-16 17:47:42,657::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54653::DEBUG::2014-05-16 17:47:42,657::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54653::DEBUG::2014-05-16 17:47:42,657::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54653::DEBUG::2014-05-16 17:47:42,657::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54653::DEBUG::2014-05-16 17:47:42,657::task::974::TaskManager.Task::(_decref) Task=`b0460ff7-5bbe-4a4d-bef1-cf7f3e54dc91`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:47:43,273::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:43,344::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347439 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:45,356::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:45,422::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306275 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:47,434::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:47,501::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309971 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:49,513::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:49,584::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347354 s, 29.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:47:50,073::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:47:50,083::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741239 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:51,595::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:51,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309325 s, 33.1 MB/s\n'; <rc> = 0 >Thread-54657::DEBUG::2014-05-16 17:47:52,688::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54657::DEBUG::2014-05-16 17:47:52,689::task::579::TaskManager.Task::(_updateState) Task=`a40625be-df75-4556-be37-cd5abe4556b9`::moving from state init -> state preparing >Thread-54657::INFO::2014-05-16 17:47:52,689::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54657::INFO::2014-05-16 17:47:52,689::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54657::DEBUG::2014-05-16 17:47:52,690::task::1168::TaskManager.Task::(prepare) Task=`a40625be-df75-4556-be37-cd5abe4556b9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54657::DEBUG::2014-05-16 17:47:52,690::task::579::TaskManager.Task::(_updateState) Task=`a40625be-df75-4556-be37-cd5abe4556b9`::moving from state preparing -> state finished >Thread-54657::DEBUG::2014-05-16 17:47:52,690::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54657::DEBUG::2014-05-16 17:47:52,690::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54657::DEBUG::2014-05-16 17:47:52,690::task::974::TaskManager.Task::(_decref) Task=`a40625be-df75-4556-be37-cd5abe4556b9`::ref 0 aborting False >Thread-54658::DEBUG::2014-05-16 17:47:52,699::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54658::DEBUG::2014-05-16 17:47:52,699::task::579::TaskManager.Task::(_updateState) Task=`19c816ab-f2d9-45df-850f-0aa6aab373da`::moving from state init -> state preparing >Thread-54658::INFO::2014-05-16 17:47:52,700::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54658::DEBUG::2014-05-16 17:47:52,700::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d116c861-49a3-43ce-a52f-c06fe74e0b78`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54658::DEBUG::2014-05-16 17:47:52,700::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54658::DEBUG::2014-05-16 17:47:52,700::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54658::DEBUG::2014-05-16 17:47:52,701::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d116c861-49a3-43ce-a52f-c06fe74e0b78`::Granted request >Thread-54658::DEBUG::2014-05-16 17:47:52,701::task::811::TaskManager.Task::(resourceAcquired) Task=`19c816ab-f2d9-45df-850f-0aa6aab373da`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54658::DEBUG::2014-05-16 17:47:52,701::task::974::TaskManager.Task::(_decref) Task=`19c816ab-f2d9-45df-850f-0aa6aab373da`::ref 1 aborting False >Thread-54658::INFO::2014-05-16 17:47:52,702::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54658::DEBUG::2014-05-16 17:47:52,702::task::1168::TaskManager.Task::(prepare) Task=`19c816ab-f2d9-45df-850f-0aa6aab373da`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54658::DEBUG::2014-05-16 17:47:52,702::task::579::TaskManager.Task::(_updateState) Task=`19c816ab-f2d9-45df-850f-0aa6aab373da`::moving from state preparing -> state finished >Thread-54658::DEBUG::2014-05-16 17:47:52,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54658::DEBUG::2014-05-16 17:47:52,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54658::DEBUG::2014-05-16 17:47:52,703::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54658::DEBUG::2014-05-16 17:47:52,703::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54658::DEBUG::2014-05-16 17:47:52,703::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54658::DEBUG::2014-05-16 17:47:52,703::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54658::DEBUG::2014-05-16 17:47:52,703::task::974::TaskManager.Task::(_decref) Task=`19c816ab-f2d9-45df-850f-0aa6aab373da`::ref 0 aborting False >Thread-54659::DEBUG::2014-05-16 17:47:53,372::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314104.000000 / 8.008953 / 262500000.000000 = 0.205204 >Thread-54659::DEBUG::2014-05-16 17:47:53,372::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051094247118683347, 'statsAge': 1.2267220020294189, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20520387260207815, 'rxDropped': 0} >Thread-54659::DEBUG::2014-05-16 17:47:53,373::task::579::TaskManager.Task::(_updateState) Task=`b6693c95-1ea8-43c4-8e76-0f8a04b83289`::moving from state init -> state preparing >Thread-54659::INFO::2014-05-16 17:47:53,373::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54659::INFO::2014-05-16 17:47:53,373::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741239', 'lastCheck': '3.3', 'valid': True}} >Thread-54659::DEBUG::2014-05-16 17:47:53,373::task::1168::TaskManager.Task::(prepare) Task=`b6693c95-1ea8-43c4-8e76-0f8a04b83289`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741239', 'lastCheck': '3.3', 'valid': True}} >Thread-54659::DEBUG::2014-05-16 17:47:53,374::task::579::TaskManager.Task::(_updateState) Task=`b6693c95-1ea8-43c4-8e76-0f8a04b83289`::moving from state preparing -> state finished >Thread-54659::DEBUG::2014-05-16 17:47:53,374::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54659::DEBUG::2014-05-16 17:47:53,374::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54659::DEBUG::2014-05-16 17:47:53,374::task::974::TaskManager.Task::(_decref) Task=`b6693c95-1ea8-43c4-8e76-0f8a04b83289`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:47:53,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:53,740::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307899 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:55,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:55,823::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352177 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:57,835::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:57,901::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305211 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:47:59,913::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:47:59,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030744 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:48:00,121::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:48:00,131::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000797189 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:01,991::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:02,063::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358092 s, 28.6 MB/s\n'; <rc> = 0 >Thread-54664::DEBUG::2014-05-16 17:48:02,747::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54664::DEBUG::2014-05-16 17:48:02,747::task::579::TaskManager.Task::(_updateState) Task=`1b79aa55-211e-4f2a-9055-7fc70fa9f0bb`::moving from state init -> state preparing >Thread-54664::INFO::2014-05-16 17:48:02,747::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54664::INFO::2014-05-16 17:48:02,748::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54664::DEBUG::2014-05-16 17:48:02,748::task::1168::TaskManager.Task::(prepare) Task=`1b79aa55-211e-4f2a-9055-7fc70fa9f0bb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54664::DEBUG::2014-05-16 17:48:02,748::task::579::TaskManager.Task::(_updateState) Task=`1b79aa55-211e-4f2a-9055-7fc70fa9f0bb`::moving from state preparing -> state finished >Thread-54664::DEBUG::2014-05-16 17:48:02,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54664::DEBUG::2014-05-16 17:48:02,748::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54664::DEBUG::2014-05-16 17:48:02,748::task::974::TaskManager.Task::(_decref) Task=`1b79aa55-211e-4f2a-9055-7fc70fa9f0bb`::ref 0 aborting False >Thread-54665::DEBUG::2014-05-16 17:48:02,758::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54665::DEBUG::2014-05-16 17:48:02,758::task::579::TaskManager.Task::(_updateState) Task=`40d9271a-bc77-4751-81b3-5e449ad56167`::moving from state init -> state preparing >Thread-54665::INFO::2014-05-16 17:48:02,758::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54665::DEBUG::2014-05-16 17:48:02,759::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`61fad266-9123-4d9c-b89b-9c146591e993`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54665::DEBUG::2014-05-16 17:48:02,759::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54665::DEBUG::2014-05-16 17:48:02,759::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54665::DEBUG::2014-05-16 17:48:02,759::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`61fad266-9123-4d9c-b89b-9c146591e993`::Granted request >Thread-54665::DEBUG::2014-05-16 17:48:02,760::task::811::TaskManager.Task::(resourceAcquired) Task=`40d9271a-bc77-4751-81b3-5e449ad56167`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54665::DEBUG::2014-05-16 17:48:02,760::task::974::TaskManager.Task::(_decref) Task=`40d9271a-bc77-4751-81b3-5e449ad56167`::ref 1 aborting False >Thread-54665::INFO::2014-05-16 17:48:02,760::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54665::DEBUG::2014-05-16 17:48:02,760::task::1168::TaskManager.Task::(prepare) Task=`40d9271a-bc77-4751-81b3-5e449ad56167`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54665::DEBUG::2014-05-16 17:48:02,761::task::579::TaskManager.Task::(_updateState) Task=`40d9271a-bc77-4751-81b3-5e449ad56167`::moving from state preparing -> state finished >Thread-54665::DEBUG::2014-05-16 17:48:02,761::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54665::DEBUG::2014-05-16 17:48:02,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54665::DEBUG::2014-05-16 17:48:02,761::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54665::DEBUG::2014-05-16 17:48:02,761::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54665::DEBUG::2014-05-16 17:48:02,761::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54665::DEBUG::2014-05-16 17:48:02,762::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54665::DEBUG::2014-05-16 17:48:02,762::task::974::TaskManager.Task::(_decref) Task=`40d9271a-bc77-4751-81b3-5e449ad56167`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:48:04,075::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:04,146::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348134 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:06,158::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:06,225::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314692 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:08,237::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:08,313::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0434439 s, 23.6 MB/s\n'; <rc> = 0 >Thread-54667::DEBUG::2014-05-16 17:48:08,514::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319352.000000 / 8.013734 / 262500000.000000 = 0.205331 >Thread-54667::DEBUG::2014-05-16 17:48:08,514::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005320865494729328, 'statsAge': 0.34667301177978516, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20533093019199603, 'rxDropped': 0} >Thread-54667::DEBUG::2014-05-16 17:48:08,516::task::579::TaskManager.Task::(_updateState) Task=`c8a2f30e-324c-4403-8f61-58e1267b0829`::moving from state init -> state preparing >Thread-54667::INFO::2014-05-16 17:48:08,516::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54667::INFO::2014-05-16 17:48:08,516::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797189', 'lastCheck': '8.4', 'valid': True}} >Thread-54667::DEBUG::2014-05-16 17:48:08,516::task::1168::TaskManager.Task::(prepare) Task=`c8a2f30e-324c-4403-8f61-58e1267b0829`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797189', 'lastCheck': '8.4', 'valid': True}} >Thread-54667::DEBUG::2014-05-16 17:48:08,516::task::579::TaskManager.Task::(_updateState) Task=`c8a2f30e-324c-4403-8f61-58e1267b0829`::moving from state preparing -> state finished >Thread-54667::DEBUG::2014-05-16 17:48:08,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54667::DEBUG::2014-05-16 17:48:08,517::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54667::DEBUG::2014-05-16 17:48:08,517::task::974::TaskManager.Task::(_decref) Task=`c8a2f30e-324c-4403-8f61-58e1267b0829`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:48:10,166::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:48:10,179::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111922 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:10,320::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:10,391::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354872 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:12,403::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:12,470::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312194 s, 32.8 MB/s\n'; <rc> = 0 >Thread-54670::DEBUG::2014-05-16 17:48:12,797::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54670::DEBUG::2014-05-16 17:48:12,797::task::579::TaskManager.Task::(_updateState) Task=`8824c735-22b6-4069-a428-f0f39ec10038`::moving from state init -> state preparing >Thread-54670::INFO::2014-05-16 17:48:12,797::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54670::INFO::2014-05-16 17:48:12,798::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54670::DEBUG::2014-05-16 17:48:12,798::task::1168::TaskManager.Task::(prepare) Task=`8824c735-22b6-4069-a428-f0f39ec10038`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54670::DEBUG::2014-05-16 17:48:12,798::task::579::TaskManager.Task::(_updateState) Task=`8824c735-22b6-4069-a428-f0f39ec10038`::moving from state preparing -> state finished >Thread-54670::DEBUG::2014-05-16 17:48:12,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54670::DEBUG::2014-05-16 17:48:12,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54670::DEBUG::2014-05-16 17:48:12,798::task::974::TaskManager.Task::(_decref) Task=`8824c735-22b6-4069-a428-f0f39ec10038`::ref 0 aborting False >Thread-54671::DEBUG::2014-05-16 17:48:12,807::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54671::DEBUG::2014-05-16 17:48:12,807::task::579::TaskManager.Task::(_updateState) Task=`a8b4685a-28ab-4c80-a299-f07211f26114`::moving from state init -> state preparing >Thread-54671::INFO::2014-05-16 17:48:12,807::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54671::DEBUG::2014-05-16 17:48:12,808::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`61894481-1451-4df3-a823-1557e27a296b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54671::DEBUG::2014-05-16 17:48:12,808::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54671::DEBUG::2014-05-16 17:48:12,808::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54671::DEBUG::2014-05-16 17:48:12,808::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`61894481-1451-4df3-a823-1557e27a296b`::Granted request >Thread-54671::DEBUG::2014-05-16 17:48:12,809::task::811::TaskManager.Task::(resourceAcquired) Task=`a8b4685a-28ab-4c80-a299-f07211f26114`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54671::DEBUG::2014-05-16 17:48:12,809::task::974::TaskManager.Task::(_decref) Task=`a8b4685a-28ab-4c80-a299-f07211f26114`::ref 1 aborting False >Thread-54671::INFO::2014-05-16 17:48:12,810::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54671::DEBUG::2014-05-16 17:48:12,810::task::1168::TaskManager.Task::(prepare) Task=`a8b4685a-28ab-4c80-a299-f07211f26114`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54671::DEBUG::2014-05-16 17:48:12,810::task::579::TaskManager.Task::(_updateState) Task=`a8b4685a-28ab-4c80-a299-f07211f26114`::moving from state preparing -> state finished >Thread-54671::DEBUG::2014-05-16 17:48:12,810::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54671::DEBUG::2014-05-16 17:48:12,810::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54671::DEBUG::2014-05-16 17:48:12,810::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54671::DEBUG::2014-05-16 17:48:12,811::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54671::DEBUG::2014-05-16 17:48:12,811::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54671::DEBUG::2014-05-16 17:48:12,811::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54671::DEBUG::2014-05-16 17:48:12,811::task::974::TaskManager.Task::(_decref) Task=`a8b4685a-28ab-4c80-a299-f07211f26114`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:48:14,481::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:14,548::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304834 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:16,559::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:16,631::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357222 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:18,643::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:18,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357833 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:48:20,215::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:48:20,226::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00099824 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:20,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:20,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310858 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:22,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54675::DEBUG::2014-05-16 17:48:22,844::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54675::DEBUG::2014-05-16 17:48:22,846::task::579::TaskManager.Task::(_updateState) Task=`bb301db1-db44-4625-8c8e-a39b8de10cf8`::moving from state init -> state preparing >Thread-54675::INFO::2014-05-16 17:48:22,847::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54675::INFO::2014-05-16 17:48:22,848::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54675::DEBUG::2014-05-16 17:48:22,849::task::1168::TaskManager.Task::(prepare) Task=`bb301db1-db44-4625-8c8e-a39b8de10cf8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54675::DEBUG::2014-05-16 17:48:22,850::task::579::TaskManager.Task::(_updateState) Task=`bb301db1-db44-4625-8c8e-a39b8de10cf8`::moving from state preparing -> state finished >Thread-54675::DEBUG::2014-05-16 17:48:22,851::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54675::DEBUG::2014-05-16 17:48:22,852::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54675::DEBUG::2014-05-16 17:48:22,853::task::974::TaskManager.Task::(_decref) Task=`bb301db1-db44-4625-8c8e-a39b8de10cf8`::ref 0 aborting False >Thread-54676::DEBUG::2014-05-16 17:48:22,866::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54676::DEBUG::2014-05-16 17:48:22,868::task::579::TaskManager.Task::(_updateState) Task=`98ba9d5f-8ffb-417d-9606-52cb7e584ad0`::moving from state init -> state preparing >Thread-54676::INFO::2014-05-16 17:48:22,869::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54676::DEBUG::2014-05-16 17:48:22,871::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`46341a5d-0e79-4849-9354-78cc4773ac5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54676::DEBUG::2014-05-16 17:48:22,872::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54676::DEBUG::2014-05-16 17:48:22,874::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54676::DEBUG::2014-05-16 17:48:22,875::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`46341a5d-0e79-4849-9354-78cc4773ac5f`::Granted request >Thread-54676::DEBUG::2014-05-16 17:48:22,877::task::811::TaskManager.Task::(resourceAcquired) Task=`98ba9d5f-8ffb-417d-9606-52cb7e584ad0`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54676::DEBUG::2014-05-16 17:48:22,878::task::974::TaskManager.Task::(_decref) Task=`98ba9d5f-8ffb-417d-9606-52cb7e584ad0`::ref 1 aborting False >Thread-54676::INFO::2014-05-16 17:48:22,882::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54676::DEBUG::2014-05-16 17:48:22,883::task::1168::TaskManager.Task::(prepare) Task=`98ba9d5f-8ffb-417d-9606-52cb7e584ad0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54676::DEBUG::2014-05-16 17:48:22,884::task::579::TaskManager.Task::(_updateState) Task=`98ba9d5f-8ffb-417d-9606-52cb7e584ad0`::moving from state preparing -> state finished >Thread-54676::DEBUG::2014-05-16 17:48:22,885::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54676::DEBUG::2014-05-16 17:48:22,886::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54676::DEBUG::2014-05-16 17:48:22,887::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54676::DEBUG::2014-05-16 17:48:22,888::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54676::DEBUG::2014-05-16 17:48:22,889::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54676::DEBUG::2014-05-16 17:48:22,890::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54676::DEBUG::2014-05-16 17:48:22,891::task::974::TaskManager.Task::(_decref) Task=`98ba9d5f-8ffb-417d-9606-52cb7e584ad0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:48:22,922::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0511779 s, 20.0 MB/s\n'; <rc> = 0 >Thread-54677::DEBUG::2014-05-16 17:48:23,654::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314776.000000 / 8.008329 / 262500000.000000 = 0.205252 >Thread-54677::DEBUG::2014-05-16 17:48:23,655::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051008798770533796, 'statsAge': 1.4667971134185791, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2052518331846766, 'rxDropped': 0} >Thread-54677::DEBUG::2014-05-16 17:48:23,656::task::579::TaskManager.Task::(_updateState) Task=`69f9dc3a-68e4-4884-a452-6ccacdb03169`::moving from state init -> state preparing >Thread-54677::INFO::2014-05-16 17:48:23,656::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54677::INFO::2014-05-16 17:48:23,656::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00099824', 'lastCheck': '3.4', 'valid': True}} >Thread-54677::DEBUG::2014-05-16 17:48:23,656::task::1168::TaskManager.Task::(prepare) Task=`69f9dc3a-68e4-4884-a452-6ccacdb03169`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00099824', 'lastCheck': '3.4', 'valid': True}} >Thread-54677::DEBUG::2014-05-16 17:48:23,656::task::579::TaskManager.Task::(_updateState) Task=`69f9dc3a-68e4-4884-a452-6ccacdb03169`::moving from state preparing -> state finished >Thread-54677::DEBUG::2014-05-16 17:48:23,657::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54677::DEBUG::2014-05-16 17:48:23,657::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54677::DEBUG::2014-05-16 17:48:23,657::task::974::TaskManager.Task::(_decref) Task=`69f9dc3a-68e4-4884-a452-6ccacdb03169`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:48:24,934::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:25,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350263 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:27,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:27,083::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316496 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:29,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:29,167::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352814 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:48:30,260::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:48:30,270::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000844225 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:31,179::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:31,250::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355525 s, 28.8 MB/s\n'; <rc> = 0 >Thread-54682::DEBUG::2014-05-16 17:48:32,930::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54682::DEBUG::2014-05-16 17:48:32,930::task::579::TaskManager.Task::(_updateState) Task=`41733054-0e6d-4924-aef1-b2fe9fa68366`::moving from state init -> state preparing >Thread-54682::INFO::2014-05-16 17:48:32,930::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54682::INFO::2014-05-16 17:48:32,931::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54682::DEBUG::2014-05-16 17:48:32,931::task::1168::TaskManager.Task::(prepare) Task=`41733054-0e6d-4924-aef1-b2fe9fa68366`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54682::DEBUG::2014-05-16 17:48:32,931::task::579::TaskManager.Task::(_updateState) Task=`41733054-0e6d-4924-aef1-b2fe9fa68366`::moving from state preparing -> state finished >Thread-54682::DEBUG::2014-05-16 17:48:32,931::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54682::DEBUG::2014-05-16 17:48:32,931::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54682::DEBUG::2014-05-16 17:48:32,931::task::974::TaskManager.Task::(_decref) Task=`41733054-0e6d-4924-aef1-b2fe9fa68366`::ref 0 aborting False >Thread-54683::DEBUG::2014-05-16 17:48:32,942::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54683::DEBUG::2014-05-16 17:48:32,942::task::579::TaskManager.Task::(_updateState) Task=`b68b41ab-5e42-4167-b8ff-89d93c024ff1`::moving from state init -> state preparing >Thread-54683::INFO::2014-05-16 17:48:32,942::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54683::DEBUG::2014-05-16 17:48:32,942::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2bfba32c-5cd4-421e-b7dd-9a19432b10e4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54683::DEBUG::2014-05-16 17:48:32,942::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54683::DEBUG::2014-05-16 17:48:32,943::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54683::DEBUG::2014-05-16 17:48:32,943::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2bfba32c-5cd4-421e-b7dd-9a19432b10e4`::Granted request >Thread-54683::DEBUG::2014-05-16 17:48:32,943::task::811::TaskManager.Task::(resourceAcquired) Task=`b68b41ab-5e42-4167-b8ff-89d93c024ff1`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54683::DEBUG::2014-05-16 17:48:32,943::task::974::TaskManager.Task::(_decref) Task=`b68b41ab-5e42-4167-b8ff-89d93c024ff1`::ref 1 aborting False >Thread-54683::INFO::2014-05-16 17:48:32,944::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54683::DEBUG::2014-05-16 17:48:32,944::task::1168::TaskManager.Task::(prepare) Task=`b68b41ab-5e42-4167-b8ff-89d93c024ff1`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54683::DEBUG::2014-05-16 17:48:32,944::task::579::TaskManager.Task::(_updateState) Task=`b68b41ab-5e42-4167-b8ff-89d93c024ff1`::moving from state preparing -> state finished >Thread-54683::DEBUG::2014-05-16 17:48:32,944::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54683::DEBUG::2014-05-16 17:48:32,944::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54683::DEBUG::2014-05-16 17:48:32,945::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54683::DEBUG::2014-05-16 17:48:32,945::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54683::DEBUG::2014-05-16 17:48:32,945::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54683::DEBUG::2014-05-16 17:48:32,945::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54683::DEBUG::2014-05-16 17:48:32,945::task::974::TaskManager.Task::(_decref) Task=`b68b41ab-5e42-4167-b8ff-89d93c024ff1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:48:33,262::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:33,328::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306037 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:35,340::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:35,407::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030997 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:37,419::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:37,490::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355725 s, 28.8 MB/s\n'; <rc> = 0 >Thread-54685::DEBUG::2014-05-16 17:48:38,827::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5417493.000000 / 8.008327 / 262500000.000000 = 0.257708 >Thread-54685::DEBUG::2014-05-16 17:48:38,827::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.006868374683762864, 'statsAge': 0.62277793884277344, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25770761549362498, 'rxDropped': 0} >Thread-54685::DEBUG::2014-05-16 17:48:38,828::task::579::TaskManager.Task::(_updateState) Task=`e3861c7c-5b96-4df7-a686-ad5c84fb0256`::moving from state init -> state preparing >Thread-54685::INFO::2014-05-16 17:48:38,828::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54685::INFO::2014-05-16 17:48:38,828::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000844225', 'lastCheck': '8.5', 'valid': True}} >Thread-54685::DEBUG::2014-05-16 17:48:38,829::task::1168::TaskManager.Task::(prepare) Task=`e3861c7c-5b96-4df7-a686-ad5c84fb0256`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000844225', 'lastCheck': '8.5', 'valid': True}} >Thread-54685::DEBUG::2014-05-16 17:48:38,829::task::579::TaskManager.Task::(_updateState) Task=`e3861c7c-5b96-4df7-a686-ad5c84fb0256`::moving from state preparing -> state finished >Thread-54685::DEBUG::2014-05-16 17:48:38,829::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54685::DEBUG::2014-05-16 17:48:38,829::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54685::DEBUG::2014-05-16 17:48:38,829::task::974::TaskManager.Task::(_decref) Task=`e3861c7c-5b96-4df7-a686-ad5c84fb0256`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:48:39,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:39,573::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356112 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:48:40,308::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:48:40,319::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000824673 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:41,585::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:41,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311024 s, 32.9 MB/s\n'; <rc> = 0 >Thread-54688::DEBUG::2014-05-16 17:48:42,975::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54688::DEBUG::2014-05-16 17:48:42,975::task::579::TaskManager.Task::(_updateState) Task=`259ff343-e8b8-4305-9bbd-82713f7b4ff7`::moving from state init -> state preparing >Thread-54688::INFO::2014-05-16 17:48:42,976::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54688::INFO::2014-05-16 17:48:42,976::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54688::DEBUG::2014-05-16 17:48:42,976::task::1168::TaskManager.Task::(prepare) Task=`259ff343-e8b8-4305-9bbd-82713f7b4ff7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54688::DEBUG::2014-05-16 17:48:42,976::task::579::TaskManager.Task::(_updateState) Task=`259ff343-e8b8-4305-9bbd-82713f7b4ff7`::moving from state preparing -> state finished >Thread-54688::DEBUG::2014-05-16 17:48:42,976::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54688::DEBUG::2014-05-16 17:48:42,976::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54688::DEBUG::2014-05-16 17:48:42,977::task::974::TaskManager.Task::(_decref) Task=`259ff343-e8b8-4305-9bbd-82713f7b4ff7`::ref 0 aborting False >Thread-54689::DEBUG::2014-05-16 17:48:42,986::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54689::DEBUG::2014-05-16 17:48:42,986::task::579::TaskManager.Task::(_updateState) Task=`6723eab3-1706-468e-8aac-f232d1092d15`::moving from state init -> state preparing >Thread-54689::INFO::2014-05-16 17:48:42,986::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54689::DEBUG::2014-05-16 17:48:42,986::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e7e9ba5a-cd7b-4cd0-8226-e6335aaf7def`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54689::DEBUG::2014-05-16 17:48:42,987::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54689::DEBUG::2014-05-16 17:48:42,987::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54689::DEBUG::2014-05-16 17:48:42,987::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e7e9ba5a-cd7b-4cd0-8226-e6335aaf7def`::Granted request >Thread-54689::DEBUG::2014-05-16 17:48:42,987::task::811::TaskManager.Task::(resourceAcquired) Task=`6723eab3-1706-468e-8aac-f232d1092d15`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54689::DEBUG::2014-05-16 17:48:42,987::task::974::TaskManager.Task::(_decref) Task=`6723eab3-1706-468e-8aac-f232d1092d15`::ref 1 aborting False >Thread-54689::INFO::2014-05-16 17:48:42,988::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54689::DEBUG::2014-05-16 17:48:42,988::task::1168::TaskManager.Task::(prepare) Task=`6723eab3-1706-468e-8aac-f232d1092d15`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54689::DEBUG::2014-05-16 17:48:42,988::task::579::TaskManager.Task::(_updateState) Task=`6723eab3-1706-468e-8aac-f232d1092d15`::moving from state preparing -> state finished >Thread-54689::DEBUG::2014-05-16 17:48:42,989::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54689::DEBUG::2014-05-16 17:48:42,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54689::DEBUG::2014-05-16 17:48:42,989::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54689::DEBUG::2014-05-16 17:48:42,989::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54689::DEBUG::2014-05-16 17:48:42,989::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54689::DEBUG::2014-05-16 17:48:42,989::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54689::DEBUG::2014-05-16 17:48:42,990::task::974::TaskManager.Task::(_decref) Task=`6723eab3-1706-468e-8aac-f232d1092d15`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:48:43,664::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:43,735::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358654 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:45,747::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:45,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313066 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:47,826::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:47,892::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305628 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:49,903::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:49,974::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03523 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:48:50,352::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:48:50,362::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000791356 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:51,985::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:52,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357732 s, 28.6 MB/s\n'; <rc> = 0 >Thread-54693::DEBUG::2014-05-16 17:48:53,042::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54693::DEBUG::2014-05-16 17:48:53,042::task::579::TaskManager.Task::(_updateState) Task=`a4a9b4ef-7a13-4498-b39b-818b3bc75dba`::moving from state init -> state preparing >Thread-54693::INFO::2014-05-16 17:48:53,043::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54693::INFO::2014-05-16 17:48:53,043::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54693::DEBUG::2014-05-16 17:48:53,043::task::1168::TaskManager.Task::(prepare) Task=`a4a9b4ef-7a13-4498-b39b-818b3bc75dba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54693::DEBUG::2014-05-16 17:48:53,043::task::579::TaskManager.Task::(_updateState) Task=`a4a9b4ef-7a13-4498-b39b-818b3bc75dba`::moving from state preparing -> state finished >Thread-54693::DEBUG::2014-05-16 17:48:53,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54693::DEBUG::2014-05-16 17:48:53,044::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54693::DEBUG::2014-05-16 17:48:53,044::task::974::TaskManager.Task::(_decref) Task=`a4a9b4ef-7a13-4498-b39b-818b3bc75dba`::ref 0 aborting False >Thread-54694::DEBUG::2014-05-16 17:48:53,053::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54694::DEBUG::2014-05-16 17:48:53,053::task::579::TaskManager.Task::(_updateState) Task=`f44990cd-5254-4cb1-8a08-71884b048668`::moving from state init -> state preparing >Thread-54694::INFO::2014-05-16 17:48:53,053::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54694::DEBUG::2014-05-16 17:48:53,054::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dc1af6c6-d597-4c5b-ab8c-a2f2dd76ebe2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54694::DEBUG::2014-05-16 17:48:53,054::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54694::DEBUG::2014-05-16 17:48:53,054::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54694::DEBUG::2014-05-16 17:48:53,054::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dc1af6c6-d597-4c5b-ab8c-a2f2dd76ebe2`::Granted request >Thread-54694::DEBUG::2014-05-16 17:48:53,055::task::811::TaskManager.Task::(resourceAcquired) Task=`f44990cd-5254-4cb1-8a08-71884b048668`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54694::DEBUG::2014-05-16 17:48:53,055::task::974::TaskManager.Task::(_decref) Task=`f44990cd-5254-4cb1-8a08-71884b048668`::ref 1 aborting False >Thread-54694::INFO::2014-05-16 17:48:53,055::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54694::DEBUG::2014-05-16 17:48:53,056::task::1168::TaskManager.Task::(prepare) Task=`f44990cd-5254-4cb1-8a08-71884b048668`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54694::DEBUG::2014-05-16 17:48:53,056::task::579::TaskManager.Task::(_updateState) Task=`f44990cd-5254-4cb1-8a08-71884b048668`::moving from state preparing -> state finished >Thread-54694::DEBUG::2014-05-16 17:48:53,056::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54694::DEBUG::2014-05-16 17:48:53,056::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54694::DEBUG::2014-05-16 17:48:53,056::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54694::DEBUG::2014-05-16 17:48:53,056::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54694::DEBUG::2014-05-16 17:48:53,057::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54694::DEBUG::2014-05-16 17:48:53,057::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54694::DEBUG::2014-05-16 17:48:53,057::task::974::TaskManager.Task::(_decref) Task=`f44990cd-5254-4cb1-8a08-71884b048668`::ref 0 aborting False >Thread-54695::DEBUG::2014-05-16 17:48:53,975::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3243884.000000 / 8.008509 / 262500000.000000 = 0.154307 >Thread-54695::DEBUG::2014-05-16 17:48:53,976::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0039227800529180821, 'statsAge': 1.7562601566314697, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15430654389906287, 'rxDropped': 0} >Thread-54695::DEBUG::2014-05-16 17:48:53,976::task::579::TaskManager.Task::(_updateState) Task=`1f52febb-6d6a-48bb-8a0b-521e949d5b04`::moving from state init -> state preparing >Thread-54695::INFO::2014-05-16 17:48:53,976::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54695::INFO::2014-05-16 17:48:53,977::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000791356', 'lastCheck': '3.6', 'valid': True}} >Thread-54695::DEBUG::2014-05-16 17:48:53,977::task::1168::TaskManager.Task::(prepare) Task=`1f52febb-6d6a-48bb-8a0b-521e949d5b04`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000791356', 'lastCheck': '3.6', 'valid': True}} >Thread-54695::DEBUG::2014-05-16 17:48:53,977::task::579::TaskManager.Task::(_updateState) Task=`1f52febb-6d6a-48bb-8a0b-521e949d5b04`::moving from state preparing -> state finished >Thread-54695::DEBUG::2014-05-16 17:48:53,977::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54695::DEBUG::2014-05-16 17:48:53,977::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54695::DEBUG::2014-05-16 17:48:53,977::task::974::TaskManager.Task::(_decref) Task=`1f52febb-6d6a-48bb-8a0b-521e949d5b04`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:48:54,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:54,140::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356933 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:56,151::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:56,228::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362342 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:48:58,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:48:58,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308415 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:00,318::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:00,431::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311681 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:49:00,528::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:49:00,558::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067784 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:02,691::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:02,758::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315681 s, 32.4 MB/s\n'; <rc> = 0 >Thread-54700::DEBUG::2014-05-16 17:49:03,097::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54700::DEBUG::2014-05-16 17:49:03,098::task::579::TaskManager.Task::(_updateState) Task=`bfa9b4c0-365d-447d-9c2b-a0c3f2104663`::moving from state init -> state preparing >Thread-54700::INFO::2014-05-16 17:49:03,098::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54700::INFO::2014-05-16 17:49:03,098::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54700::DEBUG::2014-05-16 17:49:03,098::task::1168::TaskManager.Task::(prepare) Task=`bfa9b4c0-365d-447d-9c2b-a0c3f2104663`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54700::DEBUG::2014-05-16 17:49:03,098::task::579::TaskManager.Task::(_updateState) Task=`bfa9b4c0-365d-447d-9c2b-a0c3f2104663`::moving from state preparing -> state finished >Thread-54700::DEBUG::2014-05-16 17:49:03,099::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54700::DEBUG::2014-05-16 17:49:03,099::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54700::DEBUG::2014-05-16 17:49:03,099::task::974::TaskManager.Task::(_decref) Task=`bfa9b4c0-365d-447d-9c2b-a0c3f2104663`::ref 0 aborting False >Thread-54701::DEBUG::2014-05-16 17:49:03,107::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54701::DEBUG::2014-05-16 17:49:03,107::task::579::TaskManager.Task::(_updateState) Task=`c4937a4f-c1bd-4bf6-a006-27d31c0a9694`::moving from state init -> state preparing >Thread-54701::INFO::2014-05-16 17:49:03,107::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54701::DEBUG::2014-05-16 17:49:03,108::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`96b7c2a5-30f0-49e3-bbe4-2d93ce5f228e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54701::DEBUG::2014-05-16 17:49:03,108::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54701::DEBUG::2014-05-16 17:49:03,108::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54701::DEBUG::2014-05-16 17:49:03,108::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`96b7c2a5-30f0-49e3-bbe4-2d93ce5f228e`::Granted request >Thread-54701::DEBUG::2014-05-16 17:49:03,109::task::811::TaskManager.Task::(resourceAcquired) Task=`c4937a4f-c1bd-4bf6-a006-27d31c0a9694`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54701::DEBUG::2014-05-16 17:49:03,109::task::974::TaskManager.Task::(_decref) Task=`c4937a4f-c1bd-4bf6-a006-27d31c0a9694`::ref 1 aborting False >Thread-54701::INFO::2014-05-16 17:49:03,109::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54701::DEBUG::2014-05-16 17:49:03,110::task::1168::TaskManager.Task::(prepare) Task=`c4937a4f-c1bd-4bf6-a006-27d31c0a9694`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54701::DEBUG::2014-05-16 17:49:03,110::task::579::TaskManager.Task::(_updateState) Task=`c4937a4f-c1bd-4bf6-a006-27d31c0a9694`::moving from state preparing -> state finished >Thread-54701::DEBUG::2014-05-16 17:49:03,110::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54701::DEBUG::2014-05-16 17:49:03,110::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54701::DEBUG::2014-05-16 17:49:03,110::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54701::DEBUG::2014-05-16 17:49:03,110::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54701::DEBUG::2014-05-16 17:49:03,111::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54701::DEBUG::2014-05-16 17:49:03,111::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54701::DEBUG::2014-05-16 17:49:03,111::task::974::TaskManager.Task::(_decref) Task=`c4937a4f-c1bd-4bf6-a006-27d31c0a9694`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:49:04,769::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:04,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347527 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:06,851::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:06,918::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315354 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:08,930::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:09,001::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350045 s, 29.3 MB/s\n'; <rc> = 0 >Thread-54703::DEBUG::2014-05-16 17:49:09,132::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317971.000000 / 8.008042 / 262500000.000000 = 0.205411 >Thread-54703::DEBUG::2014-05-16 17:49:09,132::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005383445369063925, 'statsAge': 0.89385390281677246, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20541117459044525, 'rxDropped': 0} >Thread-54703::DEBUG::2014-05-16 17:49:09,133::task::579::TaskManager.Task::(_updateState) Task=`76c8beaa-ffb6-4c52-8a08-e2b35e3f2dca`::moving from state init -> state preparing >Thread-54703::INFO::2014-05-16 17:49:09,133::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54703::INFO::2014-05-16 17:49:09,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067784', 'lastCheck': '8.4', 'valid': True}} >Thread-54703::DEBUG::2014-05-16 17:49:09,134::task::1168::TaskManager.Task::(prepare) Task=`76c8beaa-ffb6-4c52-8a08-e2b35e3f2dca`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067784', 'lastCheck': '8.4', 'valid': True}} >Thread-54703::DEBUG::2014-05-16 17:49:09,134::task::579::TaskManager.Task::(_updateState) Task=`76c8beaa-ffb6-4c52-8a08-e2b35e3f2dca`::moving from state preparing -> state finished >Thread-54703::DEBUG::2014-05-16 17:49:09,134::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54703::DEBUG::2014-05-16 17:49:09,134::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54703::DEBUG::2014-05-16 17:49:09,134::task::974::TaskManager.Task::(_decref) Task=`76c8beaa-ffb6-4c52-8a08-e2b35e3f2dca`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:49:10,707::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:49:10,718::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110528 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:11,012::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:11,084::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357153 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:13,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54706::DEBUG::2014-05-16 17:49:13,142::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54706::DEBUG::2014-05-16 17:49:13,144::task::579::TaskManager.Task::(_updateState) Task=`eded15ef-5e8d-4e54-91c0-d062bbf65d06`::moving from state init -> state preparing >Thread-54706::INFO::2014-05-16 17:49:13,145::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54706::INFO::2014-05-16 17:49:13,146::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54706::DEBUG::2014-05-16 17:49:13,147::task::1168::TaskManager.Task::(prepare) Task=`eded15ef-5e8d-4e54-91c0-d062bbf65d06`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54706::DEBUG::2014-05-16 17:49:13,148::task::579::TaskManager.Task::(_updateState) Task=`eded15ef-5e8d-4e54-91c0-d062bbf65d06`::moving from state preparing -> state finished >Thread-54706::DEBUG::2014-05-16 17:49:13,149::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54706::DEBUG::2014-05-16 17:49:13,150::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54706::DEBUG::2014-05-16 17:49:13,151::task::974::TaskManager.Task::(_decref) Task=`eded15ef-5e8d-4e54-91c0-d062bbf65d06`::ref 0 aborting False >Thread-54707::DEBUG::2014-05-16 17:49:13,164::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54707::DEBUG::2014-05-16 17:49:13,165::task::579::TaskManager.Task::(_updateState) Task=`5837af27-e2fd-44a6-bdda-f554327d7df7`::moving from state init -> state preparing >Thread-54707::INFO::2014-05-16 17:49:13,166::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54707::DEBUG::2014-05-16 17:49:13,168::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1ff6e697-db27-4790-a7d4-895a77877f9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54707::DEBUG::2014-05-16 17:49:13,169::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54707::DEBUG::2014-05-16 17:49:13,170::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54707::DEBUG::2014-05-16 17:49:13,171::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1ff6e697-db27-4790-a7d4-895a77877f9c`::Granted request >Thread-54707::DEBUG::2014-05-16 17:49:13,173::task::811::TaskManager.Task::(resourceAcquired) Task=`5837af27-e2fd-44a6-bdda-f554327d7df7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54707::DEBUG::2014-05-16 17:49:13,174::task::974::TaskManager.Task::(_decref) Task=`5837af27-e2fd-44a6-bdda-f554327d7df7`::ref 1 aborting False >Thread-54707::INFO::2014-05-16 17:49:13,177::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54707::DEBUG::2014-05-16 17:49:13,178::task::1168::TaskManager.Task::(prepare) Task=`5837af27-e2fd-44a6-bdda-f554327d7df7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54707::DEBUG::2014-05-16 17:49:13,179::task::579::TaskManager.Task::(_updateState) Task=`5837af27-e2fd-44a6-bdda-f554327d7df7`::moving from state preparing -> state finished >Thread-54707::DEBUG::2014-05-16 17:49:13,180::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54707::DEBUG::2014-05-16 17:49:13,181::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54707::DEBUG::2014-05-16 17:49:13,182::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54707::DEBUG::2014-05-16 17:49:13,183::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54707::DEBUG::2014-05-16 17:49:13,184::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54707::DEBUG::2014-05-16 17:49:13,185::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54707::DEBUG::2014-05-16 17:49:13,186::task::974::TaskManager.Task::(_decref) Task=`5837af27-e2fd-44a6-bdda-f554327d7df7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:49:13,205::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311415 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:15,216::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:15,284::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306337 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:17,295::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:17,369::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362302 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:19,376::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:19,447::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349338 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:49:20,752::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:49:20,762::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011354 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:21,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:21,530::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035749 s, 28.6 MB/s\n'; <rc> = 0 >Thread-54711::DEBUG::2014-05-16 17:49:23,218::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54711::DEBUG::2014-05-16 17:49:23,218::task::579::TaskManager.Task::(_updateState) Task=`5ee703bf-9de8-4590-9643-0f6a0904bb96`::moving from state init -> state preparing >Thread-54711::INFO::2014-05-16 17:49:23,219::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54711::INFO::2014-05-16 17:49:23,219::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54711::DEBUG::2014-05-16 17:49:23,219::task::1168::TaskManager.Task::(prepare) Task=`5ee703bf-9de8-4590-9643-0f6a0904bb96`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54711::DEBUG::2014-05-16 17:49:23,219::task::579::TaskManager.Task::(_updateState) Task=`5ee703bf-9de8-4590-9643-0f6a0904bb96`::moving from state preparing -> state finished >Thread-54711::DEBUG::2014-05-16 17:49:23,219::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54711::DEBUG::2014-05-16 17:49:23,219::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54711::DEBUG::2014-05-16 17:49:23,220::task::974::TaskManager.Task::(_decref) Task=`5ee703bf-9de8-4590-9643-0f6a0904bb96`::ref 0 aborting False >Thread-54712::DEBUG::2014-05-16 17:49:23,237::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54712::DEBUG::2014-05-16 17:49:23,237::task::579::TaskManager.Task::(_updateState) Task=`3051b32d-af95-4485-93ac-63d2d97b32d3`::moving from state init -> state preparing >Thread-54712::INFO::2014-05-16 17:49:23,237::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54712::DEBUG::2014-05-16 17:49:23,238::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b6deae7e-54d9-4c33-91f5-52716bda786c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54712::DEBUG::2014-05-16 17:49:23,238::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54712::DEBUG::2014-05-16 17:49:23,238::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54712::DEBUG::2014-05-16 17:49:23,238::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b6deae7e-54d9-4c33-91f5-52716bda786c`::Granted request >Thread-54712::DEBUG::2014-05-16 17:49:23,239::task::811::TaskManager.Task::(resourceAcquired) Task=`3051b32d-af95-4485-93ac-63d2d97b32d3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54712::DEBUG::2014-05-16 17:49:23,239::task::974::TaskManager.Task::(_decref) Task=`3051b32d-af95-4485-93ac-63d2d97b32d3`::ref 1 aborting False >Thread-54712::INFO::2014-05-16 17:49:23,239::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54712::DEBUG::2014-05-16 17:49:23,240::task::1168::TaskManager.Task::(prepare) Task=`3051b32d-af95-4485-93ac-63d2d97b32d3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54712::DEBUG::2014-05-16 17:49:23,240::task::579::TaskManager.Task::(_updateState) Task=`3051b32d-af95-4485-93ac-63d2d97b32d3`::moving from state preparing -> state finished >Thread-54712::DEBUG::2014-05-16 17:49:23,240::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54712::DEBUG::2014-05-16 17:49:23,240::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54712::DEBUG::2014-05-16 17:49:23,240::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54712::DEBUG::2014-05-16 17:49:23,240::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54712::DEBUG::2014-05-16 17:49:23,241::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54712::DEBUG::2014-05-16 17:49:23,241::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54712::DEBUG::2014-05-16 17:49:23,241::task::974::TaskManager.Task::(_decref) Task=`3051b32d-af95-4485-93ac-63d2d97b32d3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:49:23,541::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:23,619::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309054 s, 33.1 MB/s\n'; <rc> = 0 >Thread-54713::DEBUG::2014-05-16 17:49:24,280::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314928.000000 / 8.008467 / 262500000.000000 = 0.205256 >Thread-54713::DEBUG::2014-05-16 17:49:24,281::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052826946693890512, 'statsAge': 0.019880056381225586, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20525552563975688, 'rxDropped': 0} >Thread-54713::DEBUG::2014-05-16 17:49:24,282::task::579::TaskManager.Task::(_updateState) Task=`45994ff5-47f3-4806-b080-4d8b87cc17d9`::moving from state init -> state preparing >Thread-54713::INFO::2014-05-16 17:49:24,283::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54713::INFO::2014-05-16 17:49:24,284::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0011354', 'lastCheck': '3.5', 'valid': True}} >Thread-54713::DEBUG::2014-05-16 17:49:24,285::task::1168::TaskManager.Task::(prepare) Task=`45994ff5-47f3-4806-b080-4d8b87cc17d9`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0011354', 'lastCheck': '3.5', 'valid': True}} >Thread-54713::DEBUG::2014-05-16 17:49:24,286::task::579::TaskManager.Task::(_updateState) Task=`45994ff5-47f3-4806-b080-4d8b87cc17d9`::moving from state preparing -> state finished >Thread-54713::DEBUG::2014-05-16 17:49:24,287::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54713::DEBUG::2014-05-16 17:49:24,287::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54713::DEBUG::2014-05-16 17:49:24,288::task::974::TaskManager.Task::(_decref) Task=`45994ff5-47f3-4806-b080-4d8b87cc17d9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:49:25,631::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:25,703::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350139 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:27,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:27,781::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308055 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:29,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:29,860::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308155 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:49:30,799::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:49:30,809::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746537 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:31,871::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:31,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363014 s, 28.2 MB/s\n'; <rc> = 0 >Thread-54717::DEBUG::2014-05-16 17:49:33,279::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54717::DEBUG::2014-05-16 17:49:33,279::task::579::TaskManager.Task::(_updateState) Task=`204a9ffd-bfe7-4805-b369-3f2014e3703c`::moving from state init -> state preparing >Thread-54717::INFO::2014-05-16 17:49:33,280::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54717::INFO::2014-05-16 17:49:33,280::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54717::DEBUG::2014-05-16 17:49:33,280::task::1168::TaskManager.Task::(prepare) Task=`204a9ffd-bfe7-4805-b369-3f2014e3703c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54717::DEBUG::2014-05-16 17:49:33,280::task::579::TaskManager.Task::(_updateState) Task=`204a9ffd-bfe7-4805-b369-3f2014e3703c`::moving from state preparing -> state finished >Thread-54717::DEBUG::2014-05-16 17:49:33,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54717::DEBUG::2014-05-16 17:49:33,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54717::DEBUG::2014-05-16 17:49:33,281::task::974::TaskManager.Task::(_decref) Task=`204a9ffd-bfe7-4805-b369-3f2014e3703c`::ref 0 aborting False >Thread-54718::DEBUG::2014-05-16 17:49:33,289::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54718::DEBUG::2014-05-16 17:49:33,289::task::579::TaskManager.Task::(_updateState) Task=`9af50ec2-151a-4784-a726-af984e80ec43`::moving from state init -> state preparing >Thread-54718::INFO::2014-05-16 17:49:33,289::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54718::DEBUG::2014-05-16 17:49:33,290::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fad0bade-f012-42ab-8228-1cb3fb75e0d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54718::DEBUG::2014-05-16 17:49:33,290::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54718::DEBUG::2014-05-16 17:49:33,290::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54718::DEBUG::2014-05-16 17:49:33,290::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fad0bade-f012-42ab-8228-1cb3fb75e0d6`::Granted request >Thread-54718::DEBUG::2014-05-16 17:49:33,290::task::811::TaskManager.Task::(resourceAcquired) Task=`9af50ec2-151a-4784-a726-af984e80ec43`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54718::DEBUG::2014-05-16 17:49:33,291::task::974::TaskManager.Task::(_decref) Task=`9af50ec2-151a-4784-a726-af984e80ec43`::ref 1 aborting False >Thread-54718::INFO::2014-05-16 17:49:33,291::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54718::DEBUG::2014-05-16 17:49:33,291::task::1168::TaskManager.Task::(prepare) Task=`9af50ec2-151a-4784-a726-af984e80ec43`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54718::DEBUG::2014-05-16 17:49:33,291::task::579::TaskManager.Task::(_updateState) Task=`9af50ec2-151a-4784-a726-af984e80ec43`::moving from state preparing -> state finished >Thread-54718::DEBUG::2014-05-16 17:49:33,292::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54718::DEBUG::2014-05-16 17:49:33,292::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54718::DEBUG::2014-05-16 17:49:33,292::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54718::DEBUG::2014-05-16 17:49:33,292::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54718::DEBUG::2014-05-16 17:49:33,292::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54718::DEBUG::2014-05-16 17:49:33,292::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54718::DEBUG::2014-05-16 17:49:33,292::task::974::TaskManager.Task::(_decref) Task=`9af50ec2-151a-4784-a726-af984e80ec43`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:49:33,955::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:34,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352511 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:36,039::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:36,107::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031174 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:38,118::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:38,191::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349319 s, 29.3 MB/s\n'; <rc> = 0 >Thread-54721::DEBUG::2014-05-16 17:49:39,480::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5421045.000000 / 8.008535 / 262500000.000000 = 0.257870 >Thread-54721::DEBUG::2014-05-16 17:49:39,481::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066448156503783849, 'statsAge': 1.2057631015777588, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25786988801922461, 'rxDropped': 0} >Thread-54721::DEBUG::2014-05-16 17:49:39,481::task::579::TaskManager.Task::(_updateState) Task=`e7c77b37-5b7b-4ab5-b605-b771d7587c9b`::moving from state init -> state preparing >Thread-54721::INFO::2014-05-16 17:49:39,481::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54721::INFO::2014-05-16 17:49:39,482::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746537', 'lastCheck': '8.7', 'valid': True}} >Thread-54721::DEBUG::2014-05-16 17:49:39,482::task::1168::TaskManager.Task::(prepare) Task=`e7c77b37-5b7b-4ab5-b605-b771d7587c9b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746537', 'lastCheck': '8.7', 'valid': True}} >Thread-54721::DEBUG::2014-05-16 17:49:39,482::task::579::TaskManager.Task::(_updateState) Task=`e7c77b37-5b7b-4ab5-b605-b771d7587c9b`::moving from state preparing -> state finished >Thread-54721::DEBUG::2014-05-16 17:49:39,482::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54721::DEBUG::2014-05-16 17:49:39,482::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54721::DEBUG::2014-05-16 17:49:39,482::task::974::TaskManager.Task::(_decref) Task=`e7c77b37-5b7b-4ab5-b605-b771d7587c9b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:49:40,203::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:40,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353083 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:49:40,847::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:49:40,858::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000766901 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:42,289::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:42,357::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317123 s, 32.3 MB/s\n'; <rc> = 0 >Thread-54724::DEBUG::2014-05-16 17:49:43,345::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54724::DEBUG::2014-05-16 17:49:43,345::task::579::TaskManager.Task::(_updateState) Task=`ce0bfe7a-af0b-4e95-b567-c54f95544b18`::moving from state init -> state preparing >Thread-54724::INFO::2014-05-16 17:49:43,345::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54724::INFO::2014-05-16 17:49:43,345::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54724::DEBUG::2014-05-16 17:49:43,346::task::1168::TaskManager.Task::(prepare) Task=`ce0bfe7a-af0b-4e95-b567-c54f95544b18`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54724::DEBUG::2014-05-16 17:49:43,346::task::579::TaskManager.Task::(_updateState) Task=`ce0bfe7a-af0b-4e95-b567-c54f95544b18`::moving from state preparing -> state finished >Thread-54724::DEBUG::2014-05-16 17:49:43,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54724::DEBUG::2014-05-16 17:49:43,346::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54724::DEBUG::2014-05-16 17:49:43,346::task::974::TaskManager.Task::(_decref) Task=`ce0bfe7a-af0b-4e95-b567-c54f95544b18`::ref 0 aborting False >Thread-54725::DEBUG::2014-05-16 17:49:43,355::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54725::DEBUG::2014-05-16 17:49:43,355::task::579::TaskManager.Task::(_updateState) Task=`8fc153b9-8804-4189-9d7b-3100d688f1ca`::moving from state init -> state preparing >Thread-54725::INFO::2014-05-16 17:49:43,355::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54725::DEBUG::2014-05-16 17:49:43,356::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8b4fa6c9-80ea-4a25-b047-bdb7512f2ad7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54725::DEBUG::2014-05-16 17:49:43,356::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54725::DEBUG::2014-05-16 17:49:43,356::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54725::DEBUG::2014-05-16 17:49:43,356::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8b4fa6c9-80ea-4a25-b047-bdb7512f2ad7`::Granted request >Thread-54725::DEBUG::2014-05-16 17:49:43,356::task::811::TaskManager.Task::(resourceAcquired) Task=`8fc153b9-8804-4189-9d7b-3100d688f1ca`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54725::DEBUG::2014-05-16 17:49:43,357::task::974::TaskManager.Task::(_decref) Task=`8fc153b9-8804-4189-9d7b-3100d688f1ca`::ref 1 aborting False >Thread-54725::INFO::2014-05-16 17:49:43,357::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54725::DEBUG::2014-05-16 17:49:43,357::task::1168::TaskManager.Task::(prepare) Task=`8fc153b9-8804-4189-9d7b-3100d688f1ca`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54725::DEBUG::2014-05-16 17:49:43,358::task::579::TaskManager.Task::(_updateState) Task=`8fc153b9-8804-4189-9d7b-3100d688f1ca`::moving from state preparing -> state finished >Thread-54725::DEBUG::2014-05-16 17:49:43,358::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54725::DEBUG::2014-05-16 17:49:43,358::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54725::DEBUG::2014-05-16 17:49:43,358::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54725::DEBUG::2014-05-16 17:49:43,358::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54725::DEBUG::2014-05-16 17:49:43,358::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54725::DEBUG::2014-05-16 17:49:43,359::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54725::DEBUG::2014-05-16 17:49:43,359::task::974::TaskManager.Task::(_decref) Task=`8fc153b9-8804-4189-9d7b-3100d688f1ca`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:49:44,369::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:44,439::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328378 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:46,451::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:46,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357401 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:48,535::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:48,628::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309497 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:50,642::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:50,710::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315021 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:49:50,895::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:49:50,905::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000779316 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:52,721::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:52,792::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349334 s, 29.3 MB/s\n'; <rc> = 0 >Thread-54729::DEBUG::2014-05-16 17:49:53,396::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54729::DEBUG::2014-05-16 17:49:53,396::task::579::TaskManager.Task::(_updateState) Task=`b50f95f7-15c8-4407-a152-19a450c5c0d4`::moving from state init -> state preparing >Thread-54729::INFO::2014-05-16 17:49:53,397::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54729::INFO::2014-05-16 17:49:53,397::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54729::DEBUG::2014-05-16 17:49:53,397::task::1168::TaskManager.Task::(prepare) Task=`b50f95f7-15c8-4407-a152-19a450c5c0d4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54729::DEBUG::2014-05-16 17:49:53,397::task::579::TaskManager.Task::(_updateState) Task=`b50f95f7-15c8-4407-a152-19a450c5c0d4`::moving from state preparing -> state finished >Thread-54729::DEBUG::2014-05-16 17:49:53,397::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54729::DEBUG::2014-05-16 17:49:53,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54729::DEBUG::2014-05-16 17:49:53,398::task::974::TaskManager.Task::(_decref) Task=`b50f95f7-15c8-4407-a152-19a450c5c0d4`::ref 0 aborting False >Thread-54730::DEBUG::2014-05-16 17:49:53,407::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54730::DEBUG::2014-05-16 17:49:53,407::task::579::TaskManager.Task::(_updateState) Task=`c01a4f22-2c82-47d8-a5c3-42d9d1208a0a`::moving from state init -> state preparing >Thread-54730::INFO::2014-05-16 17:49:53,408::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54730::DEBUG::2014-05-16 17:49:53,408::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`514e978b-6517-4165-8559-934cfc8b9ad4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54730::DEBUG::2014-05-16 17:49:53,408::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54730::DEBUG::2014-05-16 17:49:53,408::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54730::DEBUG::2014-05-16 17:49:53,408::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`514e978b-6517-4165-8559-934cfc8b9ad4`::Granted request >Thread-54730::DEBUG::2014-05-16 17:49:53,409::task::811::TaskManager.Task::(resourceAcquired) Task=`c01a4f22-2c82-47d8-a5c3-42d9d1208a0a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54730::DEBUG::2014-05-16 17:49:53,409::task::974::TaskManager.Task::(_decref) Task=`c01a4f22-2c82-47d8-a5c3-42d9d1208a0a`::ref 1 aborting False >Thread-54730::INFO::2014-05-16 17:49:53,409::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54730::DEBUG::2014-05-16 17:49:53,410::task::1168::TaskManager.Task::(prepare) Task=`c01a4f22-2c82-47d8-a5c3-42d9d1208a0a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54730::DEBUG::2014-05-16 17:49:53,410::task::579::TaskManager.Task::(_updateState) Task=`c01a4f22-2c82-47d8-a5c3-42d9d1208a0a`::moving from state preparing -> state finished >Thread-54730::DEBUG::2014-05-16 17:49:53,410::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54730::DEBUG::2014-05-16 17:49:53,410::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54730::DEBUG::2014-05-16 17:49:53,410::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54730::DEBUG::2014-05-16 17:49:53,410::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54730::DEBUG::2014-05-16 17:49:53,410::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54730::DEBUG::2014-05-16 17:49:53,411::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54730::DEBUG::2014-05-16 17:49:53,411::task::974::TaskManager.Task::(_decref) Task=`c01a4f22-2c82-47d8-a5c3-42d9d1208a0a`::ref 0 aborting False >Thread-54731::DEBUG::2014-05-16 17:49:54,661::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314622.000000 / 8.008469 / 262500000.000000 = 0.205241 >Thread-54731::DEBUG::2014-05-16 17:49:54,661::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052907799311890068, 'statsAge': 0.36734390258789062, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20524091462514002, 'rxDropped': 0} >Thread-54731::DEBUG::2014-05-16 17:49:54,662::task::579::TaskManager.Task::(_updateState) Task=`9d30be9a-a815-4754-8b60-786e1731bdf0`::moving from state init -> state preparing >Thread-54731::INFO::2014-05-16 17:49:54,662::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54731::INFO::2014-05-16 17:49:54,662::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000779316', 'lastCheck': '3.7', 'valid': True}} >Thread-54731::DEBUG::2014-05-16 17:49:54,663::task::1168::TaskManager.Task::(prepare) Task=`9d30be9a-a815-4754-8b60-786e1731bdf0`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000779316', 'lastCheck': '3.7', 'valid': True}} >Thread-54731::DEBUG::2014-05-16 17:49:54,663::task::579::TaskManager.Task::(_updateState) Task=`9d30be9a-a815-4754-8b60-786e1731bdf0`::moving from state preparing -> state finished >Thread-54731::DEBUG::2014-05-16 17:49:54,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54731::DEBUG::2014-05-16 17:49:54,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54731::DEBUG::2014-05-16 17:49:54,663::task::974::TaskManager.Task::(_decref) Task=`9d30be9a-a815-4754-8b60-786e1731bdf0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:49:54,803::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:54,875::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349267 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:56,887::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:56,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031085 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:49:58,966::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:49:59,038::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351324 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:50:00,939::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:50:00,950::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104799 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:01,050::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:01,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353551 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:03,133::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:03,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318227 s, 32.2 MB/s\n'; <rc> = 0 >Thread-54735::DEBUG::2014-05-16 17:50:03,445::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54735::DEBUG::2014-05-16 17:50:03,446::task::579::TaskManager.Task::(_updateState) Task=`421f30eb-86c3-44b2-86af-a34a5e8206c9`::moving from state init -> state preparing >Thread-54735::INFO::2014-05-16 17:50:03,446::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54735::INFO::2014-05-16 17:50:03,446::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54735::DEBUG::2014-05-16 17:50:03,446::task::1168::TaskManager.Task::(prepare) Task=`421f30eb-86c3-44b2-86af-a34a5e8206c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54735::DEBUG::2014-05-16 17:50:03,447::task::579::TaskManager.Task::(_updateState) Task=`421f30eb-86c3-44b2-86af-a34a5e8206c9`::moving from state preparing -> state finished >Thread-54735::DEBUG::2014-05-16 17:50:03,447::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54735::DEBUG::2014-05-16 17:50:03,447::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54735::DEBUG::2014-05-16 17:50:03,447::task::974::TaskManager.Task::(_decref) Task=`421f30eb-86c3-44b2-86af-a34a5e8206c9`::ref 0 aborting False >Thread-54736::DEBUG::2014-05-16 17:50:03,455::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54736::DEBUG::2014-05-16 17:50:03,456::task::579::TaskManager.Task::(_updateState) Task=`a309bb92-4aeb-448d-8218-2867a834c1f0`::moving from state init -> state preparing >Thread-54736::INFO::2014-05-16 17:50:03,456::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54736::DEBUG::2014-05-16 17:50:03,456::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ad657cb6-ab53-4d51-9c4a-314f940cca27`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54736::DEBUG::2014-05-16 17:50:03,456::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54736::DEBUG::2014-05-16 17:50:03,457::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54736::DEBUG::2014-05-16 17:50:03,457::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ad657cb6-ab53-4d51-9c4a-314f940cca27`::Granted request >Thread-54736::DEBUG::2014-05-16 17:50:03,457::task::811::TaskManager.Task::(resourceAcquired) Task=`a309bb92-4aeb-448d-8218-2867a834c1f0`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54736::DEBUG::2014-05-16 17:50:03,457::task::974::TaskManager.Task::(_decref) Task=`a309bb92-4aeb-448d-8218-2867a834c1f0`::ref 1 aborting False >Thread-54736::INFO::2014-05-16 17:50:03,458::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54736::DEBUG::2014-05-16 17:50:03,458::task::1168::TaskManager.Task::(prepare) Task=`a309bb92-4aeb-448d-8218-2867a834c1f0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54736::DEBUG::2014-05-16 17:50:03,458::task::579::TaskManager.Task::(_updateState) Task=`a309bb92-4aeb-448d-8218-2867a834c1f0`::moving from state preparing -> state finished >Thread-54736::DEBUG::2014-05-16 17:50:03,458::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54736::DEBUG::2014-05-16 17:50:03,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54736::DEBUG::2014-05-16 17:50:03,459::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54736::DEBUG::2014-05-16 17:50:03,459::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54736::DEBUG::2014-05-16 17:50:03,459::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54736::DEBUG::2014-05-16 17:50:03,459::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54736::DEBUG::2014-05-16 17:50:03,459::task::974::TaskManager.Task::(_decref) Task=`a309bb92-4aeb-448d-8218-2867a834c1f0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:50:05,212::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:05,284::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350273 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:07,296::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:07,363::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311827 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:09,375::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:09,446::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352824 s, 29.0 MB/s\n'; <rc> = 0 >Thread-54739::DEBUG::2014-05-16 17:50:09,797::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4320241.000000 / 8.008270 / 262500000.000000 = 0.205513 >Thread-54739::DEBUG::2014-05-16 17:50:09,798::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053676892295530642, 'statsAge': 1.4889070987701416, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20551331186988037, 'rxDropped': 0} >Thread-54739::DEBUG::2014-05-16 17:50:09,798::task::579::TaskManager.Task::(_updateState) Task=`97eaaf01-560e-4345-a1b9-ff32aafd2569`::moving from state init -> state preparing >Thread-54739::INFO::2014-05-16 17:50:09,798::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54739::INFO::2014-05-16 17:50:09,799::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104799', 'lastCheck': '8.8', 'valid': True}} >Thread-54739::DEBUG::2014-05-16 17:50:09,799::task::1168::TaskManager.Task::(prepare) Task=`97eaaf01-560e-4345-a1b9-ff32aafd2569`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104799', 'lastCheck': '8.8', 'valid': True}} >Thread-54739::DEBUG::2014-05-16 17:50:09,799::task::579::TaskManager.Task::(_updateState) Task=`97eaaf01-560e-4345-a1b9-ff32aafd2569`::moving from state preparing -> state finished >Thread-54739::DEBUG::2014-05-16 17:50:09,799::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54739::DEBUG::2014-05-16 17:50:09,799::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54739::DEBUG::2014-05-16 17:50:09,799::task::974::TaskManager.Task::(_decref) Task=`97eaaf01-560e-4345-a1b9-ff32aafd2569`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:50:10,986::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:50:10,996::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000544731 s, 7.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:11,458::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:11,525::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031321 s, 32.7 MB/s\n'; <rc> = 0 >Thread-54742::DEBUG::2014-05-16 17:50:13,496::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54742::DEBUG::2014-05-16 17:50:13,497::task::579::TaskManager.Task::(_updateState) Task=`52df0b38-ed96-4f77-bb0a-21188d97ca6a`::moving from state init -> state preparing >Thread-54742::INFO::2014-05-16 17:50:13,497::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54742::INFO::2014-05-16 17:50:13,497::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54742::DEBUG::2014-05-16 17:50:13,498::task::1168::TaskManager.Task::(prepare) Task=`52df0b38-ed96-4f77-bb0a-21188d97ca6a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54742::DEBUG::2014-05-16 17:50:13,498::task::579::TaskManager.Task::(_updateState) Task=`52df0b38-ed96-4f77-bb0a-21188d97ca6a`::moving from state preparing -> state finished >Thread-54742::DEBUG::2014-05-16 17:50:13,498::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54742::DEBUG::2014-05-16 17:50:13,498::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54742::DEBUG::2014-05-16 17:50:13,498::task::974::TaskManager.Task::(_decref) Task=`52df0b38-ed96-4f77-bb0a-21188d97ca6a`::ref 0 aborting False >Thread-54743::DEBUG::2014-05-16 17:50:13,507::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54743::DEBUG::2014-05-16 17:50:13,507::task::579::TaskManager.Task::(_updateState) Task=`deca1505-45b9-4433-814e-bdbf80a51674`::moving from state init -> state preparing >Thread-54743::INFO::2014-05-16 17:50:13,507::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54743::DEBUG::2014-05-16 17:50:13,508::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3f561d6d-8940-48d3-a16b-8a3900d7cfba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54743::DEBUG::2014-05-16 17:50:13,508::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54743::DEBUG::2014-05-16 17:50:13,508::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54743::DEBUG::2014-05-16 17:50:13,508::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3f561d6d-8940-48d3-a16b-8a3900d7cfba`::Granted request >Thread-54743::DEBUG::2014-05-16 17:50:13,509::task::811::TaskManager.Task::(resourceAcquired) Task=`deca1505-45b9-4433-814e-bdbf80a51674`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54743::DEBUG::2014-05-16 17:50:13,509::task::974::TaskManager.Task::(_decref) Task=`deca1505-45b9-4433-814e-bdbf80a51674`::ref 1 aborting False >Thread-54743::INFO::2014-05-16 17:50:13,509::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54743::DEBUG::2014-05-16 17:50:13,510::task::1168::TaskManager.Task::(prepare) Task=`deca1505-45b9-4433-814e-bdbf80a51674`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54743::DEBUG::2014-05-16 17:50:13,510::task::579::TaskManager.Task::(_updateState) Task=`deca1505-45b9-4433-814e-bdbf80a51674`::moving from state preparing -> state finished >Thread-54743::DEBUG::2014-05-16 17:50:13,510::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54743::DEBUG::2014-05-16 17:50:13,510::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54743::DEBUG::2014-05-16 17:50:13,510::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54743::DEBUG::2014-05-16 17:50:13,510::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54743::DEBUG::2014-05-16 17:50:13,511::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54743::DEBUG::2014-05-16 17:50:13,511::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54743::DEBUG::2014-05-16 17:50:13,511::task::974::TaskManager.Task::(_decref) Task=`deca1505-45b9-4433-814e-bdbf80a51674`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:50:13,537::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:13,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349369 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:15,619::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:15,687::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03135 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:17,699::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:17,766::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306692 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:19,777::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:19,848::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348457 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:50:21,030::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:50:21,040::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000836058 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:21,860::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:21,937::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356707 s, 28.7 MB/s\n'; <rc> = 0 >Thread-54747::DEBUG::2014-05-16 17:50:23,552::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54747::DEBUG::2014-05-16 17:50:23,552::task::579::TaskManager.Task::(_updateState) Task=`7955405f-c983-4589-8bb4-a5dd8981678e`::moving from state init -> state preparing >Thread-54747::INFO::2014-05-16 17:50:23,552::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54747::INFO::2014-05-16 17:50:23,552::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54747::DEBUG::2014-05-16 17:50:23,553::task::1168::TaskManager.Task::(prepare) Task=`7955405f-c983-4589-8bb4-a5dd8981678e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54747::DEBUG::2014-05-16 17:50:23,553::task::579::TaskManager.Task::(_updateState) Task=`7955405f-c983-4589-8bb4-a5dd8981678e`::moving from state preparing -> state finished >Thread-54747::DEBUG::2014-05-16 17:50:23,553::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54747::DEBUG::2014-05-16 17:50:23,553::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54747::DEBUG::2014-05-16 17:50:23,553::task::974::TaskManager.Task::(_decref) Task=`7955405f-c983-4589-8bb4-a5dd8981678e`::ref 0 aborting False >Thread-54748::DEBUG::2014-05-16 17:50:23,562::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54748::DEBUG::2014-05-16 17:50:23,562::task::579::TaskManager.Task::(_updateState) Task=`84ac936f-f693-485a-bc77-b4c51fb5b306`::moving from state init -> state preparing >Thread-54748::INFO::2014-05-16 17:50:23,562::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54748::DEBUG::2014-05-16 17:50:23,563::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7a374502-54f6-48de-9d32-9a9dbbc73ee9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54748::DEBUG::2014-05-16 17:50:23,563::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54748::DEBUG::2014-05-16 17:50:23,563::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54748::DEBUG::2014-05-16 17:50:23,563::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7a374502-54f6-48de-9d32-9a9dbbc73ee9`::Granted request >Thread-54748::DEBUG::2014-05-16 17:50:23,563::task::811::TaskManager.Task::(resourceAcquired) Task=`84ac936f-f693-485a-bc77-b4c51fb5b306`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54748::DEBUG::2014-05-16 17:50:23,563::task::974::TaskManager.Task::(_decref) Task=`84ac936f-f693-485a-bc77-b4c51fb5b306`::ref 1 aborting False >Thread-54748::INFO::2014-05-16 17:50:23,564::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54748::DEBUG::2014-05-16 17:50:23,564::task::1168::TaskManager.Task::(prepare) Task=`84ac936f-f693-485a-bc77-b4c51fb5b306`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54748::DEBUG::2014-05-16 17:50:23,564::task::579::TaskManager.Task::(_updateState) Task=`84ac936f-f693-485a-bc77-b4c51fb5b306`::moving from state preparing -> state finished >Thread-54748::DEBUG::2014-05-16 17:50:23,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54748::DEBUG::2014-05-16 17:50:23,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54748::DEBUG::2014-05-16 17:50:23,565::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54748::DEBUG::2014-05-16 17:50:23,565::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54748::DEBUG::2014-05-16 17:50:23,565::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54748::DEBUG::2014-05-16 17:50:23,565::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54748::DEBUG::2014-05-16 17:50:23,565::task::974::TaskManager.Task::(_decref) Task=`84ac936f-f693-485a-bc77-b4c51fb5b306`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:50:23,950::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:24,022::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352096 s, 29.1 MB/s\n'; <rc> = 0 >Thread-54749::DEBUG::2014-05-16 17:50:24,945::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4342662.000000 / 8.008569 / 262500000.000000 = 0.206572 >Thread-54749::DEBUG::2014-05-16 17:50:24,946::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005687336721353381, 'statsAge': 0.61989188194274902, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20657216390680919, 'rxDropped': 0} >Thread-54749::DEBUG::2014-05-16 17:50:24,946::task::579::TaskManager.Task::(_updateState) Task=`0f589daf-eeb7-4ca1-81dd-06c97bc05d9a`::moving from state init -> state preparing >Thread-54749::INFO::2014-05-16 17:50:24,947::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54749::INFO::2014-05-16 17:50:24,947::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000836058', 'lastCheck': '3.9', 'valid': True}} >Thread-54749::DEBUG::2014-05-16 17:50:24,947::task::1168::TaskManager.Task::(prepare) Task=`0f589daf-eeb7-4ca1-81dd-06c97bc05d9a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000836058', 'lastCheck': '3.9', 'valid': True}} >Thread-54749::DEBUG::2014-05-16 17:50:24,947::task::579::TaskManager.Task::(_updateState) Task=`0f589daf-eeb7-4ca1-81dd-06c97bc05d9a`::moving from state preparing -> state finished >Thread-54749::DEBUG::2014-05-16 17:50:24,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54749::DEBUG::2014-05-16 17:50:24,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54749::DEBUG::2014-05-16 17:50:24,948::task::974::TaskManager.Task::(_decref) Task=`0f589daf-eeb7-4ca1-81dd-06c97bc05d9a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:50:26,034::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:26,105::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355413 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:28,117::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:28,184::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308823 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:30,195::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:30,263::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315625 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:50:31,078::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:50:31,088::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000867035 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:32,275::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:32,353::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367372 s, 27.9 MB/s\n'; <rc> = 0 >Thread-54753::DEBUG::2014-05-16 17:50:33,610::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54753::DEBUG::2014-05-16 17:50:33,610::task::579::TaskManager.Task::(_updateState) Task=`300d3d72-4c7f-41a6-ba28-803cd8da3a26`::moving from state init -> state preparing >Thread-54753::INFO::2014-05-16 17:50:33,611::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54753::INFO::2014-05-16 17:50:33,611::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54753::DEBUG::2014-05-16 17:50:33,611::task::1168::TaskManager.Task::(prepare) Task=`300d3d72-4c7f-41a6-ba28-803cd8da3a26`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54753::DEBUG::2014-05-16 17:50:33,611::task::579::TaskManager.Task::(_updateState) Task=`300d3d72-4c7f-41a6-ba28-803cd8da3a26`::moving from state preparing -> state finished >Thread-54753::DEBUG::2014-05-16 17:50:33,611::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54753::DEBUG::2014-05-16 17:50:33,611::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54753::DEBUG::2014-05-16 17:50:33,612::task::974::TaskManager.Task::(_decref) Task=`300d3d72-4c7f-41a6-ba28-803cd8da3a26`::ref 0 aborting False >Thread-54754::DEBUG::2014-05-16 17:50:33,620::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54754::DEBUG::2014-05-16 17:50:33,620::task::579::TaskManager.Task::(_updateState) Task=`2aba8314-3233-447d-82f2-b12c5f929eb9`::moving from state init -> state preparing >Thread-54754::INFO::2014-05-16 17:50:33,620::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54754::DEBUG::2014-05-16 17:50:33,621::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4ec5aecb-10b2-40c2-8c54-2cdf71b33884`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54754::DEBUG::2014-05-16 17:50:33,621::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54754::DEBUG::2014-05-16 17:50:33,621::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54754::DEBUG::2014-05-16 17:50:33,622::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4ec5aecb-10b2-40c2-8c54-2cdf71b33884`::Granted request >Thread-54754::DEBUG::2014-05-16 17:50:33,622::task::811::TaskManager.Task::(resourceAcquired) Task=`2aba8314-3233-447d-82f2-b12c5f929eb9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54754::DEBUG::2014-05-16 17:50:33,622::task::974::TaskManager.Task::(_decref) Task=`2aba8314-3233-447d-82f2-b12c5f929eb9`::ref 1 aborting False >Thread-54754::INFO::2014-05-16 17:50:33,623::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54754::DEBUG::2014-05-16 17:50:33,623::task::1168::TaskManager.Task::(prepare) Task=`2aba8314-3233-447d-82f2-b12c5f929eb9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54754::DEBUG::2014-05-16 17:50:33,623::task::579::TaskManager.Task::(_updateState) Task=`2aba8314-3233-447d-82f2-b12c5f929eb9`::moving from state preparing -> state finished >Thread-54754::DEBUG::2014-05-16 17:50:33,623::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54754::DEBUG::2014-05-16 17:50:33,623::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54754::DEBUG::2014-05-16 17:50:33,624::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54754::DEBUG::2014-05-16 17:50:33,624::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54754::DEBUG::2014-05-16 17:50:33,624::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54754::DEBUG::2014-05-16 17:50:33,624::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54754::DEBUG::2014-05-16 17:50:33,624::task::974::TaskManager.Task::(_decref) Task=`2aba8314-3233-447d-82f2-b12c5f929eb9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:50:34,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:34,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370269 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:36,448::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:36,515::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308806 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:38,527::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:38,594::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305627 s, 33.5 MB/s\n'; <rc> = 0 >Thread-54757::DEBUG::2014-05-16 17:50:40,106::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5416662.000000 / 8.011269 / 262500000.000000 = 0.257573 >Thread-54757::DEBUG::2014-05-16 17:50:40,106::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0068711783545251977, 'statsAge': 1.762869119644165, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25757346598692832, 'rxDropped': 0} >Thread-54757::DEBUG::2014-05-16 17:50:40,107::task::579::TaskManager.Task::(_updateState) Task=`703383ff-7506-4166-a31b-5c1760c4a438`::moving from state init -> state preparing >Thread-54757::INFO::2014-05-16 17:50:40,107::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54757::INFO::2014-05-16 17:50:40,107::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000867035', 'lastCheck': '9.0', 'valid': True}} >Thread-54757::DEBUG::2014-05-16 17:50:40,108::task::1168::TaskManager.Task::(prepare) Task=`703383ff-7506-4166-a31b-5c1760c4a438`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000867035', 'lastCheck': '9.0', 'valid': True}} >Thread-54757::DEBUG::2014-05-16 17:50:40,108::task::579::TaskManager.Task::(_updateState) Task=`703383ff-7506-4166-a31b-5c1760c4a438`::moving from state preparing -> state finished >Thread-54757::DEBUG::2014-05-16 17:50:40,108::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54757::DEBUG::2014-05-16 17:50:40,108::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54757::DEBUG::2014-05-16 17:50:40,108::task::974::TaskManager.Task::(_decref) Task=`703383ff-7506-4166-a31b-5c1760c4a438`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:50:40,605::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:40,677::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035155 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:50:41,126::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:50:41,137::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000802208 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:42,689::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:42,756::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313837 s, 32.6 MB/s\n'; <rc> = 0 >Thread-54760::DEBUG::2014-05-16 17:50:43,661::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54760::DEBUG::2014-05-16 17:50:43,661::task::579::TaskManager.Task::(_updateState) Task=`c1c63fa4-ccad-4693-a3f1-dd611a9027a2`::moving from state init -> state preparing >Thread-54760::INFO::2014-05-16 17:50:43,661::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54760::INFO::2014-05-16 17:50:43,662::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54760::DEBUG::2014-05-16 17:50:43,662::task::1168::TaskManager.Task::(prepare) Task=`c1c63fa4-ccad-4693-a3f1-dd611a9027a2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54760::DEBUG::2014-05-16 17:50:43,662::task::579::TaskManager.Task::(_updateState) Task=`c1c63fa4-ccad-4693-a3f1-dd611a9027a2`::moving from state preparing -> state finished >Thread-54760::DEBUG::2014-05-16 17:50:43,662::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54760::DEBUG::2014-05-16 17:50:43,662::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54760::DEBUG::2014-05-16 17:50:43,663::task::974::TaskManager.Task::(_decref) Task=`c1c63fa4-ccad-4693-a3f1-dd611a9027a2`::ref 0 aborting False >Thread-54761::DEBUG::2014-05-16 17:50:43,672::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54761::DEBUG::2014-05-16 17:50:43,672::task::579::TaskManager.Task::(_updateState) Task=`1c8621df-84f8-4ad0-b93d-b6dadd0b5b2d`::moving from state init -> state preparing >Thread-54761::INFO::2014-05-16 17:50:43,672::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54761::DEBUG::2014-05-16 17:50:43,673::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`72ab84d0-21dc-4b1e-8f10-e471f28ea112`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54761::DEBUG::2014-05-16 17:50:43,673::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54761::DEBUG::2014-05-16 17:50:43,673::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54761::DEBUG::2014-05-16 17:50:43,673::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`72ab84d0-21dc-4b1e-8f10-e471f28ea112`::Granted request >Thread-54761::DEBUG::2014-05-16 17:50:43,674::task::811::TaskManager.Task::(resourceAcquired) Task=`1c8621df-84f8-4ad0-b93d-b6dadd0b5b2d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54761::DEBUG::2014-05-16 17:50:43,674::task::974::TaskManager.Task::(_decref) Task=`1c8621df-84f8-4ad0-b93d-b6dadd0b5b2d`::ref 1 aborting False >Thread-54761::INFO::2014-05-16 17:50:43,675::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54761::DEBUG::2014-05-16 17:50:43,675::task::1168::TaskManager.Task::(prepare) Task=`1c8621df-84f8-4ad0-b93d-b6dadd0b5b2d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54761::DEBUG::2014-05-16 17:50:43,675::task::579::TaskManager.Task::(_updateState) Task=`1c8621df-84f8-4ad0-b93d-b6dadd0b5b2d`::moving from state preparing -> state finished >Thread-54761::DEBUG::2014-05-16 17:50:43,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54761::DEBUG::2014-05-16 17:50:43,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54761::DEBUG::2014-05-16 17:50:43,675::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54761::DEBUG::2014-05-16 17:50:43,676::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54761::DEBUG::2014-05-16 17:50:43,676::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54761::DEBUG::2014-05-16 17:50:43,676::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54761::DEBUG::2014-05-16 17:50:43,676::task::974::TaskManager.Task::(_decref) Task=`1c8621df-84f8-4ad0-b93d-b6dadd0b5b2d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:50:44,768::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:44,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030939 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:46,848::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:46,921::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363299 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:48,933::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:49,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361874 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:51,018::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:51,087::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325325 s, 31.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:50:51,174::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:50:51,184::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000787503 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:53,098::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:53,169::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346521 s, 29.6 MB/s\n'; <rc> = 0 >Thread-54765::DEBUG::2014-05-16 17:50:53,703::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54765::DEBUG::2014-05-16 17:50:53,704::task::579::TaskManager.Task::(_updateState) Task=`f9845f5d-97c3-4d78-af92-7c667b7af8a5`::moving from state init -> state preparing >Thread-54765::INFO::2014-05-16 17:50:53,704::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54765::INFO::2014-05-16 17:50:53,704::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54765::DEBUG::2014-05-16 17:50:53,704::task::1168::TaskManager.Task::(prepare) Task=`f9845f5d-97c3-4d78-af92-7c667b7af8a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54765::DEBUG::2014-05-16 17:50:53,705::task::579::TaskManager.Task::(_updateState) Task=`f9845f5d-97c3-4d78-af92-7c667b7af8a5`::moving from state preparing -> state finished >Thread-54765::DEBUG::2014-05-16 17:50:53,705::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54765::DEBUG::2014-05-16 17:50:53,705::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54765::DEBUG::2014-05-16 17:50:53,705::task::974::TaskManager.Task::(_decref) Task=`f9845f5d-97c3-4d78-af92-7c667b7af8a5`::ref 0 aborting False >Thread-54766::DEBUG::2014-05-16 17:50:53,713::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54766::DEBUG::2014-05-16 17:50:53,713::task::579::TaskManager.Task::(_updateState) Task=`bf5d0772-55e3-4c27-9f62-543f6ed232a5`::moving from state init -> state preparing >Thread-54766::INFO::2014-05-16 17:50:53,713::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54766::DEBUG::2014-05-16 17:50:53,714::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5ec924e0-f0f3-491b-a675-c306f0d5999f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54766::DEBUG::2014-05-16 17:50:53,714::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54766::DEBUG::2014-05-16 17:50:53,714::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54766::DEBUG::2014-05-16 17:50:53,714::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5ec924e0-f0f3-491b-a675-c306f0d5999f`::Granted request >Thread-54766::DEBUG::2014-05-16 17:50:53,714::task::811::TaskManager.Task::(resourceAcquired) Task=`bf5d0772-55e3-4c27-9f62-543f6ed232a5`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54766::DEBUG::2014-05-16 17:50:53,715::task::974::TaskManager.Task::(_decref) Task=`bf5d0772-55e3-4c27-9f62-543f6ed232a5`::ref 1 aborting False >Thread-54766::INFO::2014-05-16 17:50:53,715::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54766::DEBUG::2014-05-16 17:50:53,715::task::1168::TaskManager.Task::(prepare) Task=`bf5d0772-55e3-4c27-9f62-543f6ed232a5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54766::DEBUG::2014-05-16 17:50:53,715::task::579::TaskManager.Task::(_updateState) Task=`bf5d0772-55e3-4c27-9f62-543f6ed232a5`::moving from state preparing -> state finished >Thread-54766::DEBUG::2014-05-16 17:50:53,716::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54766::DEBUG::2014-05-16 17:50:53,716::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54766::DEBUG::2014-05-16 17:50:53,716::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54766::DEBUG::2014-05-16 17:50:53,716::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54766::DEBUG::2014-05-16 17:50:53,716::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54766::DEBUG::2014-05-16 17:50:53,716::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54766::DEBUG::2014-05-16 17:50:53,716::task::974::TaskManager.Task::(_decref) Task=`bf5d0772-55e3-4c27-9f62-543f6ed232a5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:50:55,182::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54767::DEBUG::2014-05-16 17:50:55,249::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317615.000000 / 8.008511 / 262500000.000000 = 0.205382 >Thread-54767::DEBUG::2014-05-16 17:50:55,250::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053722845161956797, 'statsAge': 0.88841700553894043, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20538221157975359, 'rxDropped': 0} >Thread-54767::DEBUG::2014-05-16 17:50:55,252::task::579::TaskManager.Task::(_updateState) Task=`ded9d13e-0d4e-4fe1-b842-139baa5f8dd3`::moving from state init -> state preparing >Thread-54767::INFO::2014-05-16 17:50:55,253::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54767::INFO::2014-05-16 17:50:55,254::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787503', 'lastCheck': '4.0', 'valid': True}} >Thread-54767::DEBUG::2014-05-16 17:50:55,255::task::1168::TaskManager.Task::(prepare) Task=`ded9d13e-0d4e-4fe1-b842-139baa5f8dd3`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787503', 'lastCheck': '4.0', 'valid': True}} >Thread-54767::DEBUG::2014-05-16 17:50:55,256::task::579::TaskManager.Task::(_updateState) Task=`ded9d13e-0d4e-4fe1-b842-139baa5f8dd3`::moving from state preparing -> state finished >Thread-54767::DEBUG::2014-05-16 17:50:55,257::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54767::DEBUG::2014-05-16 17:50:55,258::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54767::DEBUG::2014-05-16 17:50:55,259::task::974::TaskManager.Task::(_decref) Task=`ded9d13e-0d4e-4fe1-b842-139baa5f8dd3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:50:55,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353186 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:57,295::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:57,361::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299723 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:50:59,373::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:50:59,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358417 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:51:01,219::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:51:01,230::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102824 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:01,456::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:01,528::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359791 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:03,539::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:03,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311675 s, 32.9 MB/s\n'; <rc> = 0 >Thread-54771::DEBUG::2014-05-16 17:51:03,753::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54771::DEBUG::2014-05-16 17:51:03,754::task::579::TaskManager.Task::(_updateState) Task=`f5eba12e-b6f4-4da8-a70d-160b140e633c`::moving from state init -> state preparing >Thread-54771::INFO::2014-05-16 17:51:03,754::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54771::INFO::2014-05-16 17:51:03,754::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54771::DEBUG::2014-05-16 17:51:03,754::task::1168::TaskManager.Task::(prepare) Task=`f5eba12e-b6f4-4da8-a70d-160b140e633c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54771::DEBUG::2014-05-16 17:51:03,755::task::579::TaskManager.Task::(_updateState) Task=`f5eba12e-b6f4-4da8-a70d-160b140e633c`::moving from state preparing -> state finished >Thread-54771::DEBUG::2014-05-16 17:51:03,755::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54771::DEBUG::2014-05-16 17:51:03,755::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54771::DEBUG::2014-05-16 17:51:03,755::task::974::TaskManager.Task::(_decref) Task=`f5eba12e-b6f4-4da8-a70d-160b140e633c`::ref 0 aborting False >Thread-54772::DEBUG::2014-05-16 17:51:03,763::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54772::DEBUG::2014-05-16 17:51:03,764::task::579::TaskManager.Task::(_updateState) Task=`2257cca5-444c-45f1-8295-4a0cb72b2879`::moving from state init -> state preparing >Thread-54772::INFO::2014-05-16 17:51:03,764::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54772::DEBUG::2014-05-16 17:51:03,764::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`54919207-5e22-4c17-a525-f8337fa0cd9a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54772::DEBUG::2014-05-16 17:51:03,764::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54772::DEBUG::2014-05-16 17:51:03,765::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54772::DEBUG::2014-05-16 17:51:03,765::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`54919207-5e22-4c17-a525-f8337fa0cd9a`::Granted request >Thread-54772::DEBUG::2014-05-16 17:51:03,765::task::811::TaskManager.Task::(resourceAcquired) Task=`2257cca5-444c-45f1-8295-4a0cb72b2879`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54772::DEBUG::2014-05-16 17:51:03,765::task::974::TaskManager.Task::(_decref) Task=`2257cca5-444c-45f1-8295-4a0cb72b2879`::ref 1 aborting False >Thread-54772::INFO::2014-05-16 17:51:03,766::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54772::DEBUG::2014-05-16 17:51:03,766::task::1168::TaskManager.Task::(prepare) Task=`2257cca5-444c-45f1-8295-4a0cb72b2879`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54772::DEBUG::2014-05-16 17:51:03,766::task::579::TaskManager.Task::(_updateState) Task=`2257cca5-444c-45f1-8295-4a0cb72b2879`::moving from state preparing -> state finished >Thread-54772::DEBUG::2014-05-16 17:51:03,766::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54772::DEBUG::2014-05-16 17:51:03,766::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54772::DEBUG::2014-05-16 17:51:03,767::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54772::DEBUG::2014-05-16 17:51:03,767::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54772::DEBUG::2014-05-16 17:51:03,767::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54772::DEBUG::2014-05-16 17:51:03,767::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54772::DEBUG::2014-05-16 17:51:03,767::task::974::TaskManager.Task::(_decref) Task=`2257cca5-444c-45f1-8295-4a0cb72b2879`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:51:05,618::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:05,686::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304329 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:07,698::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:07,771::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363011 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:09,782::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:09,852::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343433 s, 29.8 MB/s\n'; <rc> = 0 >Thread-54775::DEBUG::2014-05-16 17:51:10,407::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3240561.000000 / 8.010752 / 262500000.000000 = 0.154105 >Thread-54775::DEBUG::2014-05-16 17:51:10,407::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0040837494333544602, 'statsAge': 0.026968002319335938, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.1541053071651555, 'rxDropped': 0} >Thread-54775::DEBUG::2014-05-16 17:51:10,407::task::579::TaskManager.Task::(_updateState) Task=`c0fd9e35-a0d2-476f-83aa-f4b66a48147f`::moving from state init -> state preparing >Thread-54775::INFO::2014-05-16 17:51:10,408::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54775::INFO::2014-05-16 17:51:10,408::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102824', 'lastCheck': '9.2', 'valid': True}} >Thread-54775::DEBUG::2014-05-16 17:51:10,408::task::1168::TaskManager.Task::(prepare) Task=`c0fd9e35-a0d2-476f-83aa-f4b66a48147f`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102824', 'lastCheck': '9.2', 'valid': True}} >Thread-54775::DEBUG::2014-05-16 17:51:10,408::task::579::TaskManager.Task::(_updateState) Task=`c0fd9e35-a0d2-476f-83aa-f4b66a48147f`::moving from state preparing -> state finished >Thread-54775::DEBUG::2014-05-16 17:51:10,408::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54775::DEBUG::2014-05-16 17:51:10,409::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54775::DEBUG::2014-05-16 17:51:10,409::task::974::TaskManager.Task::(_decref) Task=`c0fd9e35-a0d2-476f-83aa-f4b66a48147f`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:51:11,267::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:51:11,278::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101547 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:11,864::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:11,932::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320046 s, 32.0 MB/s\n'; <rc> = 0 >Thread-54778::DEBUG::2014-05-16 17:51:13,803::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54778::DEBUG::2014-05-16 17:51:13,804::task::579::TaskManager.Task::(_updateState) Task=`8395a6a7-88f8-47b7-975c-60fe9123f14b`::moving from state init -> state preparing >Thread-54778::INFO::2014-05-16 17:51:13,804::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54778::INFO::2014-05-16 17:51:13,804::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54778::DEBUG::2014-05-16 17:51:13,805::task::1168::TaskManager.Task::(prepare) Task=`8395a6a7-88f8-47b7-975c-60fe9123f14b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54778::DEBUG::2014-05-16 17:51:13,805::task::579::TaskManager.Task::(_updateState) Task=`8395a6a7-88f8-47b7-975c-60fe9123f14b`::moving from state preparing -> state finished >Thread-54778::DEBUG::2014-05-16 17:51:13,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54778::DEBUG::2014-05-16 17:51:13,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54778::DEBUG::2014-05-16 17:51:13,805::task::974::TaskManager.Task::(_decref) Task=`8395a6a7-88f8-47b7-975c-60fe9123f14b`::ref 0 aborting False >Thread-54779::DEBUG::2014-05-16 17:51:13,813::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54779::DEBUG::2014-05-16 17:51:13,813::task::579::TaskManager.Task::(_updateState) Task=`1a6916de-3451-440d-842a-d876b0eaecba`::moving from state init -> state preparing >Thread-54779::INFO::2014-05-16 17:51:13,814::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54779::DEBUG::2014-05-16 17:51:13,814::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cac90a84-5eb9-49c5-88c0-1318be5f4165`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54779::DEBUG::2014-05-16 17:51:13,814::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54779::DEBUG::2014-05-16 17:51:13,814::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54779::DEBUG::2014-05-16 17:51:13,814::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cac90a84-5eb9-49c5-88c0-1318be5f4165`::Granted request >Thread-54779::DEBUG::2014-05-16 17:51:13,815::task::811::TaskManager.Task::(resourceAcquired) Task=`1a6916de-3451-440d-842a-d876b0eaecba`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54779::DEBUG::2014-05-16 17:51:13,815::task::974::TaskManager.Task::(_decref) Task=`1a6916de-3451-440d-842a-d876b0eaecba`::ref 1 aborting False >Thread-54779::INFO::2014-05-16 17:51:13,816::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54779::DEBUG::2014-05-16 17:51:13,816::task::1168::TaskManager.Task::(prepare) Task=`1a6916de-3451-440d-842a-d876b0eaecba`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54779::DEBUG::2014-05-16 17:51:13,816::task::579::TaskManager.Task::(_updateState) Task=`1a6916de-3451-440d-842a-d876b0eaecba`::moving from state preparing -> state finished >Thread-54779::DEBUG::2014-05-16 17:51:13,816::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54779::DEBUG::2014-05-16 17:51:13,816::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54779::DEBUG::2014-05-16 17:51:13,817::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54779::DEBUG::2014-05-16 17:51:13,817::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54779::DEBUG::2014-05-16 17:51:13,817::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54779::DEBUG::2014-05-16 17:51:13,817::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54779::DEBUG::2014-05-16 17:51:13,817::task::974::TaskManager.Task::(_decref) Task=`1a6916de-3451-440d-842a-d876b0eaecba`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:51:13,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:14,015::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347865 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:16,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:16,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325751 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:18,107::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:18,172::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029916 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:20,184::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:20,254::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347597 s, 29.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:51:21,311::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:51:21,321::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000846268 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:22,266::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:22,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359725 s, 28.5 MB/s\n'; <rc> = 0 >Thread-54783::DEBUG::2014-05-16 17:51:23,848::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54783::DEBUG::2014-05-16 17:51:23,848::task::579::TaskManager.Task::(_updateState) Task=`974fba03-19cd-4803-8e9c-9c7cd4a55e51`::moving from state init -> state preparing >Thread-54783::INFO::2014-05-16 17:51:23,848::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54783::INFO::2014-05-16 17:51:23,849::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54783::DEBUG::2014-05-16 17:51:23,849::task::1168::TaskManager.Task::(prepare) Task=`974fba03-19cd-4803-8e9c-9c7cd4a55e51`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54783::DEBUG::2014-05-16 17:51:23,849::task::579::TaskManager.Task::(_updateState) Task=`974fba03-19cd-4803-8e9c-9c7cd4a55e51`::moving from state preparing -> state finished >Thread-54783::DEBUG::2014-05-16 17:51:23,849::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54783::DEBUG::2014-05-16 17:51:23,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54783::DEBUG::2014-05-16 17:51:23,849::task::974::TaskManager.Task::(_decref) Task=`974fba03-19cd-4803-8e9c-9c7cd4a55e51`::ref 0 aborting False >Thread-54784::DEBUG::2014-05-16 17:51:23,857::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54784::DEBUG::2014-05-16 17:51:23,857::task::579::TaskManager.Task::(_updateState) Task=`08d6f820-388b-4687-ae6b-1ef041939eb3`::moving from state init -> state preparing >Thread-54784::INFO::2014-05-16 17:51:23,857::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54784::DEBUG::2014-05-16 17:51:23,858::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b38536c6-9b44-45d9-a45d-4fa322f3c32a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54784::DEBUG::2014-05-16 17:51:23,858::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54784::DEBUG::2014-05-16 17:51:23,858::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54784::DEBUG::2014-05-16 17:51:23,858::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b38536c6-9b44-45d9-a45d-4fa322f3c32a`::Granted request >Thread-54784::DEBUG::2014-05-16 17:51:23,859::task::811::TaskManager.Task::(resourceAcquired) Task=`08d6f820-388b-4687-ae6b-1ef041939eb3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54784::DEBUG::2014-05-16 17:51:23,859::task::974::TaskManager.Task::(_decref) Task=`08d6f820-388b-4687-ae6b-1ef041939eb3`::ref 1 aborting False >Thread-54784::INFO::2014-05-16 17:51:23,859::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54784::DEBUG::2014-05-16 17:51:23,859::task::1168::TaskManager.Task::(prepare) Task=`08d6f820-388b-4687-ae6b-1ef041939eb3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54784::DEBUG::2014-05-16 17:51:23,860::task::579::TaskManager.Task::(_updateState) Task=`08d6f820-388b-4687-ae6b-1ef041939eb3`::moving from state preparing -> state finished >Thread-54784::DEBUG::2014-05-16 17:51:23,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54784::DEBUG::2014-05-16 17:51:23,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54784::DEBUG::2014-05-16 17:51:23,860::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54784::DEBUG::2014-05-16 17:51:23,860::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54784::DEBUG::2014-05-16 17:51:23,860::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54784::DEBUG::2014-05-16 17:51:23,860::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54784::DEBUG::2014-05-16 17:51:23,861::task::974::TaskManager.Task::(_decref) Task=`08d6f820-388b-4687-ae6b-1ef041939eb3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:51:24,349::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:24,426::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355922 s, 28.8 MB/s\n'; <rc> = 0 >Thread-54785::DEBUG::2014-05-16 17:51:25,555::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5416400.000000 / 8.008645 / 262500000.000000 = 0.257645 >Thread-54785::DEBUG::2014-05-16 17:51:25,556::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0063736838205400133, 'statsAge': 1.1604349613189697, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25764538961708855, 'rxDropped': 0} >Thread-54785::DEBUG::2014-05-16 17:51:25,556::task::579::TaskManager.Task::(_updateState) Task=`505b00f2-c66f-4863-830b-af1e0ff40f1a`::moving from state init -> state preparing >Thread-54785::INFO::2014-05-16 17:51:25,556::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54785::INFO::2014-05-16 17:51:25,557::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000846268', 'lastCheck': '4.2', 'valid': True}} >Thread-54785::DEBUG::2014-05-16 17:51:25,557::task::1168::TaskManager.Task::(prepare) Task=`505b00f2-c66f-4863-830b-af1e0ff40f1a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000846268', 'lastCheck': '4.2', 'valid': True}} >Thread-54785::DEBUG::2014-05-16 17:51:25,557::task::579::TaskManager.Task::(_updateState) Task=`505b00f2-c66f-4863-830b-af1e0ff40f1a`::moving from state preparing -> state finished >Thread-54785::DEBUG::2014-05-16 17:51:25,557::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54785::DEBUG::2014-05-16 17:51:25,557::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54785::DEBUG::2014-05-16 17:51:25,557::task::974::TaskManager.Task::(_decref) Task=`505b00f2-c66f-4863-830b-af1e0ff40f1a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:51:26,438::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:26,509::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356004 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:28,516::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:28,583::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030831 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:30,595::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:30,661::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305537 s, 33.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:51:31,340::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 17:51:31,341::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:51:31,358::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:51:31,367::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000749014 s, 2.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:51:31,367::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000749014 s, 2.7 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 17:51:31,368::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 17:51:31,368::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 17:51:31,368::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:51:31,368::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:51:31,369::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:51:31,369::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:51:31,369::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:51:31,370::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:51:31,370::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:51:31,519::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:51:31,520::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:51:31,521::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 17:51:31,522::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 17:51:31,522::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 17:51:31,522::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 17:51:31,522::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:51:31,666::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:51:31,686::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:51:31,697::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000550913 s, 7.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:32,673::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:32,742::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317319 s, 32.3 MB/s\n'; <rc> = 0 >Thread-54789::DEBUG::2014-05-16 17:51:33,897::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54789::DEBUG::2014-05-16 17:51:33,897::task::579::TaskManager.Task::(_updateState) Task=`806b53f9-1660-4826-b406-2f44c882b4aa`::moving from state init -> state preparing >Thread-54789::INFO::2014-05-16 17:51:33,898::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54789::INFO::2014-05-16 17:51:33,898::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54789::DEBUG::2014-05-16 17:51:33,898::task::1168::TaskManager.Task::(prepare) Task=`806b53f9-1660-4826-b406-2f44c882b4aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54789::DEBUG::2014-05-16 17:51:33,898::task::579::TaskManager.Task::(_updateState) Task=`806b53f9-1660-4826-b406-2f44c882b4aa`::moving from state preparing -> state finished >Thread-54789::DEBUG::2014-05-16 17:51:33,899::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54789::DEBUG::2014-05-16 17:51:33,899::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54789::DEBUG::2014-05-16 17:51:33,899::task::974::TaskManager.Task::(_decref) Task=`806b53f9-1660-4826-b406-2f44c882b4aa`::ref 0 aborting False >Thread-54790::DEBUG::2014-05-16 17:51:33,907::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54790::DEBUG::2014-05-16 17:51:33,907::task::579::TaskManager.Task::(_updateState) Task=`9c7c797c-dae9-4e55-9b96-8a2c5336f635`::moving from state init -> state preparing >Thread-54790::INFO::2014-05-16 17:51:33,907::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54790::DEBUG::2014-05-16 17:51:33,908::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e421a7a0-5cff-45cb-8bac-90b441b0ed36`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54790::DEBUG::2014-05-16 17:51:33,908::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54790::DEBUG::2014-05-16 17:51:33,908::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54790::DEBUG::2014-05-16 17:51:33,908::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e421a7a0-5cff-45cb-8bac-90b441b0ed36`::Granted request >Thread-54790::DEBUG::2014-05-16 17:51:33,909::task::811::TaskManager.Task::(resourceAcquired) Task=`9c7c797c-dae9-4e55-9b96-8a2c5336f635`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54790::DEBUG::2014-05-16 17:51:33,909::task::974::TaskManager.Task::(_decref) Task=`9c7c797c-dae9-4e55-9b96-8a2c5336f635`::ref 1 aborting False >Thread-54790::INFO::2014-05-16 17:51:33,910::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54790::DEBUG::2014-05-16 17:51:33,910::task::1168::TaskManager.Task::(prepare) Task=`9c7c797c-dae9-4e55-9b96-8a2c5336f635`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54790::DEBUG::2014-05-16 17:51:33,910::task::579::TaskManager.Task::(_updateState) Task=`9c7c797c-dae9-4e55-9b96-8a2c5336f635`::moving from state preparing -> state finished >Thread-54790::DEBUG::2014-05-16 17:51:33,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54790::DEBUG::2014-05-16 17:51:33,910::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54790::DEBUG::2014-05-16 17:51:33,910::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54790::DEBUG::2014-05-16 17:51:33,911::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54790::DEBUG::2014-05-16 17:51:33,911::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54790::DEBUG::2014-05-16 17:51:33,911::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54790::DEBUG::2014-05-16 17:51:33,911::task::974::TaskManager.Task::(_decref) Task=`9c7c797c-dae9-4e55-9b96-8a2c5336f635`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:51:34,754::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:34,832::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0418906 s, 24.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:36,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:36,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313735 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:38,923::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:38,990::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308199 s, 33.2 MB/s\n'; <rc> = 0 >Thread-54793::DEBUG::2014-05-16 17:51:40,820::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5420022.000000 / 8.008373 / 262500000.000000 = 0.257826 >Thread-54793::DEBUG::2014-05-16 17:51:40,820::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066073702571544171, 'statsAge': 0.40513396263122559, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2578264374076501, 'rxDropped': 0} >Thread-54793::DEBUG::2014-05-16 17:51:40,821::task::579::TaskManager.Task::(_updateState) Task=`54e3a6cf-4d20-49dd-8077-620b64505878`::moving from state init -> state preparing >Thread-54793::INFO::2014-05-16 17:51:40,821::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54793::INFO::2014-05-16 17:51:40,821::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550913', 'lastCheck': '9.1', 'valid': True}} >Thread-54793::DEBUG::2014-05-16 17:51:40,821::task::1168::TaskManager.Task::(prepare) Task=`54e3a6cf-4d20-49dd-8077-620b64505878`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550913', 'lastCheck': '9.1', 'valid': True}} >Thread-54793::DEBUG::2014-05-16 17:51:40,821::task::579::TaskManager.Task::(_updateState) Task=`54e3a6cf-4d20-49dd-8077-620b64505878`::moving from state preparing -> state finished >Thread-54793::DEBUG::2014-05-16 17:51:40,822::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54793::DEBUG::2014-05-16 17:51:40,822::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54793::DEBUG::2014-05-16 17:51:40,822::task::974::TaskManager.Task::(_decref) Task=`54e3a6cf-4d20-49dd-8077-620b64505878`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:51:41,001::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:41,076::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370996 s, 27.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:51:41,731::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:51:41,742::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000776437 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:43,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:43,160::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355369 s, 28.8 MB/s\n'; <rc> = 0 >Thread-54796::DEBUG::2014-05-16 17:51:43,947::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54796::DEBUG::2014-05-16 17:51:43,948::task::579::TaskManager.Task::(_updateState) Task=`2b295a93-113e-47d0-995c-e4e42666d0ae`::moving from state init -> state preparing >Thread-54796::INFO::2014-05-16 17:51:43,948::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54796::INFO::2014-05-16 17:51:43,948::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54796::DEBUG::2014-05-16 17:51:43,949::task::1168::TaskManager.Task::(prepare) Task=`2b295a93-113e-47d0-995c-e4e42666d0ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54796::DEBUG::2014-05-16 17:51:43,949::task::579::TaskManager.Task::(_updateState) Task=`2b295a93-113e-47d0-995c-e4e42666d0ae`::moving from state preparing -> state finished >Thread-54796::DEBUG::2014-05-16 17:51:43,949::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54796::DEBUG::2014-05-16 17:51:43,949::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54796::DEBUG::2014-05-16 17:51:43,949::task::974::TaskManager.Task::(_decref) Task=`2b295a93-113e-47d0-995c-e4e42666d0ae`::ref 0 aborting False >Thread-54797::DEBUG::2014-05-16 17:51:43,959::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54797::DEBUG::2014-05-16 17:51:43,959::task::579::TaskManager.Task::(_updateState) Task=`9f1e2c58-f5c8-4d9a-bfd6-f0bf48bf1bfb`::moving from state init -> state preparing >Thread-54797::INFO::2014-05-16 17:51:43,959::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54797::DEBUG::2014-05-16 17:51:43,960::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`148df260-a6e5-4997-bd65-7d244cf0244d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54797::DEBUG::2014-05-16 17:51:43,960::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54797::DEBUG::2014-05-16 17:51:43,960::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54797::DEBUG::2014-05-16 17:51:43,960::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`148df260-a6e5-4997-bd65-7d244cf0244d`::Granted request >Thread-54797::DEBUG::2014-05-16 17:51:43,961::task::811::TaskManager.Task::(resourceAcquired) Task=`9f1e2c58-f5c8-4d9a-bfd6-f0bf48bf1bfb`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54797::DEBUG::2014-05-16 17:51:43,961::task::974::TaskManager.Task::(_decref) Task=`9f1e2c58-f5c8-4d9a-bfd6-f0bf48bf1bfb`::ref 1 aborting False >Thread-54797::INFO::2014-05-16 17:51:43,961::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54797::DEBUG::2014-05-16 17:51:43,961::task::1168::TaskManager.Task::(prepare) Task=`9f1e2c58-f5c8-4d9a-bfd6-f0bf48bf1bfb`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54797::DEBUG::2014-05-16 17:51:43,962::task::579::TaskManager.Task::(_updateState) Task=`9f1e2c58-f5c8-4d9a-bfd6-f0bf48bf1bfb`::moving from state preparing -> state finished >Thread-54797::DEBUG::2014-05-16 17:51:43,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54797::DEBUG::2014-05-16 17:51:43,962::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54797::DEBUG::2014-05-16 17:51:43,962::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54797::DEBUG::2014-05-16 17:51:43,962::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54797::DEBUG::2014-05-16 17:51:43,962::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54797::DEBUG::2014-05-16 17:51:43,963::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54797::DEBUG::2014-05-16 17:51:43,963::task::974::TaskManager.Task::(_decref) Task=`9f1e2c58-f5c8-4d9a-bfd6-f0bf48bf1bfb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:51:45,172::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:45,239::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309943 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:47,250::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:47,323::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360428 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:49,335::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:49,418::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356375 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:51,434::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:51,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315268 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:51:51,779::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:51:51,789::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:53,513::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:53,580::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030874 s, 33.2 MB/s\n'; <rc> = 0 >Thread-54801::DEBUG::2014-05-16 17:51:53,993::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54801::DEBUG::2014-05-16 17:51:53,993::task::579::TaskManager.Task::(_updateState) Task=`5a0d5481-fbb6-404a-84e0-b96cec1cc21d`::moving from state init -> state preparing >Thread-54801::INFO::2014-05-16 17:51:53,993::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54801::INFO::2014-05-16 17:51:53,994::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54801::DEBUG::2014-05-16 17:51:53,994::task::1168::TaskManager.Task::(prepare) Task=`5a0d5481-fbb6-404a-84e0-b96cec1cc21d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54801::DEBUG::2014-05-16 17:51:53,994::task::579::TaskManager.Task::(_updateState) Task=`5a0d5481-fbb6-404a-84e0-b96cec1cc21d`::moving from state preparing -> state finished >Thread-54801::DEBUG::2014-05-16 17:51:53,994::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54801::DEBUG::2014-05-16 17:51:53,994::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54801::DEBUG::2014-05-16 17:51:53,995::task::974::TaskManager.Task::(_decref) Task=`5a0d5481-fbb6-404a-84e0-b96cec1cc21d`::ref 0 aborting False >Thread-54802::DEBUG::2014-05-16 17:51:54,005::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54802::DEBUG::2014-05-16 17:51:54,005::task::579::TaskManager.Task::(_updateState) Task=`bfc14890-8d4e-4744-8819-3c4b15078737`::moving from state init -> state preparing >Thread-54802::INFO::2014-05-16 17:51:54,005::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54802::DEBUG::2014-05-16 17:51:54,006::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`17a0e841-9865-47c8-8eeb-505a7d3a4ee0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54802::DEBUG::2014-05-16 17:51:54,006::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54802::DEBUG::2014-05-16 17:51:54,006::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54802::DEBUG::2014-05-16 17:51:54,006::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`17a0e841-9865-47c8-8eeb-505a7d3a4ee0`::Granted request >Thread-54802::DEBUG::2014-05-16 17:51:54,007::task::811::TaskManager.Task::(resourceAcquired) Task=`bfc14890-8d4e-4744-8819-3c4b15078737`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54802::DEBUG::2014-05-16 17:51:54,007::task::974::TaskManager.Task::(_decref) Task=`bfc14890-8d4e-4744-8819-3c4b15078737`::ref 1 aborting False >Thread-54802::INFO::2014-05-16 17:51:54,007::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54802::DEBUG::2014-05-16 17:51:54,008::task::1168::TaskManager.Task::(prepare) Task=`bfc14890-8d4e-4744-8819-3c4b15078737`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54802::DEBUG::2014-05-16 17:51:54,008::task::579::TaskManager.Task::(_updateState) Task=`bfc14890-8d4e-4744-8819-3c4b15078737`::moving from state preparing -> state finished >Thread-54802::DEBUG::2014-05-16 17:51:54,008::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54802::DEBUG::2014-05-16 17:51:54,008::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54802::DEBUG::2014-05-16 17:51:54,008::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54802::DEBUG::2014-05-16 17:51:54,008::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54802::DEBUG::2014-05-16 17:51:54,009::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54802::DEBUG::2014-05-16 17:51:54,009::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54802::DEBUG::2014-05-16 17:51:54,009::task::974::TaskManager.Task::(_decref) Task=`bfc14890-8d4e-4744-8819-3c4b15078737`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:51:55,592::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:55,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345615 s, 29.6 MB/s\n'; <rc> = 0 >Thread-54803::DEBUG::2014-05-16 17:51:55,984::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314155.000000 / 8.008508 / 262500000.000000 = 0.205218 >Thread-54803::DEBUG::2014-05-16 17:51:55,984::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051180807517594417, 'statsAge': 1.5546650886535645, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2052177041991817, 'rxDropped': 0} >Thread-54803::DEBUG::2014-05-16 17:51:55,985::task::579::TaskManager.Task::(_updateState) Task=`e6b6e047-c5e2-4c4d-a967-945feda61af0`::moving from state init -> state preparing >Thread-54803::INFO::2014-05-16 17:51:55,985::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54803::INFO::2014-05-16 17:51:55,985::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728', 'lastCheck': '4.2', 'valid': True}} >Thread-54803::DEBUG::2014-05-16 17:51:55,986::task::1168::TaskManager.Task::(prepare) Task=`e6b6e047-c5e2-4c4d-a967-945feda61af0`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728', 'lastCheck': '4.2', 'valid': True}} >Thread-54803::DEBUG::2014-05-16 17:51:55,986::task::579::TaskManager.Task::(_updateState) Task=`e6b6e047-c5e2-4c4d-a967-945feda61af0`::moving from state preparing -> state finished >Thread-54803::DEBUG::2014-05-16 17:51:55,986::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54803::DEBUG::2014-05-16 17:51:55,986::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54803::DEBUG::2014-05-16 17:51:55,986::task::974::TaskManager.Task::(_decref) Task=`e6b6e047-c5e2-4c4d-a967-945feda61af0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:51:57,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:57,741::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316271 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:51:59,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:51:59,821::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314124 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:52:01,827::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:01,837::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 17:52:01,849::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100597 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:02,008::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.133342 s, 7.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:04,019::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:04,087::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309207 s, 33.1 MB/s\n'; <rc> = 0 >Thread-54807::DEBUG::2014-05-16 17:52:04,100::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54807::DEBUG::2014-05-16 17:52:04,100::task::579::TaskManager.Task::(_updateState) Task=`d4e5857b-5e14-49f0-85f5-0432dc9e3a02`::moving from state init -> state preparing >Thread-54807::INFO::2014-05-16 17:52:04,101::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54807::INFO::2014-05-16 17:52:04,101::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54807::DEBUG::2014-05-16 17:52:04,101::task::1168::TaskManager.Task::(prepare) Task=`d4e5857b-5e14-49f0-85f5-0432dc9e3a02`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54807::DEBUG::2014-05-16 17:52:04,101::task::579::TaskManager.Task::(_updateState) Task=`d4e5857b-5e14-49f0-85f5-0432dc9e3a02`::moving from state preparing -> state finished >Thread-54807::DEBUG::2014-05-16 17:52:04,101::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54807::DEBUG::2014-05-16 17:52:04,102::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54807::DEBUG::2014-05-16 17:52:04,102::task::974::TaskManager.Task::(_decref) Task=`d4e5857b-5e14-49f0-85f5-0432dc9e3a02`::ref 0 aborting False >Thread-54808::DEBUG::2014-05-16 17:52:04,142::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54808::DEBUG::2014-05-16 17:52:04,142::task::579::TaskManager.Task::(_updateState) Task=`1eeee965-f6ea-4d4e-9b64-d15cae379241`::moving from state init -> state preparing >Thread-54808::INFO::2014-05-16 17:52:04,143::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54808::DEBUG::2014-05-16 17:52:04,143::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`82f82184-fa7a-4a58-80a4-7403128e6ce4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54808::DEBUG::2014-05-16 17:52:04,143::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54808::DEBUG::2014-05-16 17:52:04,143::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54808::DEBUG::2014-05-16 17:52:04,144::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`82f82184-fa7a-4a58-80a4-7403128e6ce4`::Granted request >Thread-54808::DEBUG::2014-05-16 17:52:04,144::task::811::TaskManager.Task::(resourceAcquired) Task=`1eeee965-f6ea-4d4e-9b64-d15cae379241`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54808::DEBUG::2014-05-16 17:52:04,144::task::974::TaskManager.Task::(_decref) Task=`1eeee965-f6ea-4d4e-9b64-d15cae379241`::ref 1 aborting False >Thread-54808::INFO::2014-05-16 17:52:04,145::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54808::DEBUG::2014-05-16 17:52:04,145::task::1168::TaskManager.Task::(prepare) Task=`1eeee965-f6ea-4d4e-9b64-d15cae379241`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54808::DEBUG::2014-05-16 17:52:04,145::task::579::TaskManager.Task::(_updateState) Task=`1eeee965-f6ea-4d4e-9b64-d15cae379241`::moving from state preparing -> state finished >Thread-54808::DEBUG::2014-05-16 17:52:04,145::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54808::DEBUG::2014-05-16 17:52:04,145::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54808::DEBUG::2014-05-16 17:52:04,146::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54808::DEBUG::2014-05-16 17:52:04,146::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54808::DEBUG::2014-05-16 17:52:04,146::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54808::DEBUG::2014-05-16 17:52:04,146::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54808::DEBUG::2014-05-16 17:52:04,146::task::974::TaskManager.Task::(_decref) Task=`1eeee965-f6ea-4d4e-9b64-d15cae379241`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:52:06,098::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:06,168::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318363 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:08,180::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:08,254::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361287 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:10,266::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:10,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356712 s, 28.7 MB/s\n'; <rc> = 0 >Thread-54811::DEBUG::2014-05-16 17:52:11,131::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318763.000000 / 8.008419 / 262500000.000000 = 0.205439 >Thread-54811::DEBUG::2014-05-16 17:52:11,132::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053557922448845439, 'statsAge': 0.68471384048461914, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20543918094763575, 'rxDropped': 0} >Thread-54811::DEBUG::2014-05-16 17:52:11,132::task::579::TaskManager.Task::(_updateState) Task=`630ca0a7-d9b2-4e91-b5d7-a2d268cc5f79`::moving from state init -> state preparing >Thread-54811::INFO::2014-05-16 17:52:11,132::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54811::INFO::2014-05-16 17:52:11,133::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100597', 'lastCheck': '9.2', 'valid': True}} >Thread-54811::DEBUG::2014-05-16 17:52:11,133::task::1168::TaskManager.Task::(prepare) Task=`630ca0a7-d9b2-4e91-b5d7-a2d268cc5f79`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100597', 'lastCheck': '9.2', 'valid': True}} >Thread-54811::DEBUG::2014-05-16 17:52:11,133::task::579::TaskManager.Task::(_updateState) Task=`630ca0a7-d9b2-4e91-b5d7-a2d268cc5f79`::moving from state preparing -> state finished >Thread-54811::DEBUG::2014-05-16 17:52:11,133::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54811::DEBUG::2014-05-16 17:52:11,133::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54811::DEBUG::2014-05-16 17:52:11,133::task::974::TaskManager.Task::(_decref) Task=`630ca0a7-d9b2-4e91-b5d7-a2d268cc5f79`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:52:11,977::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:52:11,987::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00093339 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:12,349::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:12,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363377 s, 28.2 MB/s\n'; <rc> = 0 >Thread-54813::DEBUG::2014-05-16 17:52:14,181::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54813::DEBUG::2014-05-16 17:52:14,181::task::579::TaskManager.Task::(_updateState) Task=`1535384e-4054-4a6e-adb6-d2aa54809a8d`::moving from state init -> state preparing >Thread-54813::INFO::2014-05-16 17:52:14,181::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54813::INFO::2014-05-16 17:52:14,182::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54813::DEBUG::2014-05-16 17:52:14,182::task::1168::TaskManager.Task::(prepare) Task=`1535384e-4054-4a6e-adb6-d2aa54809a8d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54813::DEBUG::2014-05-16 17:52:14,182::task::579::TaskManager.Task::(_updateState) Task=`1535384e-4054-4a6e-adb6-d2aa54809a8d`::moving from state preparing -> state finished >Thread-54813::DEBUG::2014-05-16 17:52:14,182::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54813::DEBUG::2014-05-16 17:52:14,182::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54813::DEBUG::2014-05-16 17:52:14,182::task::974::TaskManager.Task::(_decref) Task=`1535384e-4054-4a6e-adb6-d2aa54809a8d`::ref 0 aborting False >Thread-54814::DEBUG::2014-05-16 17:52:14,192::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54814::DEBUG::2014-05-16 17:52:14,192::task::579::TaskManager.Task::(_updateState) Task=`c261f3da-9bc3-4593-b135-9882d0c90974`::moving from state init -> state preparing >Thread-54814::INFO::2014-05-16 17:52:14,192::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54814::DEBUG::2014-05-16 17:52:14,193::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`332f9087-56fa-413a-a25d-ed95b30cc681`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54814::DEBUG::2014-05-16 17:52:14,193::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54814::DEBUG::2014-05-16 17:52:14,193::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54814::DEBUG::2014-05-16 17:52:14,193::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`332f9087-56fa-413a-a25d-ed95b30cc681`::Granted request >Thread-54814::DEBUG::2014-05-16 17:52:14,194::task::811::TaskManager.Task::(resourceAcquired) Task=`c261f3da-9bc3-4593-b135-9882d0c90974`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54814::DEBUG::2014-05-16 17:52:14,194::task::974::TaskManager.Task::(_decref) Task=`c261f3da-9bc3-4593-b135-9882d0c90974`::ref 1 aborting False >Thread-54814::INFO::2014-05-16 17:52:14,194::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54814::DEBUG::2014-05-16 17:52:14,195::task::1168::TaskManager.Task::(prepare) Task=`c261f3da-9bc3-4593-b135-9882d0c90974`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54814::DEBUG::2014-05-16 17:52:14,195::task::579::TaskManager.Task::(_updateState) Task=`c261f3da-9bc3-4593-b135-9882d0c90974`::moving from state preparing -> state finished >Thread-54814::DEBUG::2014-05-16 17:52:14,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54814::DEBUG::2014-05-16 17:52:14,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54814::DEBUG::2014-05-16 17:52:14,196::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54814::DEBUG::2014-05-16 17:52:14,196::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54814::DEBUG::2014-05-16 17:52:14,196::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54814::DEBUG::2014-05-16 17:52:14,196::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54814::DEBUG::2014-05-16 17:52:14,196::task::974::TaskManager.Task::(_decref) Task=`c261f3da-9bc3-4593-b135-9882d0c90974`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:52:14,433::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:14,506::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366091 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:16,518::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:16,585::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313866 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:18,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:18,664::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030864 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:20,676::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:20,744::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309247 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:52:22,023::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:52:22,034::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103042 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:22,755::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:22,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361662 s, 28.3 MB/s\n'; <rc> = 0 >Thread-54819::DEBUG::2014-05-16 17:52:24,226::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54819::DEBUG::2014-05-16 17:52:24,226::task::579::TaskManager.Task::(_updateState) Task=`128d112b-e537-40b5-8951-7854d4b29526`::moving from state init -> state preparing >Thread-54819::INFO::2014-05-16 17:52:24,227::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54819::INFO::2014-05-16 17:52:24,227::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54819::DEBUG::2014-05-16 17:52:24,227::task::1168::TaskManager.Task::(prepare) Task=`128d112b-e537-40b5-8951-7854d4b29526`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54819::DEBUG::2014-05-16 17:52:24,227::task::579::TaskManager.Task::(_updateState) Task=`128d112b-e537-40b5-8951-7854d4b29526`::moving from state preparing -> state finished >Thread-54819::DEBUG::2014-05-16 17:52:24,227::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54819::DEBUG::2014-05-16 17:52:24,227::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54819::DEBUG::2014-05-16 17:52:24,228::task::974::TaskManager.Task::(_decref) Task=`128d112b-e537-40b5-8951-7854d4b29526`::ref 0 aborting False >Thread-54820::DEBUG::2014-05-16 17:52:24,236::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54820::DEBUG::2014-05-16 17:52:24,236::task::579::TaskManager.Task::(_updateState) Task=`6d0ffab2-9fc3-4847-b4e9-0b64261c9fe4`::moving from state init -> state preparing >Thread-54820::INFO::2014-05-16 17:52:24,236::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54820::DEBUG::2014-05-16 17:52:24,237::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`99b92dd4-d970-4c4d-ad97-186a33e270f9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54820::DEBUG::2014-05-16 17:52:24,237::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54820::DEBUG::2014-05-16 17:52:24,237::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54820::DEBUG::2014-05-16 17:52:24,237::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`99b92dd4-d970-4c4d-ad97-186a33e270f9`::Granted request >Thread-54820::DEBUG::2014-05-16 17:52:24,238::task::811::TaskManager.Task::(resourceAcquired) Task=`6d0ffab2-9fc3-4847-b4e9-0b64261c9fe4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54820::DEBUG::2014-05-16 17:52:24,238::task::974::TaskManager.Task::(_decref) Task=`6d0ffab2-9fc3-4847-b4e9-0b64261c9fe4`::ref 1 aborting False >Thread-54820::INFO::2014-05-16 17:52:24,238::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54820::DEBUG::2014-05-16 17:52:24,238::task::1168::TaskManager.Task::(prepare) Task=`6d0ffab2-9fc3-4847-b4e9-0b64261c9fe4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54820::DEBUG::2014-05-16 17:52:24,239::task::579::TaskManager.Task::(_updateState) Task=`6d0ffab2-9fc3-4847-b4e9-0b64261c9fe4`::moving from state preparing -> state finished >Thread-54820::DEBUG::2014-05-16 17:52:24,239::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54820::DEBUG::2014-05-16 17:52:24,239::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54820::DEBUG::2014-05-16 17:52:24,239::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54820::DEBUG::2014-05-16 17:52:24,239::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54820::DEBUG::2014-05-16 17:52:24,239::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54820::DEBUG::2014-05-16 17:52:24,239::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54820::DEBUG::2014-05-16 17:52:24,240::task::974::TaskManager.Task::(_decref) Task=`6d0ffab2-9fc3-4847-b4e9-0b64261c9fe4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:52:24,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:24,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354795 s, 28.9 MB/s\n'; <rc> = 0 >Thread-54821::DEBUG::2014-05-16 17:52:26,275::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413857.000000 / 8.008290 / 262500000.000000 = 0.257536 >Thread-54821::DEBUG::2014-05-16 17:52:26,275::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065627231446678752, 'statsAge': 1.8129150867462158, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25753584108308342, 'rxDropped': 0} >Thread-54821::DEBUG::2014-05-16 17:52:26,276::task::579::TaskManager.Task::(_updateState) Task=`16b2385b-15b3-476b-bb13-b0426979a061`::moving from state init -> state preparing >Thread-54821::INFO::2014-05-16 17:52:26,276::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54821::INFO::2014-05-16 17:52:26,276::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103042', 'lastCheck': '4.2', 'valid': True}} >Thread-54821::DEBUG::2014-05-16 17:52:26,277::task::1168::TaskManager.Task::(prepare) Task=`16b2385b-15b3-476b-bb13-b0426979a061`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103042', 'lastCheck': '4.2', 'valid': True}} >Thread-54821::DEBUG::2014-05-16 17:52:26,277::task::579::TaskManager.Task::(_updateState) Task=`16b2385b-15b3-476b-bb13-b0426979a061`::moving from state preparing -> state finished >Thread-54821::DEBUG::2014-05-16 17:52:26,277::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54821::DEBUG::2014-05-16 17:52:26,277::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54821::DEBUG::2014-05-16 17:52:26,277::task::974::TaskManager.Task::(_decref) Task=`16b2385b-15b3-476b-bb13-b0426979a061`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:52:26,923::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:26,991::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321741 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:29,002::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:29,077::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368371 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:31,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:31,157::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032054 s, 31.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:52:32,071::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:52:32,082::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000784708 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:33,168::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:33,235::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305802 s, 33.5 MB/s\n'; <rc> = 0 >Thread-54825::DEBUG::2014-05-16 17:52:34,277::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54825::DEBUG::2014-05-16 17:52:34,277::task::579::TaskManager.Task::(_updateState) Task=`7a5b532c-40f7-46b7-8e93-032bd7076c54`::moving from state init -> state preparing >Thread-54825::INFO::2014-05-16 17:52:34,277::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54825::INFO::2014-05-16 17:52:34,278::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54825::DEBUG::2014-05-16 17:52:34,278::task::1168::TaskManager.Task::(prepare) Task=`7a5b532c-40f7-46b7-8e93-032bd7076c54`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54825::DEBUG::2014-05-16 17:52:34,278::task::579::TaskManager.Task::(_updateState) Task=`7a5b532c-40f7-46b7-8e93-032bd7076c54`::moving from state preparing -> state finished >Thread-54825::DEBUG::2014-05-16 17:52:34,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54825::DEBUG::2014-05-16 17:52:34,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54825::DEBUG::2014-05-16 17:52:34,278::task::974::TaskManager.Task::(_decref) Task=`7a5b532c-40f7-46b7-8e93-032bd7076c54`::ref 0 aborting False >Thread-54826::DEBUG::2014-05-16 17:52:34,360::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54826::DEBUG::2014-05-16 17:52:34,360::task::579::TaskManager.Task::(_updateState) Task=`80dbf638-67d2-4963-9c69-c5e4beee2c46`::moving from state init -> state preparing >Thread-54826::INFO::2014-05-16 17:52:34,360::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54826::DEBUG::2014-05-16 17:52:34,361::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`febeaacd-2cb2-4008-bda2-417e2eff52a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54826::DEBUG::2014-05-16 17:52:34,361::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54826::DEBUG::2014-05-16 17:52:34,361::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54826::DEBUG::2014-05-16 17:52:34,361::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`febeaacd-2cb2-4008-bda2-417e2eff52a5`::Granted request >Thread-54826::DEBUG::2014-05-16 17:52:34,361::task::811::TaskManager.Task::(resourceAcquired) Task=`80dbf638-67d2-4963-9c69-c5e4beee2c46`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54826::DEBUG::2014-05-16 17:52:34,362::task::974::TaskManager.Task::(_decref) Task=`80dbf638-67d2-4963-9c69-c5e4beee2c46`::ref 1 aborting False >Thread-54826::INFO::2014-05-16 17:52:34,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54826::DEBUG::2014-05-16 17:52:34,362::task::1168::TaskManager.Task::(prepare) Task=`80dbf638-67d2-4963-9c69-c5e4beee2c46`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54826::DEBUG::2014-05-16 17:52:34,363::task::579::TaskManager.Task::(_updateState) Task=`80dbf638-67d2-4963-9c69-c5e4beee2c46`::moving from state preparing -> state finished >Thread-54826::DEBUG::2014-05-16 17:52:34,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54826::DEBUG::2014-05-16 17:52:34,363::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54826::DEBUG::2014-05-16 17:52:34,363::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54826::DEBUG::2014-05-16 17:52:34,363::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54826::DEBUG::2014-05-16 17:52:34,363::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54826::DEBUG::2014-05-16 17:52:34,364::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54826::DEBUG::2014-05-16 17:52:34,364::task::974::TaskManager.Task::(_decref) Task=`80dbf638-67d2-4963-9c69-c5e4beee2c46`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:52:35,247::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:35,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035604 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:37,331::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:37,399::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320012 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:39,411::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:39,484::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359936 s, 28.4 MB/s\n'; <rc> = 0 >Thread-54829::DEBUG::2014-05-16 17:52:41,432::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5418341.000000 / 8.008462 / 262500000.000000 = 0.257744 >Thread-54829::DEBUG::2014-05-16 17:52:41,432::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0067007216757887685, 'statsAge': 0.95258092880249023, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25774360365682492, 'rxDropped': 0} >Thread-54829::DEBUG::2014-05-16 17:52:41,432::task::579::TaskManager.Task::(_updateState) Task=`965e9057-82ab-441a-ba90-aa69363aeb5b`::moving from state init -> state preparing >Thread-54829::INFO::2014-05-16 17:52:41,433::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54829::INFO::2014-05-16 17:52:41,433::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000784708', 'lastCheck': '9.3', 'valid': True}} >Thread-54829::DEBUG::2014-05-16 17:52:41,433::task::1168::TaskManager.Task::(prepare) Task=`965e9057-82ab-441a-ba90-aa69363aeb5b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000784708', 'lastCheck': '9.3', 'valid': True}} >Thread-54829::DEBUG::2014-05-16 17:52:41,433::task::579::TaskManager.Task::(_updateState) Task=`965e9057-82ab-441a-ba90-aa69363aeb5b`::moving from state preparing -> state finished >Thread-54829::DEBUG::2014-05-16 17:52:41,433::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54829::DEBUG::2014-05-16 17:52:41,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54829::DEBUG::2014-05-16 17:52:41,434::task::974::TaskManager.Task::(_decref) Task=`965e9057-82ab-441a-ba90-aa69363aeb5b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:52:41,496::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:41,567::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359995 s, 28.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:52:42,116::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:52:42,126::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000834533 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:43,579::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:43,650::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352177 s, 29.1 MB/s\n'; <rc> = 0 >Thread-54831::DEBUG::2014-05-16 17:52:44,447::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54831::DEBUG::2014-05-16 17:52:44,447::task::579::TaskManager.Task::(_updateState) Task=`f7ea20ef-e840-4541-a0f0-9bb5953a9dd7`::moving from state init -> state preparing >Thread-54831::INFO::2014-05-16 17:52:44,448::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54831::INFO::2014-05-16 17:52:44,448::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54831::DEBUG::2014-05-16 17:52:44,448::task::1168::TaskManager.Task::(prepare) Task=`f7ea20ef-e840-4541-a0f0-9bb5953a9dd7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54831::DEBUG::2014-05-16 17:52:44,448::task::579::TaskManager.Task::(_updateState) Task=`f7ea20ef-e840-4541-a0f0-9bb5953a9dd7`::moving from state preparing -> state finished >Thread-54831::DEBUG::2014-05-16 17:52:44,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54831::DEBUG::2014-05-16 17:52:44,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54831::DEBUG::2014-05-16 17:52:44,449::task::974::TaskManager.Task::(_decref) Task=`f7ea20ef-e840-4541-a0f0-9bb5953a9dd7`::ref 0 aborting False >Thread-54832::DEBUG::2014-05-16 17:52:44,477::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54832::DEBUG::2014-05-16 17:52:44,478::task::579::TaskManager.Task::(_updateState) Task=`68824288-c6f8-40c6-94ca-abbc4e50e40b`::moving from state init -> state preparing >Thread-54832::INFO::2014-05-16 17:52:44,478::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54832::DEBUG::2014-05-16 17:52:44,478::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`669659cc-b7bf-4c3f-9645-a57010e23304`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54832::DEBUG::2014-05-16 17:52:44,478::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54832::DEBUG::2014-05-16 17:52:44,479::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54832::DEBUG::2014-05-16 17:52:44,479::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`669659cc-b7bf-4c3f-9645-a57010e23304`::Granted request >Thread-54832::DEBUG::2014-05-16 17:52:44,479::task::811::TaskManager.Task::(resourceAcquired) Task=`68824288-c6f8-40c6-94ca-abbc4e50e40b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54832::DEBUG::2014-05-16 17:52:44,479::task::974::TaskManager.Task::(_decref) Task=`68824288-c6f8-40c6-94ca-abbc4e50e40b`::ref 1 aborting False >Thread-54832::INFO::2014-05-16 17:52:44,480::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54832::DEBUG::2014-05-16 17:52:44,480::task::1168::TaskManager.Task::(prepare) Task=`68824288-c6f8-40c6-94ca-abbc4e50e40b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54832::DEBUG::2014-05-16 17:52:44,480::task::579::TaskManager.Task::(_updateState) Task=`68824288-c6f8-40c6-94ca-abbc4e50e40b`::moving from state preparing -> state finished >Thread-54832::DEBUG::2014-05-16 17:52:44,481::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54832::DEBUG::2014-05-16 17:52:44,481::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54832::DEBUG::2014-05-16 17:52:44,481::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54832::DEBUG::2014-05-16 17:52:44,481::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54832::DEBUG::2014-05-16 17:52:44,481::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54832::DEBUG::2014-05-16 17:52:44,481::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54832::DEBUG::2014-05-16 17:52:44,482::task::974::TaskManager.Task::(_decref) Task=`68824288-c6f8-40c6-94ca-abbc4e50e40b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:52:45,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:45,729::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315212 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:47,741::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:47,809::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313551 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:49,820::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:49,893::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352156 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:51,905::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:51,972::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316011 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:52:52,163::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:52:52,173::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000724869 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:52:53,984::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:54,052::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307164 s, 33.3 MB/s\n'; <rc> = 0 >Thread-54837::DEBUG::2014-05-16 17:52:54,526::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54837::DEBUG::2014-05-16 17:52:54,527::task::579::TaskManager.Task::(_updateState) Task=`8c4f533d-7cdc-4053-9972-e627ab3b7e97`::moving from state init -> state preparing >Thread-54837::INFO::2014-05-16 17:52:54,527::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54837::INFO::2014-05-16 17:52:54,527::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54837::DEBUG::2014-05-16 17:52:54,527::task::1168::TaskManager.Task::(prepare) Task=`8c4f533d-7cdc-4053-9972-e627ab3b7e97`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54837::DEBUG::2014-05-16 17:52:54,527::task::579::TaskManager.Task::(_updateState) Task=`8c4f533d-7cdc-4053-9972-e627ab3b7e97`::moving from state preparing -> state finished >Thread-54837::DEBUG::2014-05-16 17:52:54,528::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54837::DEBUG::2014-05-16 17:52:54,528::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54837::DEBUG::2014-05-16 17:52:54,528::task::974::TaskManager.Task::(_decref) Task=`8c4f533d-7cdc-4053-9972-e627ab3b7e97`::ref 0 aborting False >Thread-54838::DEBUG::2014-05-16 17:52:54,539::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54838::DEBUG::2014-05-16 17:52:54,539::task::579::TaskManager.Task::(_updateState) Task=`78a3ce2c-55c9-4f59-acc9-6b95b5d056eb`::moving from state init -> state preparing >Thread-54838::INFO::2014-05-16 17:52:54,539::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54838::DEBUG::2014-05-16 17:52:54,540::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fd2fb17e-72df-4bdb-92c1-1d979d65a9f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54838::DEBUG::2014-05-16 17:52:54,540::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54838::DEBUG::2014-05-16 17:52:54,540::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54838::DEBUG::2014-05-16 17:52:54,540::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fd2fb17e-72df-4bdb-92c1-1d979d65a9f5`::Granted request >Thread-54838::DEBUG::2014-05-16 17:52:54,541::task::811::TaskManager.Task::(resourceAcquired) Task=`78a3ce2c-55c9-4f59-acc9-6b95b5d056eb`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54838::DEBUG::2014-05-16 17:52:54,541::task::974::TaskManager.Task::(_decref) Task=`78a3ce2c-55c9-4f59-acc9-6b95b5d056eb`::ref 1 aborting False >Thread-54838::INFO::2014-05-16 17:52:54,541::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54838::DEBUG::2014-05-16 17:52:54,541::task::1168::TaskManager.Task::(prepare) Task=`78a3ce2c-55c9-4f59-acc9-6b95b5d056eb`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54838::DEBUG::2014-05-16 17:52:54,542::task::579::TaskManager.Task::(_updateState) Task=`78a3ce2c-55c9-4f59-acc9-6b95b5d056eb`::moving from state preparing -> state finished >Thread-54838::DEBUG::2014-05-16 17:52:54,542::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54838::DEBUG::2014-05-16 17:52:54,542::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54838::DEBUG::2014-05-16 17:52:54,542::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54838::DEBUG::2014-05-16 17:52:54,542::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54838::DEBUG::2014-05-16 17:52:54,542::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54838::DEBUG::2014-05-16 17:52:54,543::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54838::DEBUG::2014-05-16 17:52:54,543::task::974::TaskManager.Task::(_decref) Task=`78a3ce2c-55c9-4f59-acc9-6b95b5d056eb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:52:56,063::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:56,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356138 s, 28.8 MB/s\n'; <rc> = 0 >Thread-54839::DEBUG::2014-05-16 17:52:56,617::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3244683.000000 / 8.008920 / 262500000.000000 = 0.154337 >Thread-54839::DEBUG::2014-05-16 17:52:56,617::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041015219423246483, 'statsAge': 0.12052392959594727, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15433662523064165, 'rxDropped': 0} >Thread-54839::DEBUG::2014-05-16 17:52:56,619::task::579::TaskManager.Task::(_updateState) Task=`17ccf0c0-436c-4417-b66e-bc2a85339645`::moving from state init -> state preparing >Thread-54839::INFO::2014-05-16 17:52:56,619::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54839::INFO::2014-05-16 17:52:56,619::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000724869', 'lastCheck': '4.4', 'valid': True}} >Thread-54839::DEBUG::2014-05-16 17:52:56,619::task::1168::TaskManager.Task::(prepare) Task=`17ccf0c0-436c-4417-b66e-bc2a85339645`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000724869', 'lastCheck': '4.4', 'valid': True}} >Thread-54839::DEBUG::2014-05-16 17:52:56,620::task::579::TaskManager.Task::(_updateState) Task=`17ccf0c0-436c-4417-b66e-bc2a85339645`::moving from state preparing -> state finished >Thread-54839::DEBUG::2014-05-16 17:52:56,620::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54839::DEBUG::2014-05-16 17:52:56,620::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54839::DEBUG::2014-05-16 17:52:56,620::task::974::TaskManager.Task::(_decref) Task=`17ccf0c0-436c-4417-b66e-bc2a85339645`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:52:58,146::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:52:58,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312883 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:00,224::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:00,291::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305116 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:53:02,211::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:53:02,222::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101383 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:02,303::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:02,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355123 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:04,385::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:04,453::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031269 s, 32.7 MB/s\n'; <rc> = 0 >Thread-54843::DEBUG::2014-05-16 17:53:04,579::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54843::DEBUG::2014-05-16 17:53:04,580::task::579::TaskManager.Task::(_updateState) Task=`bb30be9f-fc29-40ae-aa23-e98e1b92398b`::moving from state init -> state preparing >Thread-54843::INFO::2014-05-16 17:53:04,580::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54843::INFO::2014-05-16 17:53:04,580::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54843::DEBUG::2014-05-16 17:53:04,580::task::1168::TaskManager.Task::(prepare) Task=`bb30be9f-fc29-40ae-aa23-e98e1b92398b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54843::DEBUG::2014-05-16 17:53:04,581::task::579::TaskManager.Task::(_updateState) Task=`bb30be9f-fc29-40ae-aa23-e98e1b92398b`::moving from state preparing -> state finished >Thread-54843::DEBUG::2014-05-16 17:53:04,581::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54843::DEBUG::2014-05-16 17:53:04,581::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54843::DEBUG::2014-05-16 17:53:04,581::task::974::TaskManager.Task::(_decref) Task=`bb30be9f-fc29-40ae-aa23-e98e1b92398b`::ref 0 aborting False >Thread-54844::DEBUG::2014-05-16 17:53:04,591::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54844::DEBUG::2014-05-16 17:53:04,591::task::579::TaskManager.Task::(_updateState) Task=`3e53c3be-ff1c-4d91-9c3b-d1cd26477a6d`::moving from state init -> state preparing >Thread-54844::INFO::2014-05-16 17:53:04,591::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54844::DEBUG::2014-05-16 17:53:04,592::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`72386bdd-5488-4f35-94f8-47da608dfe6e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54844::DEBUG::2014-05-16 17:53:04,592::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54844::DEBUG::2014-05-16 17:53:04,592::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54844::DEBUG::2014-05-16 17:53:04,592::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`72386bdd-5488-4f35-94f8-47da608dfe6e`::Granted request >Thread-54844::DEBUG::2014-05-16 17:53:04,592::task::811::TaskManager.Task::(resourceAcquired) Task=`3e53c3be-ff1c-4d91-9c3b-d1cd26477a6d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54844::DEBUG::2014-05-16 17:53:04,593::task::974::TaskManager.Task::(_decref) Task=`3e53c3be-ff1c-4d91-9c3b-d1cd26477a6d`::ref 1 aborting False >Thread-54844::INFO::2014-05-16 17:53:04,593::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54844::DEBUG::2014-05-16 17:53:04,593::task::1168::TaskManager.Task::(prepare) Task=`3e53c3be-ff1c-4d91-9c3b-d1cd26477a6d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54844::DEBUG::2014-05-16 17:53:04,594::task::579::TaskManager.Task::(_updateState) Task=`3e53c3be-ff1c-4d91-9c3b-d1cd26477a6d`::moving from state preparing -> state finished >Thread-54844::DEBUG::2014-05-16 17:53:04,594::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54844::DEBUG::2014-05-16 17:53:04,594::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54844::DEBUG::2014-05-16 17:53:04,594::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54844::DEBUG::2014-05-16 17:53:04,594::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54844::DEBUG::2014-05-16 17:53:04,594::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54844::DEBUG::2014-05-16 17:53:04,595::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54844::DEBUG::2014-05-16 17:53:04,595::task::974::TaskManager.Task::(_decref) Task=`3e53c3be-ff1c-4d91-9c3b-d1cd26477a6d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:53:06,464::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:06,537::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321696 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:08,549::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:08,618::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353535 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:10,625::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:10,696::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349435 s, 29.3 MB/s\n'; <rc> = 0 >Thread-54847::DEBUG::2014-05-16 17:53:11,812::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4320018.000000 / 8.011590 / 262500000.000000 = 0.205418 >Thread-54847::DEBUG::2014-05-16 17:53:11,812::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053475860154415375, 'statsAge': 1.2971091270446777, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20541754408827623, 'rxDropped': 0} >Thread-54847::DEBUG::2014-05-16 17:53:11,813::task::579::TaskManager.Task::(_updateState) Task=`b519ef45-c191-4a25-b8d6-3d905784202c`::moving from state init -> state preparing >Thread-54847::INFO::2014-05-16 17:53:11,813::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54847::INFO::2014-05-16 17:53:11,814::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101383', 'lastCheck': '9.6', 'valid': True}} >Thread-54847::DEBUG::2014-05-16 17:53:11,814::task::1168::TaskManager.Task::(prepare) Task=`b519ef45-c191-4a25-b8d6-3d905784202c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101383', 'lastCheck': '9.6', 'valid': True}} >Thread-54847::DEBUG::2014-05-16 17:53:11,814::task::579::TaskManager.Task::(_updateState) Task=`b519ef45-c191-4a25-b8d6-3d905784202c`::moving from state preparing -> state finished >Thread-54847::DEBUG::2014-05-16 17:53:11,814::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54847::DEBUG::2014-05-16 17:53:11,814::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54847::DEBUG::2014-05-16 17:53:11,814::task::974::TaskManager.Task::(_decref) Task=`b519ef45-c191-4a25-b8d6-3d905784202c`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:53:12,253::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:53:12,264::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104914 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:12,708::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:12,778::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354116 s, 28.9 MB/s\n'; <rc> = 0 >Thread-54849::DEBUG::2014-05-16 17:53:14,637::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54849::DEBUG::2014-05-16 17:53:14,638::task::579::TaskManager.Task::(_updateState) Task=`a6cb4fb7-ce77-4ae6-ac7e-0af7518a057f`::moving from state init -> state preparing >Thread-54849::INFO::2014-05-16 17:53:14,638::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54849::INFO::2014-05-16 17:53:14,638::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54849::DEBUG::2014-05-16 17:53:14,638::task::1168::TaskManager.Task::(prepare) Task=`a6cb4fb7-ce77-4ae6-ac7e-0af7518a057f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54849::DEBUG::2014-05-16 17:53:14,638::task::579::TaskManager.Task::(_updateState) Task=`a6cb4fb7-ce77-4ae6-ac7e-0af7518a057f`::moving from state preparing -> state finished >Thread-54849::DEBUG::2014-05-16 17:53:14,639::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54849::DEBUG::2014-05-16 17:53:14,639::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54849::DEBUG::2014-05-16 17:53:14,639::task::974::TaskManager.Task::(_decref) Task=`a6cb4fb7-ce77-4ae6-ac7e-0af7518a057f`::ref 0 aborting False >Thread-54850::DEBUG::2014-05-16 17:53:14,651::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54850::DEBUG::2014-05-16 17:53:14,651::task::579::TaskManager.Task::(_updateState) Task=`4ebb72bf-fa6e-4f13-83bc-d7a9a31eebeb`::moving from state init -> state preparing >Thread-54850::INFO::2014-05-16 17:53:14,651::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54850::DEBUG::2014-05-16 17:53:14,651::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d5459d2a-a40d-4ef1-ae7a-80c6690a158a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54850::DEBUG::2014-05-16 17:53:14,651::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54850::DEBUG::2014-05-16 17:53:14,652::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54850::DEBUG::2014-05-16 17:53:14,652::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d5459d2a-a40d-4ef1-ae7a-80c6690a158a`::Granted request >Thread-54850::DEBUG::2014-05-16 17:53:14,652::task::811::TaskManager.Task::(resourceAcquired) Task=`4ebb72bf-fa6e-4f13-83bc-d7a9a31eebeb`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54850::DEBUG::2014-05-16 17:53:14,652::task::974::TaskManager.Task::(_decref) Task=`4ebb72bf-fa6e-4f13-83bc-d7a9a31eebeb`::ref 1 aborting False >Thread-54850::INFO::2014-05-16 17:53:14,653::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54850::DEBUG::2014-05-16 17:53:14,653::task::1168::TaskManager.Task::(prepare) Task=`4ebb72bf-fa6e-4f13-83bc-d7a9a31eebeb`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54850::DEBUG::2014-05-16 17:53:14,653::task::579::TaskManager.Task::(_updateState) Task=`4ebb72bf-fa6e-4f13-83bc-d7a9a31eebeb`::moving from state preparing -> state finished >Thread-54850::DEBUG::2014-05-16 17:53:14,653::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54850::DEBUG::2014-05-16 17:53:14,653::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54850::DEBUG::2014-05-16 17:53:14,654::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54850::DEBUG::2014-05-16 17:53:14,654::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54850::DEBUG::2014-05-16 17:53:14,654::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54850::DEBUG::2014-05-16 17:53:14,654::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54850::DEBUG::2014-05-16 17:53:14,654::task::974::TaskManager.Task::(_decref) Task=`4ebb72bf-fa6e-4f13-83bc-d7a9a31eebeb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:53:14,790::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:14,859::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309208 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:16,870::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:16,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363996 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:18,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:19,022::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307977 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:21,033::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:21,100::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300698 s, 34.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:53:22,302::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:53:22,312::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105688 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:23,112::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:23,185::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035851 s, 28.6 MB/s\n'; <rc> = 0 >Thread-54855::DEBUG::2014-05-16 17:53:24,696::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54855::DEBUG::2014-05-16 17:53:24,697::task::579::TaskManager.Task::(_updateState) Task=`df07136b-1402-4e53-81af-db7064bea837`::moving from state init -> state preparing >Thread-54855::INFO::2014-05-16 17:53:24,697::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54855::INFO::2014-05-16 17:53:24,697::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54855::DEBUG::2014-05-16 17:53:24,697::task::1168::TaskManager.Task::(prepare) Task=`df07136b-1402-4e53-81af-db7064bea837`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54855::DEBUG::2014-05-16 17:53:24,698::task::579::TaskManager.Task::(_updateState) Task=`df07136b-1402-4e53-81af-db7064bea837`::moving from state preparing -> state finished >Thread-54855::DEBUG::2014-05-16 17:53:24,698::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54855::DEBUG::2014-05-16 17:53:24,698::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54855::DEBUG::2014-05-16 17:53:24,698::task::974::TaskManager.Task::(_decref) Task=`df07136b-1402-4e53-81af-db7064bea837`::ref 0 aborting False >Thread-54856::DEBUG::2014-05-16 17:53:24,707::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54856::DEBUG::2014-05-16 17:53:24,708::task::579::TaskManager.Task::(_updateState) Task=`d6db5c78-bd7e-4918-83a5-2d75d6251d0b`::moving from state init -> state preparing >Thread-54856::INFO::2014-05-16 17:53:24,708::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54856::DEBUG::2014-05-16 17:53:24,708::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b412bd3f-a318-4644-9625-ce2cc60e7ed9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54856::DEBUG::2014-05-16 17:53:24,708::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54856::DEBUG::2014-05-16 17:53:24,709::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54856::DEBUG::2014-05-16 17:53:24,709::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b412bd3f-a318-4644-9625-ce2cc60e7ed9`::Granted request >Thread-54856::DEBUG::2014-05-16 17:53:24,709::task::811::TaskManager.Task::(resourceAcquired) Task=`d6db5c78-bd7e-4918-83a5-2d75d6251d0b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54856::DEBUG::2014-05-16 17:53:24,709::task::974::TaskManager.Task::(_decref) Task=`d6db5c78-bd7e-4918-83a5-2d75d6251d0b`::ref 1 aborting False >Thread-54856::INFO::2014-05-16 17:53:24,710::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54856::DEBUG::2014-05-16 17:53:24,710::task::1168::TaskManager.Task::(prepare) Task=`d6db5c78-bd7e-4918-83a5-2d75d6251d0b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54856::DEBUG::2014-05-16 17:53:24,710::task::579::TaskManager.Task::(_updateState) Task=`d6db5c78-bd7e-4918-83a5-2d75d6251d0b`::moving from state preparing -> state finished >Thread-54856::DEBUG::2014-05-16 17:53:24,710::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54856::DEBUG::2014-05-16 17:53:24,711::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54856::DEBUG::2014-05-16 17:53:24,711::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54856::DEBUG::2014-05-16 17:53:24,711::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54856::DEBUG::2014-05-16 17:53:24,711::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54856::DEBUG::2014-05-16 17:53:24,711::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54856::DEBUG::2014-05-16 17:53:24,711::task::974::TaskManager.Task::(_decref) Task=`d6db5c78-bd7e-4918-83a5-2d75d6251d0b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:53:25,196::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:25,268::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353063 s, 29.0 MB/s\n'; <rc> = 0 >Thread-54857::DEBUG::2014-05-16 17:53:26,976::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5416629.000000 / 8.008201 / 262500000.000000 = 0.257671 >Thread-54857::DEBUG::2014-05-16 17:53:26,976::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066191194331844533, 'statsAge': 0.44391798973083496, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25767057347963601, 'rxDropped': 0} >Thread-54857::DEBUG::2014-05-16 17:53:26,976::task::579::TaskManager.Task::(_updateState) Task=`abb44fd5-363f-47b3-975e-3af5bde38f9c`::moving from state init -> state preparing >Thread-54857::INFO::2014-05-16 17:53:26,976::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54857::INFO::2014-05-16 17:53:26,977::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105688', 'lastCheck': '4.6', 'valid': True}} >Thread-54857::DEBUG::2014-05-16 17:53:26,977::task::1168::TaskManager.Task::(prepare) Task=`abb44fd5-363f-47b3-975e-3af5bde38f9c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105688', 'lastCheck': '4.6', 'valid': True}} >Thread-54857::DEBUG::2014-05-16 17:53:26,977::task::579::TaskManager.Task::(_updateState) Task=`abb44fd5-363f-47b3-975e-3af5bde38f9c`::moving from state preparing -> state finished >Thread-54857::DEBUG::2014-05-16 17:53:26,977::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54857::DEBUG::2014-05-16 17:53:26,977::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54857::DEBUG::2014-05-16 17:53:26,977::task::974::TaskManager.Task::(_decref) Task=`abb44fd5-363f-47b3-975e-3af5bde38f9c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:53:27,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:27,347::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319646 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:29,359::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:29,433::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364701 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:31,446::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:31,517::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355921 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:53:32,349::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:53:32,359::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000771539 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:33,529::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:33,596::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306036 s, 33.5 MB/s\n'; <rc> = 0 >Thread-54861::DEBUG::2014-05-16 17:53:34,755::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54861::DEBUG::2014-05-16 17:53:34,756::task::579::TaskManager.Task::(_updateState) Task=`cdfd150a-1cd9-484b-9b21-cc8e1399519a`::moving from state init -> state preparing >Thread-54861::INFO::2014-05-16 17:53:34,756::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54861::INFO::2014-05-16 17:53:34,756::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54861::DEBUG::2014-05-16 17:53:34,757::task::1168::TaskManager.Task::(prepare) Task=`cdfd150a-1cd9-484b-9b21-cc8e1399519a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54861::DEBUG::2014-05-16 17:53:34,757::task::579::TaskManager.Task::(_updateState) Task=`cdfd150a-1cd9-484b-9b21-cc8e1399519a`::moving from state preparing -> state finished >Thread-54861::DEBUG::2014-05-16 17:53:34,757::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54861::DEBUG::2014-05-16 17:53:34,757::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54861::DEBUG::2014-05-16 17:53:34,757::task::974::TaskManager.Task::(_decref) Task=`cdfd150a-1cd9-484b-9b21-cc8e1399519a`::ref 0 aborting False >Thread-54862::DEBUG::2014-05-16 17:53:34,765::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54862::DEBUG::2014-05-16 17:53:34,766::task::579::TaskManager.Task::(_updateState) Task=`27ca6656-d162-4197-8077-26810bca78ed`::moving from state init -> state preparing >Thread-54862::INFO::2014-05-16 17:53:34,766::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54862::DEBUG::2014-05-16 17:53:34,766::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`abdbdcc9-e186-4cdc-9adb-2de1289e5514`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54862::DEBUG::2014-05-16 17:53:34,766::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54862::DEBUG::2014-05-16 17:53:34,767::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54862::DEBUG::2014-05-16 17:53:34,767::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`abdbdcc9-e186-4cdc-9adb-2de1289e5514`::Granted request >Thread-54862::DEBUG::2014-05-16 17:53:34,767::task::811::TaskManager.Task::(resourceAcquired) Task=`27ca6656-d162-4197-8077-26810bca78ed`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54862::DEBUG::2014-05-16 17:53:34,767::task::974::TaskManager.Task::(_decref) Task=`27ca6656-d162-4197-8077-26810bca78ed`::ref 1 aborting False >Thread-54862::INFO::2014-05-16 17:53:34,768::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54862::DEBUG::2014-05-16 17:53:34,768::task::1168::TaskManager.Task::(prepare) Task=`27ca6656-d162-4197-8077-26810bca78ed`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54862::DEBUG::2014-05-16 17:53:34,768::task::579::TaskManager.Task::(_updateState) Task=`27ca6656-d162-4197-8077-26810bca78ed`::moving from state preparing -> state finished >Thread-54862::DEBUG::2014-05-16 17:53:34,768::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54862::DEBUG::2014-05-16 17:53:34,769::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54862::DEBUG::2014-05-16 17:53:34,769::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54862::DEBUG::2014-05-16 17:53:34,769::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54862::DEBUG::2014-05-16 17:53:34,769::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54862::DEBUG::2014-05-16 17:53:34,769::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54862::DEBUG::2014-05-16 17:53:34,769::task::974::TaskManager.Task::(_decref) Task=`27ca6656-d162-4197-8077-26810bca78ed`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:53:35,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:35,676::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032364 s, 31.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:37,688::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:37,759::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357428 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:39,771::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:39,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035626 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:41,854::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:41,921::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306114 s, 33.5 MB/s\n'; <rc> = 0 >Thread-54865::DEBUG::2014-05-16 17:53:42,172::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3247330.000000 / 8.008473 / 262500000.000000 = 0.154471 >Thread-54865::DEBUG::2014-05-16 17:53:42,173::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.004169012983275786, 'statsAge': 1.6259949207305908, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15447115459461169, 'rxDropped': 0} >Thread-54865::DEBUG::2014-05-16 17:53:42,173::task::579::TaskManager.Task::(_updateState) Task=`b6f36276-797d-43c0-ae16-42b6d72cdf46`::moving from state init -> state preparing >Thread-54865::INFO::2014-05-16 17:53:42,173::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54865::INFO::2014-05-16 17:53:42,174::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771539', 'lastCheck': '9.8', 'valid': True}} >Thread-54865::DEBUG::2014-05-16 17:53:42,174::task::1168::TaskManager.Task::(prepare) Task=`b6f36276-797d-43c0-ae16-42b6d72cdf46`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771539', 'lastCheck': '9.8', 'valid': True}} >Thread-54865::DEBUG::2014-05-16 17:53:42,174::task::579::TaskManager.Task::(_updateState) Task=`b6f36276-797d-43c0-ae16-42b6d72cdf46`::moving from state preparing -> state finished >Thread-54865::DEBUG::2014-05-16 17:53:42,174::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54865::DEBUG::2014-05-16 17:53:42,174::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54865::DEBUG::2014-05-16 17:53:42,174::task::974::TaskManager.Task::(_decref) Task=`b6f36276-797d-43c0-ae16-42b6d72cdf46`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:53:42,397::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:53:42,407::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671361 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:43,932::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:44,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349406 s, 29.3 MB/s\n'; <rc> = 0 >Thread-54867::DEBUG::2014-05-16 17:53:44,810::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54867::DEBUG::2014-05-16 17:53:44,810::task::579::TaskManager.Task::(_updateState) Task=`1e2f4b0e-5a76-4b49-b394-4f849e4f919b`::moving from state init -> state preparing >Thread-54867::INFO::2014-05-16 17:53:44,811::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54867::INFO::2014-05-16 17:53:44,811::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54867::DEBUG::2014-05-16 17:53:44,811::task::1168::TaskManager.Task::(prepare) Task=`1e2f4b0e-5a76-4b49-b394-4f849e4f919b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54867::DEBUG::2014-05-16 17:53:44,811::task::579::TaskManager.Task::(_updateState) Task=`1e2f4b0e-5a76-4b49-b394-4f849e4f919b`::moving from state preparing -> state finished >Thread-54867::DEBUG::2014-05-16 17:53:44,811::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54867::DEBUG::2014-05-16 17:53:44,812::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54867::DEBUG::2014-05-16 17:53:44,812::task::974::TaskManager.Task::(_decref) Task=`1e2f4b0e-5a76-4b49-b394-4f849e4f919b`::ref 0 aborting False >Thread-54868::DEBUG::2014-05-16 17:53:44,821::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54868::DEBUG::2014-05-16 17:53:44,821::task::579::TaskManager.Task::(_updateState) Task=`4de804ae-be55-4d17-b243-a1a45f327800`::moving from state init -> state preparing >Thread-54868::INFO::2014-05-16 17:53:44,821::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54868::DEBUG::2014-05-16 17:53:44,822::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`12aca507-597f-449a-bdb1-389b9f285cd3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54868::DEBUG::2014-05-16 17:53:44,822::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54868::DEBUG::2014-05-16 17:53:44,822::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54868::DEBUG::2014-05-16 17:53:44,822::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`12aca507-597f-449a-bdb1-389b9f285cd3`::Granted request >Thread-54868::DEBUG::2014-05-16 17:53:44,822::task::811::TaskManager.Task::(resourceAcquired) Task=`4de804ae-be55-4d17-b243-a1a45f327800`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54868::DEBUG::2014-05-16 17:53:44,823::task::974::TaskManager.Task::(_decref) Task=`4de804ae-be55-4d17-b243-a1a45f327800`::ref 1 aborting False >Thread-54868::INFO::2014-05-16 17:53:44,823::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54868::DEBUG::2014-05-16 17:53:44,823::task::1168::TaskManager.Task::(prepare) Task=`4de804ae-be55-4d17-b243-a1a45f327800`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54868::DEBUG::2014-05-16 17:53:44,824::task::579::TaskManager.Task::(_updateState) Task=`4de804ae-be55-4d17-b243-a1a45f327800`::moving from state preparing -> state finished >Thread-54868::DEBUG::2014-05-16 17:53:44,824::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54868::DEBUG::2014-05-16 17:53:44,824::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54868::DEBUG::2014-05-16 17:53:44,824::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54868::DEBUG::2014-05-16 17:53:44,824::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54868::DEBUG::2014-05-16 17:53:44,824::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54868::DEBUG::2014-05-16 17:53:44,825::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54868::DEBUG::2014-05-16 17:53:44,825::task::974::TaskManager.Task::(_decref) Task=`4de804ae-be55-4d17-b243-a1a45f327800`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:53:46,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:46,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360339 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:48,099::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:48,166::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312001 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:50,177::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:50,250::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360973 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:52,261::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:52,329::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316452 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:53:52,444::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:53:52,454::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000819387 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:53:54,341::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:54,409::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308154 s, 33.2 MB/s\n'; <rc> = 0 >Thread-54873::DEBUG::2014-05-16 17:53:54,865::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54873::DEBUG::2014-05-16 17:53:54,866::task::579::TaskManager.Task::(_updateState) Task=`5776bcf9-a3ab-448e-b64b-b8e582c5d432`::moving from state init -> state preparing >Thread-54873::INFO::2014-05-16 17:53:54,866::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54873::INFO::2014-05-16 17:53:54,866::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54873::DEBUG::2014-05-16 17:53:54,866::task::1168::TaskManager.Task::(prepare) Task=`5776bcf9-a3ab-448e-b64b-b8e582c5d432`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54873::DEBUG::2014-05-16 17:53:54,866::task::579::TaskManager.Task::(_updateState) Task=`5776bcf9-a3ab-448e-b64b-b8e582c5d432`::moving from state preparing -> state finished >Thread-54873::DEBUG::2014-05-16 17:53:54,867::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54873::DEBUG::2014-05-16 17:53:54,867::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54873::DEBUG::2014-05-16 17:53:54,867::task::974::TaskManager.Task::(_decref) Task=`5776bcf9-a3ab-448e-b64b-b8e582c5d432`::ref 0 aborting False >Thread-54874::DEBUG::2014-05-16 17:53:54,883::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54874::DEBUG::2014-05-16 17:53:54,883::task::579::TaskManager.Task::(_updateState) Task=`4239dd0f-df7d-4f77-b5ca-5f732d45ea46`::moving from state init -> state preparing >Thread-54874::INFO::2014-05-16 17:53:54,883::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54874::DEBUG::2014-05-16 17:53:54,884::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1047455d-1167-4484-925e-2387b12d2c7e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54874::DEBUG::2014-05-16 17:53:54,884::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54874::DEBUG::2014-05-16 17:53:54,884::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54874::DEBUG::2014-05-16 17:53:54,884::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1047455d-1167-4484-925e-2387b12d2c7e`::Granted request >Thread-54874::DEBUG::2014-05-16 17:53:54,885::task::811::TaskManager.Task::(resourceAcquired) Task=`4239dd0f-df7d-4f77-b5ca-5f732d45ea46`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54874::DEBUG::2014-05-16 17:53:54,886::task::974::TaskManager.Task::(_decref) Task=`4239dd0f-df7d-4f77-b5ca-5f732d45ea46`::ref 1 aborting False >Thread-54874::INFO::2014-05-16 17:53:54,886::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54874::DEBUG::2014-05-16 17:53:54,886::task::1168::TaskManager.Task::(prepare) Task=`4239dd0f-df7d-4f77-b5ca-5f732d45ea46`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54874::DEBUG::2014-05-16 17:53:54,886::task::579::TaskManager.Task::(_updateState) Task=`4239dd0f-df7d-4f77-b5ca-5f732d45ea46`::moving from state preparing -> state finished >Thread-54874::DEBUG::2014-05-16 17:53:54,887::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54874::DEBUG::2014-05-16 17:53:54,887::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54874::DEBUG::2014-05-16 17:53:54,887::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54874::DEBUG::2014-05-16 17:53:54,887::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54874::DEBUG::2014-05-16 17:53:54,887::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54874::DEBUG::2014-05-16 17:53:54,887::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54874::DEBUG::2014-05-16 17:53:54,888::task::974::TaskManager.Task::(_decref) Task=`4239dd0f-df7d-4f77-b5ca-5f732d45ea46`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:53:56,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:56,493::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363687 s, 28.2 MB/s\n'; <rc> = 0 >Thread-54875::DEBUG::2014-05-16 17:53:57,333::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315028.000000 / 8.008353 / 262500000.000000 = 0.205263 >Thread-54875::DEBUG::2014-05-16 17:53:57,333::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.00537800374287684, 'statsAge': 0.77006912231445312, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20526320349754426, 'rxDropped': 0} >Thread-54875::DEBUG::2014-05-16 17:53:57,334::task::579::TaskManager.Task::(_updateState) Task=`452d2e03-98be-4e46-bc57-b1ccde4a4d8c`::moving from state init -> state preparing >Thread-54875::INFO::2014-05-16 17:53:57,334::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54875::INFO::2014-05-16 17:53:57,334::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819387', 'lastCheck': '4.9', 'valid': True}} >Thread-54875::DEBUG::2014-05-16 17:53:57,334::task::1168::TaskManager.Task::(prepare) Task=`452d2e03-98be-4e46-bc57-b1ccde4a4d8c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819387', 'lastCheck': '4.9', 'valid': True}} >Thread-54875::DEBUG::2014-05-16 17:53:57,334::task::579::TaskManager.Task::(_updateState) Task=`452d2e03-98be-4e46-bc57-b1ccde4a4d8c`::moving from state preparing -> state finished >Thread-54875::DEBUG::2014-05-16 17:53:57,335::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54875::DEBUG::2014-05-16 17:53:57,335::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54875::DEBUG::2014-05-16 17:53:57,335::task::974::TaskManager.Task::(_decref) Task=`452d2e03-98be-4e46-bc57-b1ccde4a4d8c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:53:58,505::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:53:58,577::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313491 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:00,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:00,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357954 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:54:02,492::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:54:02,503::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568231 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:02,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:02,740::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314528 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:04,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:04,826::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038451 s, 26.6 MB/s\n'; <rc> = 0 >Thread-54879::DEBUG::2014-05-16 17:54:04,922::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54879::DEBUG::2014-05-16 17:54:04,922::task::579::TaskManager.Task::(_updateState) Task=`ec4fde07-6b93-4f73-8985-ceeaa5750076`::moving from state init -> state preparing >Thread-54879::INFO::2014-05-16 17:54:04,922::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54879::INFO::2014-05-16 17:54:04,923::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54879::DEBUG::2014-05-16 17:54:04,923::task::1168::TaskManager.Task::(prepare) Task=`ec4fde07-6b93-4f73-8985-ceeaa5750076`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54879::DEBUG::2014-05-16 17:54:04,923::task::579::TaskManager.Task::(_updateState) Task=`ec4fde07-6b93-4f73-8985-ceeaa5750076`::moving from state preparing -> state finished >Thread-54879::DEBUG::2014-05-16 17:54:04,923::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54879::DEBUG::2014-05-16 17:54:04,923::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54879::DEBUG::2014-05-16 17:54:04,923::task::974::TaskManager.Task::(_decref) Task=`ec4fde07-6b93-4f73-8985-ceeaa5750076`::ref 0 aborting False >Thread-54880::DEBUG::2014-05-16 17:54:04,945::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54880::DEBUG::2014-05-16 17:54:04,945::task::579::TaskManager.Task::(_updateState) Task=`fd9d6a0a-bf6b-4174-9ca3-caeeebb5eba3`::moving from state init -> state preparing >Thread-54880::INFO::2014-05-16 17:54:04,945::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54880::DEBUG::2014-05-16 17:54:04,946::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`508c703a-c6ff-4d8b-bfd5-63395c90ae11`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54880::DEBUG::2014-05-16 17:54:04,946::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54880::DEBUG::2014-05-16 17:54:04,946::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54880::DEBUG::2014-05-16 17:54:04,946::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`508c703a-c6ff-4d8b-bfd5-63395c90ae11`::Granted request >Thread-54880::DEBUG::2014-05-16 17:54:04,947::task::811::TaskManager.Task::(resourceAcquired) Task=`fd9d6a0a-bf6b-4174-9ca3-caeeebb5eba3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54880::DEBUG::2014-05-16 17:54:04,947::task::974::TaskManager.Task::(_decref) Task=`fd9d6a0a-bf6b-4174-9ca3-caeeebb5eba3`::ref 1 aborting False >Thread-54880::INFO::2014-05-16 17:54:04,948::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54880::DEBUG::2014-05-16 17:54:04,948::task::1168::TaskManager.Task::(prepare) Task=`fd9d6a0a-bf6b-4174-9ca3-caeeebb5eba3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54880::DEBUG::2014-05-16 17:54:04,948::task::579::TaskManager.Task::(_updateState) Task=`fd9d6a0a-bf6b-4174-9ca3-caeeebb5eba3`::moving from state preparing -> state finished >Thread-54880::DEBUG::2014-05-16 17:54:04,948::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54880::DEBUG::2014-05-16 17:54:04,948::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54880::DEBUG::2014-05-16 17:54:04,948::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54880::DEBUG::2014-05-16 17:54:04,949::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54880::DEBUG::2014-05-16 17:54:04,949::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54880::DEBUG::2014-05-16 17:54:04,949::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54880::DEBUG::2014-05-16 17:54:04,949::task::974::TaskManager.Task::(_decref) Task=`fd9d6a0a-bf6b-4174-9ca3-caeeebb5eba3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:54:06,838::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:06,905::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314748 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:08,917::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:08,984::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03126 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:10,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:11,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357193 s, 28.7 MB/s\n'; <rc> = 0 >Thread-54883::DEBUG::2014-05-16 17:54:12,509::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317336.000000 / 8.008244 / 262500000.000000 = 0.205376 >Thread-54883::DEBUG::2014-05-16 17:54:12,509::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053816923962977355, 'statsAge': 1.9282760620117188, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20537579397042816, 'rxDropped': 0} >Thread-54883::DEBUG::2014-05-16 17:54:12,510::task::579::TaskManager.Task::(_updateState) Task=`ef2cd607-ed7d-454c-9d07-24d2c54f76a8`::moving from state init -> state preparing >Thread-54883::INFO::2014-05-16 17:54:12,510::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54883::INFO::2014-05-16 17:54:12,510::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568231', 'lastCheck': '10.0', 'valid': True}} >Thread-54883::DEBUG::2014-05-16 17:54:12,510::task::1168::TaskManager.Task::(prepare) Task=`ef2cd607-ed7d-454c-9d07-24d2c54f76a8`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568231', 'lastCheck': '10.0', 'valid': True}} >Thread-54883::DEBUG::2014-05-16 17:54:12,510::task::579::TaskManager.Task::(_updateState) Task=`ef2cd607-ed7d-454c-9d07-24d2c54f76a8`::moving from state preparing -> state finished >Thread-54883::DEBUG::2014-05-16 17:54:12,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54883::DEBUG::2014-05-16 17:54:12,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54883::DEBUG::2014-05-16 17:54:12,511::task::974::TaskManager.Task::(_decref) Task=`ef2cd607-ed7d-454c-9d07-24d2c54f76a8`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 17:54:12,539::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:54:12,549::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001131 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:13,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:13,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352158 s, 29.1 MB/s\n'; <rc> = 0 >Thread-54885::DEBUG::2014-05-16 17:54:14,982::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54885::DEBUG::2014-05-16 17:54:14,982::task::579::TaskManager.Task::(_updateState) Task=`87054998-2b66-4234-98f5-94037a109434`::moving from state init -> state preparing >Thread-54885::INFO::2014-05-16 17:54:14,983::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54885::INFO::2014-05-16 17:54:14,983::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54885::DEBUG::2014-05-16 17:54:14,983::task::1168::TaskManager.Task::(prepare) Task=`87054998-2b66-4234-98f5-94037a109434`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54885::DEBUG::2014-05-16 17:54:14,983::task::579::TaskManager.Task::(_updateState) Task=`87054998-2b66-4234-98f5-94037a109434`::moving from state preparing -> state finished >Thread-54885::DEBUG::2014-05-16 17:54:14,983::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54885::DEBUG::2014-05-16 17:54:14,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54885::DEBUG::2014-05-16 17:54:14,984::task::974::TaskManager.Task::(_decref) Task=`87054998-2b66-4234-98f5-94037a109434`::ref 0 aborting False >Thread-54886::DEBUG::2014-05-16 17:54:14,992::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54886::DEBUG::2014-05-16 17:54:14,993::task::579::TaskManager.Task::(_updateState) Task=`bb5fa65a-813d-411a-8df4-209708753d67`::moving from state init -> state preparing >Thread-54886::INFO::2014-05-16 17:54:14,993::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54886::DEBUG::2014-05-16 17:54:14,993::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4907dcfe-8e22-4e8e-9e80-525afab0bbd4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54886::DEBUG::2014-05-16 17:54:14,994::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54886::DEBUG::2014-05-16 17:54:14,994::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54886::DEBUG::2014-05-16 17:54:14,994::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4907dcfe-8e22-4e8e-9e80-525afab0bbd4`::Granted request >Thread-54886::DEBUG::2014-05-16 17:54:14,994::task::811::TaskManager.Task::(resourceAcquired) Task=`bb5fa65a-813d-411a-8df4-209708753d67`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54886::DEBUG::2014-05-16 17:54:14,994::task::974::TaskManager.Task::(_decref) Task=`bb5fa65a-813d-411a-8df4-209708753d67`::ref 1 aborting False >Thread-54886::INFO::2014-05-16 17:54:14,995::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54886::DEBUG::2014-05-16 17:54:14,995::task::1168::TaskManager.Task::(prepare) Task=`bb5fa65a-813d-411a-8df4-209708753d67`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54886::DEBUG::2014-05-16 17:54:14,995::task::579::TaskManager.Task::(_updateState) Task=`bb5fa65a-813d-411a-8df4-209708753d67`::moving from state preparing -> state finished >Thread-54886::DEBUG::2014-05-16 17:54:14,996::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54886::DEBUG::2014-05-16 17:54:14,996::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54886::DEBUG::2014-05-16 17:54:14,996::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54886::DEBUG::2014-05-16 17:54:14,996::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54886::DEBUG::2014-05-16 17:54:14,996::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54886::DEBUG::2014-05-16 17:54:14,996::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54886::DEBUG::2014-05-16 17:54:14,997::task::974::TaskManager.Task::(_decref) Task=`bb5fa65a-813d-411a-8df4-209708753d67`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:54:15,162::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:15,233::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355542 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:17,245::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:17,317::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364294 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:19,329::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:19,396::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308482 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:21,408::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:21,475::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307404 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:54:22,587::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:54:22,601::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000542151 s, 7.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:23,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:23,557::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345006 s, 29.7 MB/s\n'; <rc> = 0 >Thread-54891::DEBUG::2014-05-16 17:54:25,064::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54891::DEBUG::2014-05-16 17:54:25,065::task::579::TaskManager.Task::(_updateState) Task=`1883b641-bc2e-4a56-9bd3-d5118a8890d4`::moving from state init -> state preparing >Thread-54891::INFO::2014-05-16 17:54:25,065::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54891::INFO::2014-05-16 17:54:25,065::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54891::DEBUG::2014-05-16 17:54:25,065::task::1168::TaskManager.Task::(prepare) Task=`1883b641-bc2e-4a56-9bd3-d5118a8890d4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54891::DEBUG::2014-05-16 17:54:25,065::task::579::TaskManager.Task::(_updateState) Task=`1883b641-bc2e-4a56-9bd3-d5118a8890d4`::moving from state preparing -> state finished >Thread-54891::DEBUG::2014-05-16 17:54:25,066::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54891::DEBUG::2014-05-16 17:54:25,066::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54891::DEBUG::2014-05-16 17:54:25,066::task::974::TaskManager.Task::(_decref) Task=`1883b641-bc2e-4a56-9bd3-d5118a8890d4`::ref 0 aborting False >Thread-54892::DEBUG::2014-05-16 17:54:25,075::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54892::DEBUG::2014-05-16 17:54:25,076::task::579::TaskManager.Task::(_updateState) Task=`536c79fb-4d88-482b-b67f-90b82aee3dd8`::moving from state init -> state preparing >Thread-54892::INFO::2014-05-16 17:54:25,076::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54892::DEBUG::2014-05-16 17:54:25,076::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9ae8c43e-247b-432c-b439-a65fe75369d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54892::DEBUG::2014-05-16 17:54:25,076::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54892::DEBUG::2014-05-16 17:54:25,077::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54892::DEBUG::2014-05-16 17:54:25,077::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9ae8c43e-247b-432c-b439-a65fe75369d6`::Granted request >Thread-54892::DEBUG::2014-05-16 17:54:25,077::task::811::TaskManager.Task::(resourceAcquired) Task=`536c79fb-4d88-482b-b67f-90b82aee3dd8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54892::DEBUG::2014-05-16 17:54:25,077::task::974::TaskManager.Task::(_decref) Task=`536c79fb-4d88-482b-b67f-90b82aee3dd8`::ref 1 aborting False >Thread-54892::INFO::2014-05-16 17:54:25,078::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54892::DEBUG::2014-05-16 17:54:25,078::task::1168::TaskManager.Task::(prepare) Task=`536c79fb-4d88-482b-b67f-90b82aee3dd8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54892::DEBUG::2014-05-16 17:54:25,078::task::579::TaskManager.Task::(_updateState) Task=`536c79fb-4d88-482b-b67f-90b82aee3dd8`::moving from state preparing -> state finished >Thread-54892::DEBUG::2014-05-16 17:54:25,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54892::DEBUG::2014-05-16 17:54:25,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54892::DEBUG::2014-05-16 17:54:25,079::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54892::DEBUG::2014-05-16 17:54:25,079::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54892::DEBUG::2014-05-16 17:54:25,079::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54892::DEBUG::2014-05-16 17:54:25,079::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54892::DEBUG::2014-05-16 17:54:25,080::task::974::TaskManager.Task::(_decref) Task=`536c79fb-4d88-482b-b67f-90b82aee3dd8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:54:25,568::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:25,639::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356956 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:27,651::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54893::DEBUG::2014-05-16 17:54:27,667::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5420380.000000 / 8.012679 / 262500000.000000 = 0.257705 >Thread-54893::DEBUG::2014-05-16 17:54:27,667::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066586848288559203, 'statsAge': 1.065173864364624, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25770490005736396, 'rxDropped': 0} >Thread-54893::DEBUG::2014-05-16 17:54:27,668::task::579::TaskManager.Task::(_updateState) Task=`7053d4b7-764a-42c1-9922-c6db9ff92b56`::moving from state init -> state preparing >Thread-54893::INFO::2014-05-16 17:54:27,668::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54893::INFO::2014-05-16 17:54:27,668::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542151', 'lastCheck': '5.0', 'valid': True}} >Thread-54893::DEBUG::2014-05-16 17:54:27,668::task::1168::TaskManager.Task::(prepare) Task=`7053d4b7-764a-42c1-9922-c6db9ff92b56`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542151', 'lastCheck': '5.0', 'valid': True}} >Thread-54893::DEBUG::2014-05-16 17:54:27,669::task::579::TaskManager.Task::(_updateState) Task=`7053d4b7-764a-42c1-9922-c6db9ff92b56`::moving from state preparing -> state finished >Thread-54893::DEBUG::2014-05-16 17:54:27,669::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54893::DEBUG::2014-05-16 17:54:27,669::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54893::DEBUG::2014-05-16 17:54:27,669::task::974::TaskManager.Task::(_decref) Task=`7053d4b7-764a-42c1-9922-c6db9ff92b56`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:54:27,725::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324582 s, 31.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:29,737::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:29,804::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311228 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:31,816::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:31,888::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355688 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:54:32,637::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:54:32,647::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000820667 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:33,900::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:33,966::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308634 s, 33.2 MB/s\n'; <rc> = 0 >Thread-54897::DEBUG::2014-05-16 17:54:35,122::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54897::DEBUG::2014-05-16 17:54:35,124::task::579::TaskManager.Task::(_updateState) Task=`f0d1de47-219e-41a3-a78b-7c07c4414eaf`::moving from state init -> state preparing >Thread-54897::INFO::2014-05-16 17:54:35,125::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54897::INFO::2014-05-16 17:54:35,126::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54897::DEBUG::2014-05-16 17:54:35,127::task::1168::TaskManager.Task::(prepare) Task=`f0d1de47-219e-41a3-a78b-7c07c4414eaf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54897::DEBUG::2014-05-16 17:54:35,128::task::579::TaskManager.Task::(_updateState) Task=`f0d1de47-219e-41a3-a78b-7c07c4414eaf`::moving from state preparing -> state finished >Thread-54897::DEBUG::2014-05-16 17:54:35,128::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54897::DEBUG::2014-05-16 17:54:35,129::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54897::DEBUG::2014-05-16 17:54:35,130::task::974::TaskManager.Task::(_decref) Task=`f0d1de47-219e-41a3-a78b-7c07c4414eaf`::ref 0 aborting False >Thread-54898::DEBUG::2014-05-16 17:54:35,143::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54898::DEBUG::2014-05-16 17:54:35,144::task::579::TaskManager.Task::(_updateState) Task=`cd0927b4-3e7c-4f25-963f-dbb6d3d0a7c9`::moving from state init -> state preparing >Thread-54898::INFO::2014-05-16 17:54:35,145::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54898::DEBUG::2014-05-16 17:54:35,147::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`316f743d-2c15-4852-ae8d-25485dd52aff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54898::DEBUG::2014-05-16 17:54:35,148::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54898::DEBUG::2014-05-16 17:54:35,149::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54898::DEBUG::2014-05-16 17:54:35,150::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`316f743d-2c15-4852-ae8d-25485dd52aff`::Granted request >Thread-54898::DEBUG::2014-05-16 17:54:35,151::task::811::TaskManager.Task::(resourceAcquired) Task=`cd0927b4-3e7c-4f25-963f-dbb6d3d0a7c9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54898::DEBUG::2014-05-16 17:54:35,152::task::974::TaskManager.Task::(_decref) Task=`cd0927b4-3e7c-4f25-963f-dbb6d3d0a7c9`::ref 1 aborting False >Thread-54898::INFO::2014-05-16 17:54:35,156::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54898::DEBUG::2014-05-16 17:54:35,156::task::1168::TaskManager.Task::(prepare) Task=`cd0927b4-3e7c-4f25-963f-dbb6d3d0a7c9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54898::DEBUG::2014-05-16 17:54:35,157::task::579::TaskManager.Task::(_updateState) Task=`cd0927b4-3e7c-4f25-963f-dbb6d3d0a7c9`::moving from state preparing -> state finished >Thread-54898::DEBUG::2014-05-16 17:54:35,158::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54898::DEBUG::2014-05-16 17:54:35,159::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54898::DEBUG::2014-05-16 17:54:35,160::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54898::DEBUG::2014-05-16 17:54:35,161::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54898::DEBUG::2014-05-16 17:54:35,162::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54898::DEBUG::2014-05-16 17:54:35,163::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54898::DEBUG::2014-05-16 17:54:35,164::task::974::TaskManager.Task::(_decref) Task=`cd0927b4-3e7c-4f25-963f-dbb6d3d0a7c9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:54:35,978::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:36,045::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310018 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:38,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:38,128::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348564 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:40,140::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:40,211::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351344 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:42,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:42,290::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309104 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:54:42,686::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:54:42,696::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000557806 s, 7.3 MB/s\n'; <rc> = 0 >Thread-54901::DEBUG::2014-05-16 17:54:42,847::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4311784.000000 / 8.008563 / 262500000.000000 = 0.205104 >Thread-54901::DEBUG::2014-05-16 17:54:42,847::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053865200897761289, 'statsAge': 0.22771501541137695, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20510350888195902, 'rxDropped': 0} >Thread-54901::DEBUG::2014-05-16 17:54:42,847::task::579::TaskManager.Task::(_updateState) Task=`91c3aec0-f77c-4ac8-8c22-bbf405b77e60`::moving from state init -> state preparing >Thread-54901::INFO::2014-05-16 17:54:42,848::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54901::INFO::2014-05-16 17:54:42,848::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557806', 'lastCheck': '0.1', 'valid': True}} >Thread-54901::DEBUG::2014-05-16 17:54:42,848::task::1168::TaskManager.Task::(prepare) Task=`91c3aec0-f77c-4ac8-8c22-bbf405b77e60`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557806', 'lastCheck': '0.1', 'valid': True}} >Thread-54901::DEBUG::2014-05-16 17:54:42,848::task::579::TaskManager.Task::(_updateState) Task=`91c3aec0-f77c-4ac8-8c22-bbf405b77e60`::moving from state preparing -> state finished >Thread-54901::DEBUG::2014-05-16 17:54:42,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54901::DEBUG::2014-05-16 17:54:42,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54901::DEBUG::2014-05-16 17:54:42,849::task::974::TaskManager.Task::(_decref) Task=`91c3aec0-f77c-4ac8-8c22-bbf405b77e60`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:54:44,301::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:44,375::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359724 s, 28.5 MB/s\n'; <rc> = 0 >Thread-54903::DEBUG::2014-05-16 17:54:45,216::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54903::DEBUG::2014-05-16 17:54:45,217::task::579::TaskManager.Task::(_updateState) Task=`6f0136a7-532e-4049-a008-049f7c958097`::moving from state init -> state preparing >Thread-54903::INFO::2014-05-16 17:54:45,217::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54903::INFO::2014-05-16 17:54:45,217::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54903::DEBUG::2014-05-16 17:54:45,217::task::1168::TaskManager.Task::(prepare) Task=`6f0136a7-532e-4049-a008-049f7c958097`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54903::DEBUG::2014-05-16 17:54:45,218::task::579::TaskManager.Task::(_updateState) Task=`6f0136a7-532e-4049-a008-049f7c958097`::moving from state preparing -> state finished >Thread-54903::DEBUG::2014-05-16 17:54:45,218::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54903::DEBUG::2014-05-16 17:54:45,218::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54903::DEBUG::2014-05-16 17:54:45,218::task::974::TaskManager.Task::(_decref) Task=`6f0136a7-532e-4049-a008-049f7c958097`::ref 0 aborting False >Thread-54904::DEBUG::2014-05-16 17:54:45,227::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54904::DEBUG::2014-05-16 17:54:45,227::task::579::TaskManager.Task::(_updateState) Task=`fc2c630c-4bf3-45e2-a242-f9220d97fd29`::moving from state init -> state preparing >Thread-54904::INFO::2014-05-16 17:54:45,227::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54904::DEBUG::2014-05-16 17:54:45,228::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`827cd224-9408-4157-8eb9-f16c474f4738`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54904::DEBUG::2014-05-16 17:54:45,228::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54904::DEBUG::2014-05-16 17:54:45,228::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54904::DEBUG::2014-05-16 17:54:45,228::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`827cd224-9408-4157-8eb9-f16c474f4738`::Granted request >Thread-54904::DEBUG::2014-05-16 17:54:45,228::task::811::TaskManager.Task::(resourceAcquired) Task=`fc2c630c-4bf3-45e2-a242-f9220d97fd29`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54904::DEBUG::2014-05-16 17:54:45,229::task::974::TaskManager.Task::(_decref) Task=`fc2c630c-4bf3-45e2-a242-f9220d97fd29`::ref 1 aborting False >Thread-54904::INFO::2014-05-16 17:54:45,229::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54904::DEBUG::2014-05-16 17:54:45,229::task::1168::TaskManager.Task::(prepare) Task=`fc2c630c-4bf3-45e2-a242-f9220d97fd29`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54904::DEBUG::2014-05-16 17:54:45,230::task::579::TaskManager.Task::(_updateState) Task=`fc2c630c-4bf3-45e2-a242-f9220d97fd29`::moving from state preparing -> state finished >Thread-54904::DEBUG::2014-05-16 17:54:45,230::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54904::DEBUG::2014-05-16 17:54:45,230::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54904::DEBUG::2014-05-16 17:54:45,230::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54904::DEBUG::2014-05-16 17:54:45,230::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54904::DEBUG::2014-05-16 17:54:45,230::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54904::DEBUG::2014-05-16 17:54:45,231::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54904::DEBUG::2014-05-16 17:54:45,231::task::974::TaskManager.Task::(_decref) Task=`fc2c630c-4bf3-45e2-a242-f9220d97fd29`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:54:46,387::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:46,458::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356015 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:48,470::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:48,537::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307295 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:50,548::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:50,620::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353131 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:52,635::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:52,702::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310113 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:54:52,734::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:54:52,744::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000791707 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:54:54,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:54,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304026 s, 33.7 MB/s\n'; <rc> = 0 >Thread-54909::DEBUG::2014-05-16 17:54:55,269::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54909::DEBUG::2014-05-16 17:54:55,269::task::579::TaskManager.Task::(_updateState) Task=`0f59af44-9f06-406f-9337-97910d291b70`::moving from state init -> state preparing >Thread-54909::INFO::2014-05-16 17:54:55,270::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54909::INFO::2014-05-16 17:54:55,270::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54909::DEBUG::2014-05-16 17:54:55,270::task::1168::TaskManager.Task::(prepare) Task=`0f59af44-9f06-406f-9337-97910d291b70`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54909::DEBUG::2014-05-16 17:54:55,270::task::579::TaskManager.Task::(_updateState) Task=`0f59af44-9f06-406f-9337-97910d291b70`::moving from state preparing -> state finished >Thread-54909::DEBUG::2014-05-16 17:54:55,270::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54909::DEBUG::2014-05-16 17:54:55,271::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54909::DEBUG::2014-05-16 17:54:55,271::task::974::TaskManager.Task::(_decref) Task=`0f59af44-9f06-406f-9337-97910d291b70`::ref 0 aborting False >Thread-54910::DEBUG::2014-05-16 17:54:55,279::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54910::DEBUG::2014-05-16 17:54:55,279::task::579::TaskManager.Task::(_updateState) Task=`e62839bc-7cb4-4685-8f64-111d45e8cfa3`::moving from state init -> state preparing >Thread-54910::INFO::2014-05-16 17:54:55,279::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54910::DEBUG::2014-05-16 17:54:55,280::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2206a7ed-4889-4e4d-9e7e-1fd712e6115a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54910::DEBUG::2014-05-16 17:54:55,280::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54910::DEBUG::2014-05-16 17:54:55,280::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54910::DEBUG::2014-05-16 17:54:55,280::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2206a7ed-4889-4e4d-9e7e-1fd712e6115a`::Granted request >Thread-54910::DEBUG::2014-05-16 17:54:55,280::task::811::TaskManager.Task::(resourceAcquired) Task=`e62839bc-7cb4-4685-8f64-111d45e8cfa3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54910::DEBUG::2014-05-16 17:54:55,281::task::974::TaskManager.Task::(_decref) Task=`e62839bc-7cb4-4685-8f64-111d45e8cfa3`::ref 1 aborting False >Thread-54910::INFO::2014-05-16 17:54:55,281::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54910::DEBUG::2014-05-16 17:54:55,281::task::1168::TaskManager.Task::(prepare) Task=`e62839bc-7cb4-4685-8f64-111d45e8cfa3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54910::DEBUG::2014-05-16 17:54:55,282::task::579::TaskManager.Task::(_updateState) Task=`e62839bc-7cb4-4685-8f64-111d45e8cfa3`::moving from state preparing -> state finished >Thread-54910::DEBUG::2014-05-16 17:54:55,282::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54910::DEBUG::2014-05-16 17:54:55,282::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54910::DEBUG::2014-05-16 17:54:55,282::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54910::DEBUG::2014-05-16 17:54:55,282::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54910::DEBUG::2014-05-16 17:54:55,282::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54910::DEBUG::2014-05-16 17:54:55,283::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54910::DEBUG::2014-05-16 17:54:55,283::task::974::TaskManager.Task::(_decref) Task=`e62839bc-7cb4-4685-8f64-111d45e8cfa3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:54:56,792::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:56,859::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311778 s, 32.8 MB/s\n'; <rc> = 0 >Thread-54911::DEBUG::2014-05-16 17:54:58,116::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315725.000000 / 8.010158 / 262500000.000000 = 0.205250 >Thread-54911::DEBUG::2014-05-16 17:54:58,116::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053645216903545683, 'statsAge': 1.4805119037628174, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20525009638562269, 'rxDropped': 0} >Thread-54911::DEBUG::2014-05-16 17:54:58,117::task::579::TaskManager.Task::(_updateState) Task=`6b2c4f3e-998d-4135-9a56-d13cb261c8bb`::moving from state init -> state preparing >Thread-54911::INFO::2014-05-16 17:54:58,117::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54911::INFO::2014-05-16 17:54:58,117::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000791707', 'lastCheck': '5.4', 'valid': True}} >Thread-54911::DEBUG::2014-05-16 17:54:58,117::task::1168::TaskManager.Task::(prepare) Task=`6b2c4f3e-998d-4135-9a56-d13cb261c8bb`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000791707', 'lastCheck': '5.4', 'valid': True}} >Thread-54911::DEBUG::2014-05-16 17:54:58,118::task::579::TaskManager.Task::(_updateState) Task=`6b2c4f3e-998d-4135-9a56-d13cb261c8bb`::moving from state preparing -> state finished >Thread-54911::DEBUG::2014-05-16 17:54:58,118::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54911::DEBUG::2014-05-16 17:54:58,118::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54911::DEBUG::2014-05-16 17:54:58,118::task::974::TaskManager.Task::(_decref) Task=`6b2c4f3e-998d-4135-9a56-d13cb261c8bb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:54:58,871::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:54:58,942::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359234 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:00,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:01,026::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354508 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:55:02,777::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:55:02,787::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110615 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:03,038::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:03,108::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342753 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:05,120::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:05,191::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356666 s, 28.7 MB/s\n'; <rc> = 0 >Thread-54915::DEBUG::2014-05-16 17:55:05,349::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54915::DEBUG::2014-05-16 17:55:05,349::task::579::TaskManager.Task::(_updateState) Task=`f3a8a916-811f-4603-b13c-243fbd939042`::moving from state init -> state preparing >Thread-54915::INFO::2014-05-16 17:55:05,349::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54915::INFO::2014-05-16 17:55:05,350::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54915::DEBUG::2014-05-16 17:55:05,350::task::1168::TaskManager.Task::(prepare) Task=`f3a8a916-811f-4603-b13c-243fbd939042`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54915::DEBUG::2014-05-16 17:55:05,350::task::579::TaskManager.Task::(_updateState) Task=`f3a8a916-811f-4603-b13c-243fbd939042`::moving from state preparing -> state finished >Thread-54915::DEBUG::2014-05-16 17:55:05,350::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54915::DEBUG::2014-05-16 17:55:05,350::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54915::DEBUG::2014-05-16 17:55:05,350::task::974::TaskManager.Task::(_decref) Task=`f3a8a916-811f-4603-b13c-243fbd939042`::ref 0 aborting False >Thread-54916::DEBUG::2014-05-16 17:55:05,359::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54916::DEBUG::2014-05-16 17:55:05,359::task::579::TaskManager.Task::(_updateState) Task=`7e988ebe-48dc-4216-9e7e-a68a0034ffdf`::moving from state init -> state preparing >Thread-54916::INFO::2014-05-16 17:55:05,359::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54916::DEBUG::2014-05-16 17:55:05,360::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e559be5a-be8c-494d-9277-03a216cab81f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54916::DEBUG::2014-05-16 17:55:05,360::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54916::DEBUG::2014-05-16 17:55:05,360::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54916::DEBUG::2014-05-16 17:55:05,360::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e559be5a-be8c-494d-9277-03a216cab81f`::Granted request >Thread-54916::DEBUG::2014-05-16 17:55:05,360::task::811::TaskManager.Task::(resourceAcquired) Task=`7e988ebe-48dc-4216-9e7e-a68a0034ffdf`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54916::DEBUG::2014-05-16 17:55:05,361::task::974::TaskManager.Task::(_decref) Task=`7e988ebe-48dc-4216-9e7e-a68a0034ffdf`::ref 1 aborting False >Thread-54916::INFO::2014-05-16 17:55:05,361::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54916::DEBUG::2014-05-16 17:55:05,361::task::1168::TaskManager.Task::(prepare) Task=`7e988ebe-48dc-4216-9e7e-a68a0034ffdf`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54916::DEBUG::2014-05-16 17:55:05,362::task::579::TaskManager.Task::(_updateState) Task=`7e988ebe-48dc-4216-9e7e-a68a0034ffdf`::moving from state preparing -> state finished >Thread-54916::DEBUG::2014-05-16 17:55:05,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54916::DEBUG::2014-05-16 17:55:05,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54916::DEBUG::2014-05-16 17:55:05,362::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54916::DEBUG::2014-05-16 17:55:05,362::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54916::DEBUG::2014-05-16 17:55:05,362::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54916::DEBUG::2014-05-16 17:55:05,363::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54916::DEBUG::2014-05-16 17:55:05,363::task::974::TaskManager.Task::(_decref) Task=`7e988ebe-48dc-4216-9e7e-a68a0034ffdf`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:55:07,203::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:07,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349077 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:09,285::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:09,353::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306969 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:11,365::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:11,437::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363325 s, 28.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:55:12,820::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:55:12,831::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109954 s, 3.7 MB/s\n'; <rc> = 0 >Thread-54919::DEBUG::2014-05-16 17:55:13,264::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318132.000000 / 8.008269 / 262500000.000000 = 0.205413 >Thread-54919::DEBUG::2014-05-16 17:55:13,264::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053410507372148048, 'statsAge': 0.61213588714599609, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20541301147144445, 'rxDropped': 0} >Thread-54919::DEBUG::2014-05-16 17:55:13,265::task::579::TaskManager.Task::(_updateState) Task=`efb53fa5-3f08-4c88-950e-8aa6d6ffc68e`::moving from state init -> state preparing >Thread-54919::INFO::2014-05-16 17:55:13,265::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54919::INFO::2014-05-16 17:55:13,265::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109954', 'lastCheck': '0.4', 'valid': True}} >Thread-54919::DEBUG::2014-05-16 17:55:13,265::task::1168::TaskManager.Task::(prepare) Task=`efb53fa5-3f08-4c88-950e-8aa6d6ffc68e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109954', 'lastCheck': '0.4', 'valid': True}} >Thread-54919::DEBUG::2014-05-16 17:55:13,266::task::579::TaskManager.Task::(_updateState) Task=`efb53fa5-3f08-4c88-950e-8aa6d6ffc68e`::moving from state preparing -> state finished >Thread-54919::DEBUG::2014-05-16 17:55:13,266::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54919::DEBUG::2014-05-16 17:55:13,266::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54919::DEBUG::2014-05-16 17:55:13,266::task::974::TaskManager.Task::(_decref) Task=`efb53fa5-3f08-4c88-950e-8aa6d6ffc68e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:55:13,448::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:13,519::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348819 s, 29.4 MB/s\n'; <rc> = 0 >Thread-54921::DEBUG::2014-05-16 17:55:15,391::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54921::DEBUG::2014-05-16 17:55:15,392::task::579::TaskManager.Task::(_updateState) Task=`7ff4b084-b4e9-4985-81ed-e3358c592a13`::moving from state init -> state preparing >Thread-54921::INFO::2014-05-16 17:55:15,392::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54921::INFO::2014-05-16 17:55:15,392::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54921::DEBUG::2014-05-16 17:55:15,392::task::1168::TaskManager.Task::(prepare) Task=`7ff4b084-b4e9-4985-81ed-e3358c592a13`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54921::DEBUG::2014-05-16 17:55:15,392::task::579::TaskManager.Task::(_updateState) Task=`7ff4b084-b4e9-4985-81ed-e3358c592a13`::moving from state preparing -> state finished >Thread-54921::DEBUG::2014-05-16 17:55:15,393::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54921::DEBUG::2014-05-16 17:55:15,393::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54921::DEBUG::2014-05-16 17:55:15,393::task::974::TaskManager.Task::(_decref) Task=`7ff4b084-b4e9-4985-81ed-e3358c592a13`::ref 0 aborting False >Thread-54922::DEBUG::2014-05-16 17:55:15,401::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54922::DEBUG::2014-05-16 17:55:15,402::task::579::TaskManager.Task::(_updateState) Task=`5a2ea5fa-0993-4ec6-8bfa-906b2abbbf4b`::moving from state init -> state preparing >Thread-54922::INFO::2014-05-16 17:55:15,402::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54922::DEBUG::2014-05-16 17:55:15,402::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`061225ed-b5f7-42ae-9f6b-34127d6b86a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54922::DEBUG::2014-05-16 17:55:15,402::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54922::DEBUG::2014-05-16 17:55:15,403::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54922::DEBUG::2014-05-16 17:55:15,403::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`061225ed-b5f7-42ae-9f6b-34127d6b86a3`::Granted request >Thread-54922::DEBUG::2014-05-16 17:55:15,403::task::811::TaskManager.Task::(resourceAcquired) Task=`5a2ea5fa-0993-4ec6-8bfa-906b2abbbf4b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54922::DEBUG::2014-05-16 17:55:15,403::task::974::TaskManager.Task::(_decref) Task=`5a2ea5fa-0993-4ec6-8bfa-906b2abbbf4b`::ref 1 aborting False >Thread-54922::INFO::2014-05-16 17:55:15,404::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54922::DEBUG::2014-05-16 17:55:15,404::task::1168::TaskManager.Task::(prepare) Task=`5a2ea5fa-0993-4ec6-8bfa-906b2abbbf4b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54922::DEBUG::2014-05-16 17:55:15,404::task::579::TaskManager.Task::(_updateState) Task=`5a2ea5fa-0993-4ec6-8bfa-906b2abbbf4b`::moving from state preparing -> state finished >Thread-54922::DEBUG::2014-05-16 17:55:15,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54922::DEBUG::2014-05-16 17:55:15,405::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54922::DEBUG::2014-05-16 17:55:15,405::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54922::DEBUG::2014-05-16 17:55:15,405::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54922::DEBUG::2014-05-16 17:55:15,405::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54922::DEBUG::2014-05-16 17:55:15,405::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54922::DEBUG::2014-05-16 17:55:15,406::task::974::TaskManager.Task::(_decref) Task=`5a2ea5fa-0993-4ec6-8bfa-906b2abbbf4b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:55:15,530::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:15,601::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347114 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:17,613::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:17,684::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351286 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:19,696::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:19,763::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313195 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:21,775::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:21,842::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310377 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:55:22,868::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:55:22,878::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000860035 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:23,854::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:23,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029654 s, 34.5 MB/s\n'; <rc> = 0 >Thread-54927::DEBUG::2014-05-16 17:55:25,435::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54927::DEBUG::2014-05-16 17:55:25,435::task::579::TaskManager.Task::(_updateState) Task=`dfe84cb7-1255-4130-acea-a7d4639a2389`::moving from state init -> state preparing >Thread-54927::INFO::2014-05-16 17:55:25,436::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54927::INFO::2014-05-16 17:55:25,436::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54927::DEBUG::2014-05-16 17:55:25,436::task::1168::TaskManager.Task::(prepare) Task=`dfe84cb7-1255-4130-acea-a7d4639a2389`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54927::DEBUG::2014-05-16 17:55:25,436::task::579::TaskManager.Task::(_updateState) Task=`dfe84cb7-1255-4130-acea-a7d4639a2389`::moving from state preparing -> state finished >Thread-54927::DEBUG::2014-05-16 17:55:25,436::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54927::DEBUG::2014-05-16 17:55:25,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54927::DEBUG::2014-05-16 17:55:25,437::task::974::TaskManager.Task::(_decref) Task=`dfe84cb7-1255-4130-acea-a7d4639a2389`::ref 0 aborting False >Thread-54928::DEBUG::2014-05-16 17:55:25,460::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54928::DEBUG::2014-05-16 17:55:25,460::task::579::TaskManager.Task::(_updateState) Task=`260b4388-9a33-4d35-8609-a3deda4c14ef`::moving from state init -> state preparing >Thread-54928::INFO::2014-05-16 17:55:25,461::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54928::DEBUG::2014-05-16 17:55:25,461::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b0668340-12b0-4bd0-8ef8-fb0b4ced8383`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54928::DEBUG::2014-05-16 17:55:25,461::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54928::DEBUG::2014-05-16 17:55:25,461::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54928::DEBUG::2014-05-16 17:55:25,461::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b0668340-12b0-4bd0-8ef8-fb0b4ced8383`::Granted request >Thread-54928::DEBUG::2014-05-16 17:55:25,462::task::811::TaskManager.Task::(resourceAcquired) Task=`260b4388-9a33-4d35-8609-a3deda4c14ef`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54928::DEBUG::2014-05-16 17:55:25,462::task::974::TaskManager.Task::(_decref) Task=`260b4388-9a33-4d35-8609-a3deda4c14ef`::ref 1 aborting False >Thread-54928::INFO::2014-05-16 17:55:25,463::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54928::DEBUG::2014-05-16 17:55:25,463::task::1168::TaskManager.Task::(prepare) Task=`260b4388-9a33-4d35-8609-a3deda4c14ef`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54928::DEBUG::2014-05-16 17:55:25,463::task::579::TaskManager.Task::(_updateState) Task=`260b4388-9a33-4d35-8609-a3deda4c14ef`::moving from state preparing -> state finished >Thread-54928::DEBUG::2014-05-16 17:55:25,463::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54928::DEBUG::2014-05-16 17:55:25,463::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54928::DEBUG::2014-05-16 17:55:25,463::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54928::DEBUG::2014-05-16 17:55:25,464::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54928::DEBUG::2014-05-16 17:55:25,464::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54928::DEBUG::2014-05-16 17:55:25,464::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54928::DEBUG::2014-05-16 17:55:25,464::task::974::TaskManager.Task::(_decref) Task=`260b4388-9a33-4d35-8609-a3deda4c14ef`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:55:25,931::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:26,002::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355156 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:28,014::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:28,082::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315138 s, 32.5 MB/s\n'; <rc> = 0 >Thread-54929::DEBUG::2014-05-16 17:55:28,404::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4342626.000000 / 8.008340 / 262500000.000000 = 0.206576 >Thread-54929::DEBUG::2014-05-16 17:55:28,404::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0056385027284865594, 'statsAge': 1.7377150058746338, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20657635532849081, 'rxDropped': 0} >Thread-54929::DEBUG::2014-05-16 17:55:28,405::task::579::TaskManager.Task::(_updateState) Task=`3e7e3d4a-0c98-44f4-9878-619da3c22dce`::moving from state init -> state preparing >Thread-54929::INFO::2014-05-16 17:55:28,405::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54929::INFO::2014-05-16 17:55:28,405::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860035', 'lastCheck': '5.5', 'valid': True}} >Thread-54929::DEBUG::2014-05-16 17:55:28,406::task::1168::TaskManager.Task::(prepare) Task=`3e7e3d4a-0c98-44f4-9878-619da3c22dce`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860035', 'lastCheck': '5.5', 'valid': True}} >Thread-54929::DEBUG::2014-05-16 17:55:28,406::task::579::TaskManager.Task::(_updateState) Task=`3e7e3d4a-0c98-44f4-9878-619da3c22dce`::moving from state preparing -> state finished >Thread-54929::DEBUG::2014-05-16 17:55:28,406::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54929::DEBUG::2014-05-16 17:55:28,406::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54929::DEBUG::2014-05-16 17:55:28,406::task::974::TaskManager.Task::(_decref) Task=`3e7e3d4a-0c98-44f4-9878-619da3c22dce`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:55:30,093::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:30,170::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036161 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:32,182::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:32,256::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370977 s, 27.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:55:32,913::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:55:32,924::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000790266 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:34,268::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:34,339::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354262 s, 28.9 MB/s\n'; <rc> = 0 >Thread-54933::DEBUG::2014-05-16 17:55:35,510::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54933::DEBUG::2014-05-16 17:55:35,510::task::579::TaskManager.Task::(_updateState) Task=`e51dd9d5-e774-4f91-b321-c8791655091e`::moving from state init -> state preparing >Thread-54933::INFO::2014-05-16 17:55:35,510::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54933::INFO::2014-05-16 17:55:35,511::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54933::DEBUG::2014-05-16 17:55:35,511::task::1168::TaskManager.Task::(prepare) Task=`e51dd9d5-e774-4f91-b321-c8791655091e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54933::DEBUG::2014-05-16 17:55:35,511::task::579::TaskManager.Task::(_updateState) Task=`e51dd9d5-e774-4f91-b321-c8791655091e`::moving from state preparing -> state finished >Thread-54933::DEBUG::2014-05-16 17:55:35,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54933::DEBUG::2014-05-16 17:55:35,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54933::DEBUG::2014-05-16 17:55:35,512::task::974::TaskManager.Task::(_decref) Task=`e51dd9d5-e774-4f91-b321-c8791655091e`::ref 0 aborting False >Thread-54934::DEBUG::2014-05-16 17:55:35,520::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54934::DEBUG::2014-05-16 17:55:35,520::task::579::TaskManager.Task::(_updateState) Task=`537e38cb-a1d0-465a-911d-616177bed974`::moving from state init -> state preparing >Thread-54934::INFO::2014-05-16 17:55:35,520::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54934::DEBUG::2014-05-16 17:55:35,521::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`90053d12-d681-405c-a3b5-35f0cb146048`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54934::DEBUG::2014-05-16 17:55:35,521::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54934::DEBUG::2014-05-16 17:55:35,521::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54934::DEBUG::2014-05-16 17:55:35,521::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`90053d12-d681-405c-a3b5-35f0cb146048`::Granted request >Thread-54934::DEBUG::2014-05-16 17:55:35,522::task::811::TaskManager.Task::(resourceAcquired) Task=`537e38cb-a1d0-465a-911d-616177bed974`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54934::DEBUG::2014-05-16 17:55:35,522::task::974::TaskManager.Task::(_decref) Task=`537e38cb-a1d0-465a-911d-616177bed974`::ref 1 aborting False >Thread-54934::INFO::2014-05-16 17:55:35,523::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54934::DEBUG::2014-05-16 17:55:35,523::task::1168::TaskManager.Task::(prepare) Task=`537e38cb-a1d0-465a-911d-616177bed974`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54934::DEBUG::2014-05-16 17:55:35,523::task::579::TaskManager.Task::(_updateState) Task=`537e38cb-a1d0-465a-911d-616177bed974`::moving from state preparing -> state finished >Thread-54934::DEBUG::2014-05-16 17:55:35,523::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54934::DEBUG::2014-05-16 17:55:35,524::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54934::DEBUG::2014-05-16 17:55:35,524::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54934::DEBUG::2014-05-16 17:55:35,524::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54934::DEBUG::2014-05-16 17:55:35,524::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54934::DEBUG::2014-05-16 17:55:35,524::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54934::DEBUG::2014-05-16 17:55:35,524::task::974::TaskManager.Task::(_decref) Task=`537e38cb-a1d0-465a-911d-616177bed974`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:55:36,351::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:36,418::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317576 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:38,430::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:38,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345109 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:40,513::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:40,592::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357442 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:42,604::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:42,671::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314441 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:55:42,961::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:55:42,971::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721691 s, 5.7 MB/s\n'; <rc> = 0 >Thread-54937::DEBUG::2014-05-16 17:55:43,591::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4311286.000000 / 8.008367 / 262500000.000000 = 0.205085 >Thread-54937::DEBUG::2014-05-16 17:55:43,591::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053536388170073073, 'statsAge': 0.90760493278503418, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20508483864817464, 'rxDropped': 0} >Thread-54937::DEBUG::2014-05-16 17:55:43,603::task::579::TaskManager.Task::(_updateState) Task=`8abbc089-60df-45f9-aa0b-bcc978d30ef9`::moving from state init -> state preparing >Thread-54937::INFO::2014-05-16 17:55:43,603::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54937::INFO::2014-05-16 17:55:43,603::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721691', 'lastCheck': '0.6', 'valid': True}} >Thread-54937::DEBUG::2014-05-16 17:55:43,604::task::1168::TaskManager.Task::(prepare) Task=`8abbc089-60df-45f9-aa0b-bcc978d30ef9`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721691', 'lastCheck': '0.6', 'valid': True}} >Thread-54937::DEBUG::2014-05-16 17:55:43,604::task::579::TaskManager.Task::(_updateState) Task=`8abbc089-60df-45f9-aa0b-bcc978d30ef9`::moving from state preparing -> state finished >Thread-54937::DEBUG::2014-05-16 17:55:43,604::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54937::DEBUG::2014-05-16 17:55:43,604::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54937::DEBUG::2014-05-16 17:55:43,604::task::974::TaskManager.Task::(_decref) Task=`8abbc089-60df-45f9-aa0b-bcc978d30ef9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:55:44,683::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:44,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339279 s, 30.2 MB/s\n'; <rc> = 0 >Thread-54939::DEBUG::2014-05-16 17:55:45,558::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54939::DEBUG::2014-05-16 17:55:45,559::task::579::TaskManager.Task::(_updateState) Task=`6fa00c3f-2353-4098-b8f5-247157f64777`::moving from state init -> state preparing >Thread-54939::INFO::2014-05-16 17:55:45,559::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54939::INFO::2014-05-16 17:55:45,559::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54939::DEBUG::2014-05-16 17:55:45,559::task::1168::TaskManager.Task::(prepare) Task=`6fa00c3f-2353-4098-b8f5-247157f64777`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54939::DEBUG::2014-05-16 17:55:45,559::task::579::TaskManager.Task::(_updateState) Task=`6fa00c3f-2353-4098-b8f5-247157f64777`::moving from state preparing -> state finished >Thread-54939::DEBUG::2014-05-16 17:55:45,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54939::DEBUG::2014-05-16 17:55:45,560::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54939::DEBUG::2014-05-16 17:55:45,560::task::974::TaskManager.Task::(_decref) Task=`6fa00c3f-2353-4098-b8f5-247157f64777`::ref 0 aborting False >Thread-54940::DEBUG::2014-05-16 17:55:45,568::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54940::DEBUG::2014-05-16 17:55:45,569::task::579::TaskManager.Task::(_updateState) Task=`64fe644d-dba6-4187-87ee-fd6a01266d19`::moving from state init -> state preparing >Thread-54940::INFO::2014-05-16 17:55:45,569::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54940::DEBUG::2014-05-16 17:55:45,569::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c7cb0267-8510-4e15-9e4a-21c04389d0a4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54940::DEBUG::2014-05-16 17:55:45,569::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54940::DEBUG::2014-05-16 17:55:45,570::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54940::DEBUG::2014-05-16 17:55:45,570::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c7cb0267-8510-4e15-9e4a-21c04389d0a4`::Granted request >Thread-54940::DEBUG::2014-05-16 17:55:45,570::task::811::TaskManager.Task::(resourceAcquired) Task=`64fe644d-dba6-4187-87ee-fd6a01266d19`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54940::DEBUG::2014-05-16 17:55:45,570::task::974::TaskManager.Task::(_decref) Task=`64fe644d-dba6-4187-87ee-fd6a01266d19`::ref 1 aborting False >Thread-54940::INFO::2014-05-16 17:55:45,571::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54940::DEBUG::2014-05-16 17:55:45,571::task::1168::TaskManager.Task::(prepare) Task=`64fe644d-dba6-4187-87ee-fd6a01266d19`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54940::DEBUG::2014-05-16 17:55:45,571::task::579::TaskManager.Task::(_updateState) Task=`64fe644d-dba6-4187-87ee-fd6a01266d19`::moving from state preparing -> state finished >Thread-54940::DEBUG::2014-05-16 17:55:45,571::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54940::DEBUG::2014-05-16 17:55:45,571::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54940::DEBUG::2014-05-16 17:55:45,572::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54940::DEBUG::2014-05-16 17:55:45,572::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54940::DEBUG::2014-05-16 17:55:45,572::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54940::DEBUG::2014-05-16 17:55:45,572::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54940::DEBUG::2014-05-16 17:55:45,572::task::974::TaskManager.Task::(_decref) Task=`64fe644d-dba6-4187-87ee-fd6a01266d19`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:55:46,765::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:46,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355657 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:48,848::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:48,914::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305698 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:50,926::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:50,993::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306301 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:53,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 17:55:53,024::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:55:53,055::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000774103 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:53,191::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.146463 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:55:55,202::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:55,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366192 s, 28.0 MB/s\n'; <rc> = 0 >Thread-54944::DEBUG::2014-05-16 17:55:55,602::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54944::DEBUG::2014-05-16 17:55:55,603::task::579::TaskManager.Task::(_updateState) Task=`58859331-4ee1-49e9-8c96-d139c94cc82e`::moving from state init -> state preparing >Thread-54944::INFO::2014-05-16 17:55:55,603::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54944::INFO::2014-05-16 17:55:55,603::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54944::DEBUG::2014-05-16 17:55:55,603::task::1168::TaskManager.Task::(prepare) Task=`58859331-4ee1-49e9-8c96-d139c94cc82e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54944::DEBUG::2014-05-16 17:55:55,604::task::579::TaskManager.Task::(_updateState) Task=`58859331-4ee1-49e9-8c96-d139c94cc82e`::moving from state preparing -> state finished >Thread-54944::DEBUG::2014-05-16 17:55:55,604::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54944::DEBUG::2014-05-16 17:55:55,604::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54944::DEBUG::2014-05-16 17:55:55,604::task::974::TaskManager.Task::(_decref) Task=`58859331-4ee1-49e9-8c96-d139c94cc82e`::ref 0 aborting False >Thread-54945::DEBUG::2014-05-16 17:55:55,613::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54945::DEBUG::2014-05-16 17:55:55,613::task::579::TaskManager.Task::(_updateState) Task=`694120c1-5d7c-4a9b-bee1-d63ca836630e`::moving from state init -> state preparing >Thread-54945::INFO::2014-05-16 17:55:55,613::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54945::DEBUG::2014-05-16 17:55:55,613::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b28d3289-f0b8-4c21-a125-f2691a1f1dd2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54945::DEBUG::2014-05-16 17:55:55,614::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54945::DEBUG::2014-05-16 17:55:55,614::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54945::DEBUG::2014-05-16 17:55:55,614::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b28d3289-f0b8-4c21-a125-f2691a1f1dd2`::Granted request >Thread-54945::DEBUG::2014-05-16 17:55:55,614::task::811::TaskManager.Task::(resourceAcquired) Task=`694120c1-5d7c-4a9b-bee1-d63ca836630e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54945::DEBUG::2014-05-16 17:55:55,614::task::974::TaskManager.Task::(_decref) Task=`694120c1-5d7c-4a9b-bee1-d63ca836630e`::ref 1 aborting False >Thread-54945::INFO::2014-05-16 17:55:55,615::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54945::DEBUG::2014-05-16 17:55:55,615::task::1168::TaskManager.Task::(prepare) Task=`694120c1-5d7c-4a9b-bee1-d63ca836630e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54945::DEBUG::2014-05-16 17:55:55,615::task::579::TaskManager.Task::(_updateState) Task=`694120c1-5d7c-4a9b-bee1-d63ca836630e`::moving from state preparing -> state finished >Thread-54945::DEBUG::2014-05-16 17:55:55,616::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54945::DEBUG::2014-05-16 17:55:55,616::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54945::DEBUG::2014-05-16 17:55:55,616::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54945::DEBUG::2014-05-16 17:55:55,616::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54945::DEBUG::2014-05-16 17:55:55,616::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54945::DEBUG::2014-05-16 17:55:55,616::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54945::DEBUG::2014-05-16 17:55:55,617::task::974::TaskManager.Task::(_decref) Task=`694120c1-5d7c-4a9b-bee1-d63ca836630e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:55:57,290::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:57,358::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320431 s, 32.0 MB/s\n'; <rc> = 0 >Thread-54947::DEBUG::2014-05-16 17:55:58,780::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319870.000000 / 8.008464 / 262500000.000000 = 0.205491 >Thread-54947::DEBUG::2014-05-16 17:55:58,781::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052455929555526564, 'statsAge': 0.074871063232421875, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20549068357820752, 'rxDropped': 0} >Thread-54947::DEBUG::2014-05-16 17:55:58,781::task::579::TaskManager.Task::(_updateState) Task=`6d47a79b-1cdd-4cb4-b517-377c71adc5dd`::moving from state init -> state preparing >Thread-54947::INFO::2014-05-16 17:55:58,781::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54947::INFO::2014-05-16 17:55:58,781::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774103', 'lastCheck': '5.6', 'valid': True}} >Thread-54947::DEBUG::2014-05-16 17:55:58,782::task::1168::TaskManager.Task::(prepare) Task=`6d47a79b-1cdd-4cb4-b517-377c71adc5dd`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774103', 'lastCheck': '5.6', 'valid': True}} >Thread-54947::DEBUG::2014-05-16 17:55:58,782::task::579::TaskManager.Task::(_updateState) Task=`6d47a79b-1cdd-4cb4-b517-377c71adc5dd`::moving from state preparing -> state finished >Thread-54947::DEBUG::2014-05-16 17:55:58,782::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54947::DEBUG::2014-05-16 17:55:58,782::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54947::DEBUG::2014-05-16 17:55:58,782::task::974::TaskManager.Task::(_decref) Task=`6d47a79b-1cdd-4cb4-b517-377c71adc5dd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:55:59,370::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:55:59,442::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364729 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:01,454::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:01,525::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353675 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:56:03,165::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:56:03,176::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102906 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:03,536::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:03,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354691 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:05,618::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54951::DEBUG::2014-05-16 17:56:05,667::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54951::DEBUG::2014-05-16 17:56:05,669::task::579::TaskManager.Task::(_updateState) Task=`0ef3779f-9e9b-4e7b-ab60-dd85229f137e`::moving from state init -> state preparing >Thread-54951::INFO::2014-05-16 17:56:05,670::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54951::INFO::2014-05-16 17:56:05,672::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54951::DEBUG::2014-05-16 17:56:05,673::task::1168::TaskManager.Task::(prepare) Task=`0ef3779f-9e9b-4e7b-ab60-dd85229f137e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54951::DEBUG::2014-05-16 17:56:05,673::task::579::TaskManager.Task::(_updateState) Task=`0ef3779f-9e9b-4e7b-ab60-dd85229f137e`::moving from state preparing -> state finished >Thread-54951::DEBUG::2014-05-16 17:56:05,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54951::DEBUG::2014-05-16 17:56:05,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54951::DEBUG::2014-05-16 17:56:05,676::task::974::TaskManager.Task::(_decref) Task=`0ef3779f-9e9b-4e7b-ab60-dd85229f137e`::ref 0 aborting False >Thread-54952::DEBUG::2014-05-16 17:56:05,689::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54952::DEBUG::2014-05-16 17:56:05,691::task::579::TaskManager.Task::(_updateState) Task=`e4da254a-09bd-4cd2-a389-7e3baadc7475`::moving from state init -> state preparing >Thread-54952::INFO::2014-05-16 17:56:05,692::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54952::DEBUG::2014-05-16 17:56:05,694::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`02e01e75-7338-4135-859e-303579b3b841`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54952::DEBUG::2014-05-16 17:56:05,695::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54952::DEBUG::2014-05-16 17:56:05,696::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54952::DEBUG::2014-05-16 17:56:05,697::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`02e01e75-7338-4135-859e-303579b3b841`::Granted request >Thread-54952::DEBUG::2014-05-16 17:56:05,699::task::811::TaskManager.Task::(resourceAcquired) Task=`e4da254a-09bd-4cd2-a389-7e3baadc7475`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54952::DEBUG::2014-05-16 17:56:05,700::task::974::TaskManager.Task::(_decref) Task=`e4da254a-09bd-4cd2-a389-7e3baadc7475`::ref 1 aborting False >Thread-54952::INFO::2014-05-16 17:56:05,703::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54952::DEBUG::2014-05-16 17:56:05,704::task::1168::TaskManager.Task::(prepare) Task=`e4da254a-09bd-4cd2-a389-7e3baadc7475`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54952::DEBUG::2014-05-16 17:56:05,705::task::579::TaskManager.Task::(_updateState) Task=`e4da254a-09bd-4cd2-a389-7e3baadc7475`::moving from state preparing -> state finished >Thread-54952::DEBUG::2014-05-16 17:56:05,706::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54952::DEBUG::2014-05-16 17:56:05,707::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54952::DEBUG::2014-05-16 17:56:05,708::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54952::DEBUG::2014-05-16 17:56:05,709::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54952::DEBUG::2014-05-16 17:56:05,710::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54952::DEBUG::2014-05-16 17:56:05,711::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54952::DEBUG::2014-05-16 17:56:05,712::task::974::TaskManager.Task::(_decref) Task=`e4da254a-09bd-4cd2-a389-7e3baadc7475`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:56:05,733::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349602 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:07,745::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:07,811::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314157 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:09,823::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:09,889::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303845 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:11,900::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:11,967::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314365 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:56:13,214::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:56:13,224::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108755 s, 3.8 MB/s\n'; <rc> = 0 >Thread-54955::DEBUG::2014-05-16 17:56:13,946::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4346618.000000 / 8.008497 / 262500000.000000 = 0.206762 >Thread-54955::DEBUG::2014-05-16 17:56:13,947::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054338476223893088, 'statsAge': 1.2257728576660156, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20676220222647398, 'rxDropped': 0} >Thread-54955::DEBUG::2014-05-16 17:56:13,947::task::579::TaskManager.Task::(_updateState) Task=`e53cb7af-93bc-493a-8fa9-40a129b28734`::moving from state init -> state preparing >Thread-54955::INFO::2014-05-16 17:56:13,947::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54955::INFO::2014-05-16 17:56:13,947::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108755', 'lastCheck': '0.7', 'valid': True}} >Thread-54955::DEBUG::2014-05-16 17:56:13,948::task::1168::TaskManager.Task::(prepare) Task=`e53cb7af-93bc-493a-8fa9-40a129b28734`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108755', 'lastCheck': '0.7', 'valid': True}} >Thread-54955::DEBUG::2014-05-16 17:56:13,948::task::579::TaskManager.Task::(_updateState) Task=`e53cb7af-93bc-493a-8fa9-40a129b28734`::moving from state preparing -> state finished >Thread-54955::DEBUG::2014-05-16 17:56:13,948::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54955::DEBUG::2014-05-16 17:56:13,948::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54955::DEBUG::2014-05-16 17:56:13,948::task::974::TaskManager.Task::(_decref) Task=`e53cb7af-93bc-493a-8fa9-40a129b28734`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:56:13,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:14,050::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347865 s, 29.4 MB/s\n'; <rc> = 0 >Thread-54957::DEBUG::2014-05-16 17:56:15,838::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54957::DEBUG::2014-05-16 17:56:15,838::task::579::TaskManager.Task::(_updateState) Task=`9b6a4e01-fce7-4b9a-8bd1-6befbcff8787`::moving from state init -> state preparing >Thread-54957::INFO::2014-05-16 17:56:15,839::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54957::INFO::2014-05-16 17:56:15,839::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54957::DEBUG::2014-05-16 17:56:15,839::task::1168::TaskManager.Task::(prepare) Task=`9b6a4e01-fce7-4b9a-8bd1-6befbcff8787`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54957::DEBUG::2014-05-16 17:56:15,839::task::579::TaskManager.Task::(_updateState) Task=`9b6a4e01-fce7-4b9a-8bd1-6befbcff8787`::moving from state preparing -> state finished >Thread-54957::DEBUG::2014-05-16 17:56:15,839::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54957::DEBUG::2014-05-16 17:56:15,839::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54957::DEBUG::2014-05-16 17:56:15,840::task::974::TaskManager.Task::(_decref) Task=`9b6a4e01-fce7-4b9a-8bd1-6befbcff8787`::ref 0 aborting False >Thread-54958::DEBUG::2014-05-16 17:56:15,849::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54958::DEBUG::2014-05-16 17:56:15,850::task::579::TaskManager.Task::(_updateState) Task=`35803d51-1695-42cb-a3b1-9d5d297c814d`::moving from state init -> state preparing >Thread-54958::INFO::2014-05-16 17:56:15,850::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54958::DEBUG::2014-05-16 17:56:15,850::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dd0b977d-1f98-4ccc-a6cb-5c1a03c9e095`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54958::DEBUG::2014-05-16 17:56:15,850::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54958::DEBUG::2014-05-16 17:56:15,851::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54958::DEBUG::2014-05-16 17:56:15,851::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dd0b977d-1f98-4ccc-a6cb-5c1a03c9e095`::Granted request >Thread-54958::DEBUG::2014-05-16 17:56:15,851::task::811::TaskManager.Task::(resourceAcquired) Task=`35803d51-1695-42cb-a3b1-9d5d297c814d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54958::DEBUG::2014-05-16 17:56:15,851::task::974::TaskManager.Task::(_decref) Task=`35803d51-1695-42cb-a3b1-9d5d297c814d`::ref 1 aborting False >Thread-54958::INFO::2014-05-16 17:56:15,852::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54958::DEBUG::2014-05-16 17:56:15,852::task::1168::TaskManager.Task::(prepare) Task=`35803d51-1695-42cb-a3b1-9d5d297c814d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54958::DEBUG::2014-05-16 17:56:15,852::task::579::TaskManager.Task::(_updateState) Task=`35803d51-1695-42cb-a3b1-9d5d297c814d`::moving from state preparing -> state finished >Thread-54958::DEBUG::2014-05-16 17:56:15,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54958::DEBUG::2014-05-16 17:56:15,853::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54958::DEBUG::2014-05-16 17:56:15,853::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54958::DEBUG::2014-05-16 17:56:15,853::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54958::DEBUG::2014-05-16 17:56:15,853::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54958::DEBUG::2014-05-16 17:56:15,853::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54958::DEBUG::2014-05-16 17:56:15,854::task::974::TaskManager.Task::(_decref) Task=`35803d51-1695-42cb-a3b1-9d5d297c814d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:56:16,062::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:16,135::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371956 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:18,146::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:18,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312079 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:20,225::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:20,295::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341403 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:22,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:22,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316689 s, 32.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:56:23,262::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:56:23,272::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000829657 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:24,385::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:24,452::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304753 s, 33.6 MB/s\n'; <rc> = 0 >Thread-54962::DEBUG::2014-05-16 17:56:25,923::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54962::DEBUG::2014-05-16 17:56:25,923::task::579::TaskManager.Task::(_updateState) Task=`6cba6552-8bfe-4dee-a7cb-8a434c5e471d`::moving from state init -> state preparing >Thread-54962::INFO::2014-05-16 17:56:25,923::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54962::INFO::2014-05-16 17:56:25,924::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54962::DEBUG::2014-05-16 17:56:25,924::task::1168::TaskManager.Task::(prepare) Task=`6cba6552-8bfe-4dee-a7cb-8a434c5e471d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54962::DEBUG::2014-05-16 17:56:25,924::task::579::TaskManager.Task::(_updateState) Task=`6cba6552-8bfe-4dee-a7cb-8a434c5e471d`::moving from state preparing -> state finished >Thread-54962::DEBUG::2014-05-16 17:56:25,924::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54962::DEBUG::2014-05-16 17:56:25,924::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54962::DEBUG::2014-05-16 17:56:25,924::task::974::TaskManager.Task::(_decref) Task=`6cba6552-8bfe-4dee-a7cb-8a434c5e471d`::ref 0 aborting False >Thread-54963::DEBUG::2014-05-16 17:56:25,934::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54963::DEBUG::2014-05-16 17:56:25,934::task::579::TaskManager.Task::(_updateState) Task=`d0cf9461-ff61-4d62-b665-8fdf2fce8d1b`::moving from state init -> state preparing >Thread-54963::INFO::2014-05-16 17:56:25,934::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54963::DEBUG::2014-05-16 17:56:25,934::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3f35adbe-2f47-4435-bdcd-7f030176591c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54963::DEBUG::2014-05-16 17:56:25,935::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54963::DEBUG::2014-05-16 17:56:25,935::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54963::DEBUG::2014-05-16 17:56:25,935::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3f35adbe-2f47-4435-bdcd-7f030176591c`::Granted request >Thread-54963::DEBUG::2014-05-16 17:56:25,936::task::811::TaskManager.Task::(resourceAcquired) Task=`d0cf9461-ff61-4d62-b665-8fdf2fce8d1b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54963::DEBUG::2014-05-16 17:56:25,936::task::974::TaskManager.Task::(_decref) Task=`d0cf9461-ff61-4d62-b665-8fdf2fce8d1b`::ref 1 aborting False >Thread-54963::INFO::2014-05-16 17:56:25,937::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54963::DEBUG::2014-05-16 17:56:25,937::task::1168::TaskManager.Task::(prepare) Task=`d0cf9461-ff61-4d62-b665-8fdf2fce8d1b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54963::DEBUG::2014-05-16 17:56:25,937::task::579::TaskManager.Task::(_updateState) Task=`d0cf9461-ff61-4d62-b665-8fdf2fce8d1b`::moving from state preparing -> state finished >Thread-54963::DEBUG::2014-05-16 17:56:25,937::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54963::DEBUG::2014-05-16 17:56:25,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54963::DEBUG::2014-05-16 17:56:25,937::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54963::DEBUG::2014-05-16 17:56:25,938::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54963::DEBUG::2014-05-16 17:56:25,938::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54963::DEBUG::2014-05-16 17:56:25,938::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54963::DEBUG::2014-05-16 17:56:25,938::task::974::TaskManager.Task::(_decref) Task=`d0cf9461-ff61-4d62-b665-8fdf2fce8d1b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:56:26,464::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:26,537::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362199 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:28,548::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:28,616::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312789 s, 32.7 MB/s\n'; <rc> = 0 >Thread-54965::DEBUG::2014-05-16 17:56:29,163::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5419558.000000 / 8.008637 / 262500000.000000 = 0.257796 >Thread-54965::DEBUG::2014-05-16 17:56:29,163::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066516756696471564, 'statsAge': 0.42551779747009277, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25779586150091249, 'rxDropped': 0} >Thread-54965::DEBUG::2014-05-16 17:56:29,164::task::579::TaskManager.Task::(_updateState) Task=`063aac60-1b80-4d02-a204-7a1407f51e95`::moving from state init -> state preparing >Thread-54965::INFO::2014-05-16 17:56:29,164::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54965::INFO::2014-05-16 17:56:29,165::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000829657', 'lastCheck': '5.9', 'valid': True}} >Thread-54965::DEBUG::2014-05-16 17:56:29,165::task::1168::TaskManager.Task::(prepare) Task=`063aac60-1b80-4d02-a204-7a1407f51e95`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000829657', 'lastCheck': '5.9', 'valid': True}} >Thread-54965::DEBUG::2014-05-16 17:56:29,165::task::579::TaskManager.Task::(_updateState) Task=`063aac60-1b80-4d02-a204-7a1407f51e95`::moving from state preparing -> state finished >Thread-54965::DEBUG::2014-05-16 17:56:29,165::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54965::DEBUG::2014-05-16 17:56:29,165::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54965::DEBUG::2014-05-16 17:56:29,165::task::974::TaskManager.Task::(_decref) Task=`063aac60-1b80-4d02-a204-7a1407f51e95`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:56:30,627::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:30,698::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347444 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:32,710::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:32,786::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0404465 s, 25.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:56:33,293::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 17:56:33,293::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:56:33,308::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:56:33,316::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000789084 s, 2.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:56:33,317::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000789084 s, 2.6 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 17:56:33,317::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 17:56:33,317::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 17:56:33,317::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 17:56:33,317::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:56:33,318::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:56:33,318::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:56:33,318::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:56:33,318::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 17:56:33,319::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:56:33,467::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:56:33,469::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 17:56:33,469::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 17:56:33,470::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 17:56:33,470::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 17:56:33,470::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 17:56:33,471::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 17:56:33,613::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:56:33,633::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:56:33,643::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571784 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:34,798::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:34,869::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350949 s, 29.2 MB/s\n'; <rc> = 0 >Thread-54969::DEBUG::2014-05-16 17:56:35,985::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54969::DEBUG::2014-05-16 17:56:35,985::task::579::TaskManager.Task::(_updateState) Task=`4b10ed9f-c670-4fff-a457-019eab98931b`::moving from state init -> state preparing >Thread-54969::INFO::2014-05-16 17:56:35,986::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54969::INFO::2014-05-16 17:56:35,986::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54969::DEBUG::2014-05-16 17:56:35,986::task::1168::TaskManager.Task::(prepare) Task=`4b10ed9f-c670-4fff-a457-019eab98931b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54969::DEBUG::2014-05-16 17:56:35,986::task::579::TaskManager.Task::(_updateState) Task=`4b10ed9f-c670-4fff-a457-019eab98931b`::moving from state preparing -> state finished >Thread-54969::DEBUG::2014-05-16 17:56:35,986::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54969::DEBUG::2014-05-16 17:56:35,986::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54969::DEBUG::2014-05-16 17:56:35,986::task::974::TaskManager.Task::(_decref) Task=`4b10ed9f-c670-4fff-a457-019eab98931b`::ref 0 aborting False >Thread-54970::DEBUG::2014-05-16 17:56:35,995::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54970::DEBUG::2014-05-16 17:56:35,995::task::579::TaskManager.Task::(_updateState) Task=`4ee79d12-c912-471d-9185-f14e4ebd963a`::moving from state init -> state preparing >Thread-54970::INFO::2014-05-16 17:56:35,995::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54970::DEBUG::2014-05-16 17:56:35,996::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e45ac135-3031-494e-b812-744457df1caa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54970::DEBUG::2014-05-16 17:56:35,996::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54970::DEBUG::2014-05-16 17:56:35,996::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54970::DEBUG::2014-05-16 17:56:35,996::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e45ac135-3031-494e-b812-744457df1caa`::Granted request >Thread-54970::DEBUG::2014-05-16 17:56:35,997::task::811::TaskManager.Task::(resourceAcquired) Task=`4ee79d12-c912-471d-9185-f14e4ebd963a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54970::DEBUG::2014-05-16 17:56:35,997::task::974::TaskManager.Task::(_decref) Task=`4ee79d12-c912-471d-9185-f14e4ebd963a`::ref 1 aborting False >Thread-54970::INFO::2014-05-16 17:56:35,997::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54970::DEBUG::2014-05-16 17:56:35,997::task::1168::TaskManager.Task::(prepare) Task=`4ee79d12-c912-471d-9185-f14e4ebd963a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54970::DEBUG::2014-05-16 17:56:35,998::task::579::TaskManager.Task::(_updateState) Task=`4ee79d12-c912-471d-9185-f14e4ebd963a`::moving from state preparing -> state finished >Thread-54970::DEBUG::2014-05-16 17:56:35,998::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54970::DEBUG::2014-05-16 17:56:35,998::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54970::DEBUG::2014-05-16 17:56:35,998::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54970::DEBUG::2014-05-16 17:56:35,998::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54970::DEBUG::2014-05-16 17:56:35,998::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54970::DEBUG::2014-05-16 17:56:35,998::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54970::DEBUG::2014-05-16 17:56:35,999::task::974::TaskManager.Task::(_decref) Task=`4ee79d12-c912-471d-9185-f14e4ebd963a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:56:36,880::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:36,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317982 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:38,959::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:39,038::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298266 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:41,052::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:41,123::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338159 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:43,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:43,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314367 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:56:43,679::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:56:43,689::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000735724 s, 5.6 MB/s\n'; <rc> = 0 >Thread-54973::DEBUG::2014-05-16 17:56:44,373::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316150.000000 / 8.008291 / 262500000.000000 = 0.205318 >Thread-54973::DEBUG::2014-05-16 17:56:44,373::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053270506024492587, 'statsAge': 1.6181700229644775, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20531816561081376, 'rxDropped': 0} >Thread-54973::DEBUG::2014-05-16 17:56:44,374::task::579::TaskManager.Task::(_updateState) Task=`d35160c4-e121-4f26-ae7f-13dbeb72a60b`::moving from state init -> state preparing >Thread-54973::INFO::2014-05-16 17:56:44,374::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54973::INFO::2014-05-16 17:56:44,374::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735724', 'lastCheck': '0.7', 'valid': True}} >Thread-54973::DEBUG::2014-05-16 17:56:44,375::task::1168::TaskManager.Task::(prepare) Task=`d35160c4-e121-4f26-ae7f-13dbeb72a60b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735724', 'lastCheck': '0.7', 'valid': True}} >Thread-54973::DEBUG::2014-05-16 17:56:44,375::task::579::TaskManager.Task::(_updateState) Task=`d35160c4-e121-4f26-ae7f-13dbeb72a60b`::moving from state preparing -> state finished >Thread-54973::DEBUG::2014-05-16 17:56:44,375::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54973::DEBUG::2014-05-16 17:56:44,375::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54973::DEBUG::2014-05-16 17:56:44,375::task::974::TaskManager.Task::(_decref) Task=`d35160c4-e121-4f26-ae7f-13dbeb72a60b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:56:45,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:45,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303774 s, 33.7 MB/s\n'; <rc> = 0 >Thread-54975::DEBUG::2014-05-16 17:56:46,049::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54975::DEBUG::2014-05-16 17:56:46,050::task::579::TaskManager.Task::(_updateState) Task=`ee545d33-0642-4653-8d1f-aaec109b797e`::moving from state init -> state preparing >Thread-54975::INFO::2014-05-16 17:56:46,050::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54975::INFO::2014-05-16 17:56:46,050::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54975::DEBUG::2014-05-16 17:56:46,050::task::1168::TaskManager.Task::(prepare) Task=`ee545d33-0642-4653-8d1f-aaec109b797e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54975::DEBUG::2014-05-16 17:56:46,051::task::579::TaskManager.Task::(_updateState) Task=`ee545d33-0642-4653-8d1f-aaec109b797e`::moving from state preparing -> state finished >Thread-54975::DEBUG::2014-05-16 17:56:46,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54975::DEBUG::2014-05-16 17:56:46,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54975::DEBUG::2014-05-16 17:56:46,051::task::974::TaskManager.Task::(_decref) Task=`ee545d33-0642-4653-8d1f-aaec109b797e`::ref 0 aborting False >Thread-54976::DEBUG::2014-05-16 17:56:46,059::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54976::DEBUG::2014-05-16 17:56:46,060::task::579::TaskManager.Task::(_updateState) Task=`a1e097d5-93ab-4991-bc4f-5d5de1536943`::moving from state init -> state preparing >Thread-54976::INFO::2014-05-16 17:56:46,060::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54976::DEBUG::2014-05-16 17:56:46,061::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`398da957-42b9-4214-bdf3-4cb22d3cc3bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54976::DEBUG::2014-05-16 17:56:46,061::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54976::DEBUG::2014-05-16 17:56:46,061::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54976::DEBUG::2014-05-16 17:56:46,061::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`398da957-42b9-4214-bdf3-4cb22d3cc3bd`::Granted request >Thread-54976::DEBUG::2014-05-16 17:56:46,061::task::811::TaskManager.Task::(resourceAcquired) Task=`a1e097d5-93ab-4991-bc4f-5d5de1536943`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54976::DEBUG::2014-05-16 17:56:46,062::task::974::TaskManager.Task::(_decref) Task=`a1e097d5-93ab-4991-bc4f-5d5de1536943`::ref 1 aborting False >Thread-54976::INFO::2014-05-16 17:56:46,062::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54976::DEBUG::2014-05-16 17:56:46,062::task::1168::TaskManager.Task::(prepare) Task=`a1e097d5-93ab-4991-bc4f-5d5de1536943`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54976::DEBUG::2014-05-16 17:56:46,063::task::579::TaskManager.Task::(_updateState) Task=`a1e097d5-93ab-4991-bc4f-5d5de1536943`::moving from state preparing -> state finished >Thread-54976::DEBUG::2014-05-16 17:56:46,063::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54976::DEBUG::2014-05-16 17:56:46,063::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54976::DEBUG::2014-05-16 17:56:46,063::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54976::DEBUG::2014-05-16 17:56:46,063::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54976::DEBUG::2014-05-16 17:56:46,063::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54976::DEBUG::2014-05-16 17:56:46,064::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54976::DEBUG::2014-05-16 17:56:46,064::task::974::TaskManager.Task::(_decref) Task=`a1e097d5-93ab-4991-bc4f-5d5de1536943`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:56:47,291::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:47,362::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035308 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:49,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:49,441::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312049 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:51,453::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:51,521::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309908 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:53,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:53,603::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034505 s, 29.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:56:53,728::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:56:53,738::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000748975 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:56:55,614::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:55,686::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03578 s, 28.6 MB/s\n'; <rc> = 0 >Thread-54980::DEBUG::2014-05-16 17:56:56,128::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54980::DEBUG::2014-05-16 17:56:56,129::task::579::TaskManager.Task::(_updateState) Task=`c0535cc6-011e-426c-8212-01874dadfca7`::moving from state init -> state preparing >Thread-54980::INFO::2014-05-16 17:56:56,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54980::INFO::2014-05-16 17:56:56,129::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54980::DEBUG::2014-05-16 17:56:56,129::task::1168::TaskManager.Task::(prepare) Task=`c0535cc6-011e-426c-8212-01874dadfca7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54980::DEBUG::2014-05-16 17:56:56,129::task::579::TaskManager.Task::(_updateState) Task=`c0535cc6-011e-426c-8212-01874dadfca7`::moving from state preparing -> state finished >Thread-54980::DEBUG::2014-05-16 17:56:56,130::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54980::DEBUG::2014-05-16 17:56:56,130::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54980::DEBUG::2014-05-16 17:56:56,130::task::974::TaskManager.Task::(_decref) Task=`c0535cc6-011e-426c-8212-01874dadfca7`::ref 0 aborting False >Thread-54981::DEBUG::2014-05-16 17:56:56,139::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54981::DEBUG::2014-05-16 17:56:56,139::task::579::TaskManager.Task::(_updateState) Task=`451d890c-0336-4b46-908b-80c1bf89bbd6`::moving from state init -> state preparing >Thread-54981::INFO::2014-05-16 17:56:56,139::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54981::DEBUG::2014-05-16 17:56:56,139::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`247a3e71-66eb-44f0-b41a-4dbefed6f056`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54981::DEBUG::2014-05-16 17:56:56,140::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54981::DEBUG::2014-05-16 17:56:56,140::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54981::DEBUG::2014-05-16 17:56:56,140::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`247a3e71-66eb-44f0-b41a-4dbefed6f056`::Granted request >Thread-54981::DEBUG::2014-05-16 17:56:56,140::task::811::TaskManager.Task::(resourceAcquired) Task=`451d890c-0336-4b46-908b-80c1bf89bbd6`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54981::DEBUG::2014-05-16 17:56:56,140::task::974::TaskManager.Task::(_decref) Task=`451d890c-0336-4b46-908b-80c1bf89bbd6`::ref 1 aborting False >Thread-54981::INFO::2014-05-16 17:56:56,141::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54981::DEBUG::2014-05-16 17:56:56,141::task::1168::TaskManager.Task::(prepare) Task=`451d890c-0336-4b46-908b-80c1bf89bbd6`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54981::DEBUG::2014-05-16 17:56:56,141::task::579::TaskManager.Task::(_updateState) Task=`451d890c-0336-4b46-908b-80c1bf89bbd6`::moving from state preparing -> state finished >Thread-54981::DEBUG::2014-05-16 17:56:56,142::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54981::DEBUG::2014-05-16 17:56:56,142::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54981::DEBUG::2014-05-16 17:56:56,142::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54981::DEBUG::2014-05-16 17:56:56,142::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54981::DEBUG::2014-05-16 17:56:56,142::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54981::DEBUG::2014-05-16 17:56:56,142::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54981::DEBUG::2014-05-16 17:56:56,143::task::974::TaskManager.Task::(_decref) Task=`451d890c-0336-4b46-908b-80c1bf89bbd6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:56:57,697::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:57,764::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313949 s, 32.6 MB/s\n'; <rc> = 0 >Thread-54983::DEBUG::2014-05-16 17:56:59,558::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4323695.000000 / 8.008325 / 262500000.000000 = 0.205676 >Thread-54983::DEBUG::2014-05-16 17:56:59,558::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052875452012645444, 'statsAge': 0.78636503219604492, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20567620372619524, 'rxDropped': 0} >Thread-54983::DEBUG::2014-05-16 17:56:59,559::task::579::TaskManager.Task::(_updateState) Task=`848510d2-3019-4cae-bb7e-4a3b44c685b5`::moving from state init -> state preparing >Thread-54983::INFO::2014-05-16 17:56:59,559::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54983::INFO::2014-05-16 17:56:59,559::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748975', 'lastCheck': '5.8', 'valid': True}} >Thread-54983::DEBUG::2014-05-16 17:56:59,559::task::1168::TaskManager.Task::(prepare) Task=`848510d2-3019-4cae-bb7e-4a3b44c685b5`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748975', 'lastCheck': '5.8', 'valid': True}} >Thread-54983::DEBUG::2014-05-16 17:56:59,559::task::579::TaskManager.Task::(_updateState) Task=`848510d2-3019-4cae-bb7e-4a3b44c685b5`::moving from state preparing -> state finished >Thread-54983::DEBUG::2014-05-16 17:56:59,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54983::DEBUG::2014-05-16 17:56:59,560::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54983::DEBUG::2014-05-16 17:56:59,560::task::974::TaskManager.Task::(_decref) Task=`848510d2-3019-4cae-bb7e-4a3b44c685b5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:56:59,776::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:56:59,846::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345577 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:57:01,854::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:01,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444186 s, 23.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:57:03,772::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:57:03,783::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010296 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:57:03,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:04,018::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347507 s, 29.5 MB/s\n'; <rc> = 0 >Thread-54986::DEBUG::2014-05-16 17:57:05,613::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [49a001b9] >Thread-54986::DEBUG::2014-05-16 17:57:05,613::task::579::TaskManager.Task::(_updateState) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::moving from state init -> state preparing >Thread-54986::INFO::2014-05-16 17:57:05,613::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='01628de4-d767-4b97-bdcf-c1e3459c1476', size='34359738368', volFormat=4, preallocate=2, diskType=2, volUUID='458ec5f0-63fa-49a6-a086-e06ecc27582a', desc='', srcImgUUID='7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', srcVolUUID='77c78124-ee6c-46b1-9112-a738f448beca') >Thread-54986::DEBUG::2014-05-16 17:57:05,614::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`31efcfab-7766-42d4-9407-b9768a99341b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1484' at 'createVolume' >Thread-54986::DEBUG::2014-05-16 17:57:05,614::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-54986::DEBUG::2014-05-16 17:57:05,614::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-54986::DEBUG::2014-05-16 17:57:05,614::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`31efcfab-7766-42d4-9407-b9768a99341b`::Granted request >Thread-54986::DEBUG::2014-05-16 17:57:05,615::task::811::TaskManager.Task::(resourceAcquired) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-54986::DEBUG::2014-05-16 17:57:05,615::task::974::TaskManager.Task::(_decref) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::ref 1 aborting False >Thread-54986::DEBUG::2014-05-16 17:57:05,616::task::736::TaskManager.Task::(_save) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d.temp >Thread-54986::DEBUG::2014-05-16 17:57:05,622::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 0ed5d6c5-4689-4d69-9909-4a386461e36d >Thread-54986::INFO::2014-05-16 17:57:05,622::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-54986::DEBUG::2014-05-16 17:57:05,622::task::1163::TaskManager.Task::(prepare) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::Prepare: 1 jobs exist, move to acquiring >Thread-54986::DEBUG::2014-05-16 17:57:05,622::task::579::TaskManager.Task::(_updateState) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::moving from state preparing -> state acquiring >Thread-54986::DEBUG::2014-05-16 17:57:05,623::task::736::TaskManager.Task::(_save) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d.temp >Thread-54986::DEBUG::2014-05-16 17:57:05,628::task::579::TaskManager.Task::(_updateState) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::moving from state acquiring -> state queued >Thread-54986::DEBUG::2014-05-16 17:57:05,628::task::736::TaskManager.Task::(_save) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d.temp >Thread-54986::DEBUG::2014-05-16 17:57:05,634::taskManager::50::TaskManager::(_queueTask) queuing task: 0ed5d6c5-4689-4d69-9909-4a386461e36d >Thread-54986::DEBUG::2014-05-16 17:57:05,634::taskManager::56::TaskManager::(_queueTask) task queued: 0ed5d6c5-4689-4d69-9909-4a386461e36d >Thread-3::DEBUG::2014-05-16 17:57:05,634::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,635::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 0ed5d6c5-4689-4d69-9909-4a386461e36d running: <bound method Task.commit of <storage.task.Task instance at 0x7ff54050aea8>> with: None >Thread-54986::DEBUG::2014-05-16 17:57:05,635::task::1165::TaskManager.Task::(prepare) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::returning >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,636::task::1176::TaskManager.Task::(commit) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::committing task: 0ed5d6c5-4689-4d69-9909-4a386461e36d >Thread-54986::DEBUG::2014-05-16 17:57:05,637::task::974::TaskManager.Task::(_decref) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::ref 0 aborting False >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,637::task::579::TaskManager.Task::(_updateState) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::moving from state queued -> state running >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,639::task::736::TaskManager.Task::(_save) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d.temp >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,648::task::889::TaskManager.Task::(_runJobs) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x2b04510>> (args: ('f79908bf-a757-4a71-9ab5-3a12ede5f65c', '01628de4-d767-4b97-bdcf-c1e3459c1476', 67108864, 4, 2, 2, '458ec5f0-63fa-49a6-a086-e06ecc27582a', '', '7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', '77c78124-ee6c-46b1-9112-a738f448beca') kwargs: {}) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,649::task::315::TaskManager.Task::(run) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x2b04510>> (args: ('f79908bf-a757-4a71-9ab5-3a12ede5f65c', '01628de4-d767-4b97-bdcf-c1e3459c1476', 67108864, 4, 2, 2, '458ec5f0-63fa-49a6-a086-e06ecc27582a', '', '7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', '77c78124-ee6c-46b1-9112-a738f448beca') kwargs: {}) callback None >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,649::resourceManager::197::ResourceManager.Request::(__init__) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.01628de4-d767-4b97-bdcf-c1e3459c1476`ReqID=`010215b1-9447-4528-b24e-015183615434`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1895' at 'createVolume' >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,649::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.01628de4-d767-4b97-bdcf-c1e3459c1476' for lock type 'exclusive' >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,649::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,650::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,794::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,809::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,809::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,809::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 01628de4-d767-4b97-bdcf-c1e3459c1476 does not exist in domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,809::resourceManager::600::ResourceManager::(registerResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.01628de4-d767-4b97-bdcf-c1e3459c1476' is free. Now locking as 'exclusive' (1 active user) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,810::resourceManager::237::ResourceManager.Request::(grant) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.01628de4-d767-4b97-bdcf-c1e3459c1476`ReqID=`010215b1-9447-4528-b24e-015183615434`::Granted request >0ed5d6c5-4689-4d69-9909-4a386461e36d::INFO::2014-05-16 17:57:05,810::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476 for image's volumes >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,811::task::736::TaskManager.Task::(_save) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d.temp >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,835::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,844::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000504942 s, 1.0 MB/s\n'; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,844::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000504942 s, 1.0 MB/s'], size: 512 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,845::volume::300::Storage.Volume::(share) Share volume 77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,860::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,868::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000563519 s, 909 kB/s\n'; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,869::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000563519 s, 909 kB/s'], size: 512 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,870::task::736::TaskManager.Task::(_save) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d.temp >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,876::blockVolume::380::Storage.Volume::(_share) Share volume 77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,895::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,903::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000510507 s, 1.0 MB/s\n'; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,903::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000510507 s, 1.0 MB/s'], size: 512 >0ed5d6c5-4689-4d69-9909-4a386461e36d::INFO::2014-05-16 17:57:05,904::volume::446::Storage.Volume::(create) Creating volume 458ec5f0-63fa-49a6-a086-e06ecc27582a >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,904::task::736::TaskManager.Task::(_save) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d.temp >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,912::task::736::TaskManager.Task::(_save) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d.temp >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:05,921::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 458ec5f0-63fa-49a6-a086-e06ecc27582a f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:06,030::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:06,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0479035 s, 21.4 MB/s\n'; <rc> = 0 >Thread-54988::DEBUG::2014-05-16 17:57:06,194::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54988::DEBUG::2014-05-16 17:57:06,196::task::579::TaskManager.Task::(_updateState) Task=`5c98677a-cfb5-4b88-bd83-83d8fe3d0076`::moving from state init -> state preparing >Thread-54988::INFO::2014-05-16 17:57:06,196::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54988::INFO::2014-05-16 17:57:06,196::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54988::DEBUG::2014-05-16 17:57:06,196::task::1168::TaskManager.Task::(prepare) Task=`5c98677a-cfb5-4b88-bd83-83d8fe3d0076`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54988::DEBUG::2014-05-16 17:57:06,197::task::579::TaskManager.Task::(_updateState) Task=`5c98677a-cfb5-4b88-bd83-83d8fe3d0076`::moving from state preparing -> state finished >Thread-54988::DEBUG::2014-05-16 17:57:06,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54988::DEBUG::2014-05-16 17:57:06,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54988::DEBUG::2014-05-16 17:57:06,197::task::974::TaskManager.Task::(_decref) Task=`5c98677a-cfb5-4b88-bd83-83d8fe3d0076`::ref 0 aborting False >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,205::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,206::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,206::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,206::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,206::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::WARNING::2014-05-16 17:57:06,207::utils::114::root::(rmFile) File: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a already removed >0ed5d6c5-4689-4d69-9909-4a386461e36d::INFO::2014-05-16 17:57:06,211::blockVolume::196::Storage.Volume::(_create) Request to create snapshot 01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a of volume 7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96/77c78124-ee6c-46b1-9112-a738f448beca >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,212::task::736::TaskManager.Task::(_save) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d.temp >Thread-54989::DEBUG::2014-05-16 17:57:06,219::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54989::DEBUG::2014-05-16 17:57:06,220::task::579::TaskManager.Task::(_updateState) Task=`195cffeb-c506-4084-b59a-ce4bac684f42`::moving from state init -> state preparing >Thread-54989::INFO::2014-05-16 17:57:06,221::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54989::DEBUG::2014-05-16 17:57:06,223::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f74cb387-5cd2-4b5d-9e52-27339b86f83a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54989::DEBUG::2014-05-16 17:57:06,224::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54989::DEBUG::2014-05-16 17:57:06,225::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54989::DEBUG::2014-05-16 17:57:06,225::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f74cb387-5cd2-4b5d-9e52-27339b86f83a`::Granted request >Thread-54989::DEBUG::2014-05-16 17:57:06,225::task::811::TaskManager.Task::(resourceAcquired) Task=`195cffeb-c506-4084-b59a-ce4bac684f42`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54989::DEBUG::2014-05-16 17:57:06,226::task::974::TaskManager.Task::(_decref) Task=`195cffeb-c506-4084-b59a-ce4bac684f42`::ref 1 aborting False >Thread-54989::DEBUG::2014-05-16 17:57:06,229::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-54989::DEBUG::2014-05-16 17:57:06,231::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,270::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,279::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000418554 s, 1.2 MB/s\n'; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,279::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000418554 s, 1.2 MB/s'], size: 512 >0ed5d6c5-4689-4d69-9909-4a386461e36d::INFO::2014-05-16 17:57:06,280::volume::793::Storage.Volume::(prepare) Volume: preparing volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,303::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,312::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00047928 s, 1.1 MB/s\n'; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,313::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00047928 s, 1.1 MB/s'], size: 512 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,313::resourceManager::197::ResourceManager.Request::(__init__) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca`ReqID=`0232a584-6983-4aba-b168-4033c4ba62b6`::Request was made in '/usr/share/vdsm/storage/volume.py' line '810' at 'prepare' >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,313::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' for lock type 'shared' >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,315::resourceManager::600::ResourceManager::(registerResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' is free. Now locking as 'shared' (1 active user) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,315::resourceManager::237::ResourceManager.Request::(grant) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca`ReqID=`0232a584-6983-4aba-b168-4033c4ba62b6`::Granted request >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,334::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,343::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000545849 s, 938 kB/s\n'; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,343::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000545849 s, 938 kB/s'], size: 512 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,343::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,362::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,372::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000564822 s, 906 kB/s\n'; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,372::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000564822 s, 906 kB/s'], size: 512 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,396::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-54989::DEBUG::2014-05-16 17:57:06,409::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,414::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000465061 s, 1.1 MB/s\n'; <rc> = 0 >Thread-54989::DEBUG::2014-05-16 17:57:06,414::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,415::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000465061 s, 1.1 MB/s'], size: 512 >Thread-54989::INFO::2014-05-16 17:57:06,418::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54989::DEBUG::2014-05-16 17:57:06,419::task::1168::TaskManager.Task::(prepare) Task=`195cffeb-c506-4084-b59a-ce4bac684f42`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,419::volume::1058::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../01628de4-d767-4b97-bdcf-c1e3459c1476/77c78124-ee6c-46b1-9112-a738f448beca /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a' (cwd /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476) >Thread-54989::DEBUG::2014-05-16 17:57:06,420::task::579::TaskManager.Task::(_updateState) Task=`195cffeb-c506-4084-b59a-ce4bac684f42`::moving from state preparing -> state finished >Thread-54989::DEBUG::2014-05-16 17:57:06,428::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54989::DEBUG::2014-05-16 17:57:06,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54989::DEBUG::2014-05-16 17:57:06,429::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54989::DEBUG::2014-05-16 17:57:06,430::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54989::DEBUG::2014-05-16 17:57:06,430::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54989::DEBUG::2014-05-16 17:57:06,430::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54989::DEBUG::2014-05-16 17:57:06,430::task::974::TaskManager.Task::(_decref) Task=`195cffeb-c506-4084-b59a-ce4bac684f42`::ref 0 aborting False >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,479::volume::1058::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::INFO::2014-05-16 17:57:06,479::blockVolume::420::Storage.Volume::(teardown) Tearing down volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca justme False >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,479::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,480::resourceManager::634::ResourceManager::(releaseResource) Released resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' (0 active users) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,480::resourceManager::640::ResourceManager::(releaseResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' is free, finding out if anyone is waiting for it. >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,480::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,646::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,647::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,647::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,647::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca', Clearing records. >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,647::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,648::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,792::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,808::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,808::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,808::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,809::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,952::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,967::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,967::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::WARNING::2014-05-16 17:57:06,967::blockSD::743::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv f79908bf-a757-4a71-9ab5-3a12ede5f65c/458ec5f0-63fa-49a6-a086-e06ecc27582a >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,968::blockSD::766::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 15 in VG f79908bf-a757-4a71-9ab5-3a12ede5f65c >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:06,968::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_15 --addtag IU_01628de4-d767-4b97-bdcf-c1e3459c1476 --addtag PU_77c78124-ee6c-46b1-9112-a738f448beca f79908bf-a757-4a71-9ab5-3a12ede5f65c/458ec5f0-63fa-49a6-a086-e06ecc27582a' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,141::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,142::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,142::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,143::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/458ec5f0-63fa-49a6-a086-e06ecc27582a' (cwd None) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,296::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,297::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,297::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,298::task::736::TaskManager.Task::(_save) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d.temp >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,327::blockVolume::622::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=458ec5f0-63fa-49a6-a086-e06ecc27582a sdUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c, metaId=('f79908bf-a757-4a71-9ab5-3a12ede5f65c', 15) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,343::task::736::TaskManager.Task::(_save) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d.temp >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,375::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.01628de4-d767-4b97-bdcf-c1e3459c1476' >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,375::resourceManager::634::ResourceManager::(releaseResource) Released resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.01628de4-d767-4b97-bdcf-c1e3459c1476' (0 active users) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,375::resourceManager::640::ResourceManager::(releaseResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.01628de4-d767-4b97-bdcf-c1e3459c1476' is free, finding out if anyone is waiting for it. >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,375::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.01628de4-d767-4b97-bdcf-c1e3459c1476', Clearing records. >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,376::task::579::TaskManager.Task::(_updateState) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::moving from state running -> state finished >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,376::task::736::TaskManager.Task::(_save) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/0ed5d6c5-4689-4d69-9909-4a386461e36d.temp >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,387::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,387::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,387::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,387::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,387::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,387::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,388::task::897::TaskManager.Task::(_runJobs) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::Task.run: exit - success: result {'uuid': '458ec5f0-63fa-49a6-a086-e06ecc27582a'} >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,388::task::974::TaskManager.Task::(_decref) Task=`0ed5d6c5-4689-4d69-9909-4a386461e36d`::ref 0 aborting False >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 17:57:07,388::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-51::DEBUG::2014-05-16 17:57:08,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:08,204::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345305 s, 29.7 MB/s\n'; <rc> = 0 >Thread-54991::DEBUG::2014-05-16 17:57:08,978::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54991::DEBUG::2014-05-16 17:57:08,978::task::579::TaskManager.Task::(_updateState) Task=`afbac4e2-59dc-49c3-96f5-b930f9d54d72`::moving from state init -> state preparing >Thread-54991::INFO::2014-05-16 17:57:08,979::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-54991::DEBUG::2014-05-16 17:57:08,979::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-54991::DEBUG::2014-05-16 17:57:08,979::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 0ed5d6c5-4689-4d69-9909-4a386461e36d >Thread-54991::DEBUG::2014-05-16 17:57:08,979::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '0ed5d6c5-4689-4d69-9909-4a386461e36d'} >Thread-54991::DEBUG::2014-05-16 17:57:08,979::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'0ed5d6c5-4689-4d69-9909-4a386461e36d': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '0ed5d6c5-4689-4d69-9909-4a386461e36d'}} >Thread-54991::INFO::2014-05-16 17:57:08,979::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'0ed5d6c5-4689-4d69-9909-4a386461e36d': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '0ed5d6c5-4689-4d69-9909-4a386461e36d'}}} >Thread-54991::DEBUG::2014-05-16 17:57:08,979::task::1168::TaskManager.Task::(prepare) Task=`afbac4e2-59dc-49c3-96f5-b930f9d54d72`::finished: {'allTasksStatus': {'0ed5d6c5-4689-4d69-9909-4a386461e36d': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '0ed5d6c5-4689-4d69-9909-4a386461e36d'}}} >Thread-54991::DEBUG::2014-05-16 17:57:08,980::task::579::TaskManager.Task::(_updateState) Task=`afbac4e2-59dc-49c3-96f5-b930f9d54d72`::moving from state preparing -> state finished >Thread-54991::DEBUG::2014-05-16 17:57:08,980::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54991::DEBUG::2014-05-16 17:57:08,980::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54991::DEBUG::2014-05-16 17:57:08,980::task::974::TaskManager.Task::(_decref) Task=`afbac4e2-59dc-49c3-96f5-b930f9d54d72`::ref 0 aborting False >Thread-54992::DEBUG::2014-05-16 17:57:09,104::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [49a001b9] >Thread-54992::DEBUG::2014-05-16 17:57:09,105::task::579::TaskManager.Task::(_updateState) Task=`414f3adb-985d-4c0e-b4b9-e7e51d8b19af`::moving from state init -> state preparing >Thread-54992::INFO::2014-05-16 17:57:09,105::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='01628de4-d767-4b97-bdcf-c1e3459c1476', volUUID='458ec5f0-63fa-49a6-a086-e06ecc27582a', options=None) >Thread-54992::DEBUG::2014-05-16 17:57:09,105::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`86124c39-8061-44c7-aa6b-2ba8056e8675`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3104' at 'getVolumeInfo' >Thread-54992::DEBUG::2014-05-16 17:57:09,105::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-54992::DEBUG::2014-05-16 17:57:09,106::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-54992::DEBUG::2014-05-16 17:57:09,106::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`86124c39-8061-44c7-aa6b-2ba8056e8675`::Granted request >Thread-54992::DEBUG::2014-05-16 17:57:09,106::task::811::TaskManager.Task::(resourceAcquired) Task=`414f3adb-985d-4c0e-b4b9-e7e51d8b19af`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-54992::DEBUG::2014-05-16 17:57:09,106::task::974::TaskManager.Task::(_decref) Task=`414f3adb-985d-4c0e-b4b9-e7e51d8b19af`::ref 1 aborting False >Thread-54992::DEBUG::2014-05-16 17:57:09,106::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-54992::DEBUG::2014-05-16 17:57:09,107::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-54992::DEBUG::2014-05-16 17:57:09,251::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-54992::DEBUG::2014-05-16 17:57:09,267::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-54992::DEBUG::2014-05-16 17:57:09,267::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-54992::INFO::2014-05-16 17:57:09,267::volume::883::Storage.Volume::(getInfo) Info request: sdUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c imgUUID=01628de4-d767-4b97-bdcf-c1e3459c1476 volUUID = 458ec5f0-63fa-49a6-a086-e06ecc27582a >Thread-54992::DEBUG::2014-05-16 17:57:09,286::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-54992::DEBUG::2014-05-16 17:57:09,294::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000473694 s, 1.1 MB/s\n'; <rc> = 0 >Thread-54992::DEBUG::2014-05-16 17:57:09,295::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000473694 s, 1.1 MB/s'], size: 512 >Thread-54992::DEBUG::2014-05-16 17:57:09,315::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-54992::DEBUG::2014-05-16 17:57:09,324::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000557547 s, 918 kB/s\n'; <rc> = 0 >Thread-54992::DEBUG::2014-05-16 17:57:09,324::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000557547 s, 918 kB/s'], size: 512 >Thread-54992::DEBUG::2014-05-16 17:57:09,324::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-54992::DEBUG::2014-05-16 17:57:09,325::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-54992::DEBUG::2014-05-16 17:57:09,469::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-54992::DEBUG::2014-05-16 17:57:09,487::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-54992::DEBUG::2014-05-16 17:57:09,487::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-54992::INFO::2014-05-16 17:57:09,487::volume::912::Storage.Volume::(getInfo) f79908bf-a757-4a71-9ab5-3a12ede5f65c/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a info is {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': '01628de4-d767-4b97-bdcf-c1e3459c1476', 'ctime': '1400263027', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400263027', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-54992::INFO::2014-05-16 17:57:09,487::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': '01628de4-d767-4b97-bdcf-c1e3459c1476', 'ctime': '1400263027', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400263027', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-54992::DEBUG::2014-05-16 17:57:09,488::task::1168::TaskManager.Task::(prepare) Task=`414f3adb-985d-4c0e-b4b9-e7e51d8b19af`::finished: {'info': {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': '01628de4-d767-4b97-bdcf-c1e3459c1476', 'ctime': '1400263027', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400263027', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-54992::DEBUG::2014-05-16 17:57:09,488::task::579::TaskManager.Task::(_updateState) Task=`414f3adb-985d-4c0e-b4b9-e7e51d8b19af`::moving from state preparing -> state finished >Thread-54992::DEBUG::2014-05-16 17:57:09,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-54992::DEBUG::2014-05-16 17:57:09,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54992::DEBUG::2014-05-16 17:57:09,489::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-54992::DEBUG::2014-05-16 17:57:09,489::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-54992::DEBUG::2014-05-16 17:57:09,489::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-54992::DEBUG::2014-05-16 17:57:09,489::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-54992::DEBUG::2014-05-16 17:57:09,489::task::974::TaskManager.Task::(_decref) Task=`414f3adb-985d-4c0e-b4b9-e7e51d8b19af`::ref 0 aborting False >Thread-54993::DEBUG::2014-05-16 17:57:09,574::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54993::DEBUG::2014-05-16 17:57:09,575::task::579::TaskManager.Task::(_updateState) Task=`d440471a-cef6-41d2-8fb7-7a06080b2bbc`::moving from state init -> state preparing >Thread-54993::INFO::2014-05-16 17:57:09,575::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='0ed5d6c5-4689-4d69-9909-4a386461e36d', spUUID=None, options=None) >Thread-54993::DEBUG::2014-05-16 17:57:09,575::taskManager::161::TaskManager::(clearTask) Entry. taskID: 0ed5d6c5-4689-4d69-9909-4a386461e36d >Thread-54993::DEBUG::2014-05-16 17:57:09,576::taskManager::166::TaskManager::(clearTask) Return. >Thread-54993::INFO::2014-05-16 17:57:09,576::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-54993::DEBUG::2014-05-16 17:57:09,576::task::1168::TaskManager.Task::(prepare) Task=`d440471a-cef6-41d2-8fb7-7a06080b2bbc`::finished: None >Thread-54993::DEBUG::2014-05-16 17:57:09,576::task::579::TaskManager.Task::(_updateState) Task=`d440471a-cef6-41d2-8fb7-7a06080b2bbc`::moving from state preparing -> state finished >Thread-54993::DEBUG::2014-05-16 17:57:09,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54993::DEBUG::2014-05-16 17:57:09,577::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54993::DEBUG::2014-05-16 17:57:09,577::task::974::TaskManager.Task::(_decref) Task=`d440471a-cef6-41d2-8fb7-7a06080b2bbc`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:57:10,216::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:10,288::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357743 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:57:12,299::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:12,366::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316393 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:57:13,819::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:57:13,830::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112144 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:57:14,378::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:14,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035639 s, 28.7 MB/s\n'; <rc> = 0 >Thread-54995::DEBUG::2014-05-16 17:57:14,726::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 7742621.000000 / 8.010140 / 262500000.000000 = 0.368229 >Thread-54995::DEBUG::2014-05-16 17:57:14,727::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.11793936633372826, 'statsAge': 1.9381749629974365, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.36822949889317308, 'rxDropped': 0} >Thread-54995::DEBUG::2014-05-16 17:57:14,727::task::579::TaskManager.Task::(_updateState) Task=`78665ab4-8441-4917-9b47-6021a83a8349`::moving from state init -> state preparing >Thread-54995::INFO::2014-05-16 17:57:14,727::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-54995::INFO::2014-05-16 17:57:14,728::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112144', 'lastCheck': '0.9', 'valid': True}} >Thread-54995::DEBUG::2014-05-16 17:57:14,728::task::1168::TaskManager.Task::(prepare) Task=`78665ab4-8441-4917-9b47-6021a83a8349`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112144', 'lastCheck': '0.9', 'valid': True}} >Thread-54995::DEBUG::2014-05-16 17:57:14,728::task::579::TaskManager.Task::(_updateState) Task=`78665ab4-8441-4917-9b47-6021a83a8349`::moving from state preparing -> state finished >Thread-54995::DEBUG::2014-05-16 17:57:14,728::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54995::DEBUG::2014-05-16 17:57:14,728::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54995::DEBUG::2014-05-16 17:57:14,728::task::974::TaskManager.Task::(_decref) Task=`78665ab4-8441-4917-9b47-6021a83a8349`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:57:16,461::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-54997::DEBUG::2014-05-16 17:57:16,471::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54997::DEBUG::2014-05-16 17:57:16,471::task::579::TaskManager.Task::(_updateState) Task=`0e3c5f84-ddcb-4bd2-84bd-b7f6f1cbf831`::moving from state init -> state preparing >Thread-54997::INFO::2014-05-16 17:57:16,471::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54997::INFO::2014-05-16 17:57:16,472::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54997::DEBUG::2014-05-16 17:57:16,472::task::1168::TaskManager.Task::(prepare) Task=`0e3c5f84-ddcb-4bd2-84bd-b7f6f1cbf831`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-54997::DEBUG::2014-05-16 17:57:16,472::task::579::TaskManager.Task::(_updateState) Task=`0e3c5f84-ddcb-4bd2-84bd-b7f6f1cbf831`::moving from state preparing -> state finished >Thread-54997::DEBUG::2014-05-16 17:57:16,472::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54997::DEBUG::2014-05-16 17:57:16,472::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54997::DEBUG::2014-05-16 17:57:16,473::task::974::TaskManager.Task::(_decref) Task=`0e3c5f84-ddcb-4bd2-84bd-b7f6f1cbf831`::ref 0 aborting False >Thread-54998::DEBUG::2014-05-16 17:57:16,484::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-54998::DEBUG::2014-05-16 17:57:16,486::task::579::TaskManager.Task::(_updateState) Task=`3baf0c81-9104-48ce-b082-95fe714a4244`::moving from state init -> state preparing >Thread-54998::INFO::2014-05-16 17:57:16,488::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-54998::DEBUG::2014-05-16 17:57:16,491::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`15ab9ae3-9ecf-4e6d-8e2e-6646f8e40d2e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-54998::DEBUG::2014-05-16 17:57:16,492::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-54998::DEBUG::2014-05-16 17:57:16,494::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-54998::DEBUG::2014-05-16 17:57:16,495::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`15ab9ae3-9ecf-4e6d-8e2e-6646f8e40d2e`::Granted request >Thread-54998::DEBUG::2014-05-16 17:57:16,498::task::811::TaskManager.Task::(resourceAcquired) Task=`3baf0c81-9104-48ce-b082-95fe714a4244`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-54998::DEBUG::2014-05-16 17:57:16,499::task::974::TaskManager.Task::(_decref) Task=`3baf0c81-9104-48ce-b082-95fe714a4244`::ref 1 aborting False >Thread-54998::INFO::2014-05-16 17:57:16,505::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54998::DEBUG::2014-05-16 17:57:16,506::task::1168::TaskManager.Task::(prepare) Task=`3baf0c81-9104-48ce-b082-95fe714a4244`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-54998::DEBUG::2014-05-16 17:57:16,507::task::579::TaskManager.Task::(_updateState) Task=`3baf0c81-9104-48ce-b082-95fe714a4244`::moving from state preparing -> state finished >Thread-54998::DEBUG::2014-05-16 17:57:16,508::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-54998::DEBUG::2014-05-16 17:57:16,510::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54998::DEBUG::2014-05-16 17:57:16,512::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-54998::DEBUG::2014-05-16 17:57:16,513::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-54998::DEBUG::2014-05-16 17:57:16,515::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-54998::DEBUG::2014-05-16 17:57:16,516::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-54998::DEBUG::2014-05-16 17:57:16,518::task::974::TaskManager.Task::(_decref) Task=`3baf0c81-9104-48ce-b082-95fe714a4244`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:57:16,573::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0749707 s, 13.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:57:18,585::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:18,653::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317269 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:57:20,665::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:20,736::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034251 s, 29.9 MB/s\n'; <rc> = 0 >Thread-55001::DEBUG::2014-05-16 17:57:22,443::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [455c3afc] >Thread-55001::DEBUG::2014-05-16 17:57:22,444::task::579::TaskManager.Task::(_updateState) Task=`a2661d54-7f4f-4b94-bde3-1e2bace11fb8`::moving from state init -> state preparing >Thread-55001::INFO::2014-05-16 17:57:22,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55001::DEBUG::2014-05-16 17:57:22,444::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7e51c217-e527-482b-a1b1-072add92e9e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55001::DEBUG::2014-05-16 17:57:22,444::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55001::DEBUG::2014-05-16 17:57:22,445::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55001::DEBUG::2014-05-16 17:57:22,445::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7e51c217-e527-482b-a1b1-072add92e9e3`::Granted request >Thread-55001::DEBUG::2014-05-16 17:57:22,445::task::811::TaskManager.Task::(resourceAcquired) Task=`a2661d54-7f4f-4b94-bde3-1e2bace11fb8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55001::DEBUG::2014-05-16 17:57:22,445::task::974::TaskManager.Task::(_decref) Task=`a2661d54-7f4f-4b94-bde3-1e2bace11fb8`::ref 1 aborting False >Thread-55001::INFO::2014-05-16 17:57:22,446::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55001::DEBUG::2014-05-16 17:57:22,446::task::1168::TaskManager.Task::(prepare) Task=`a2661d54-7f4f-4b94-bde3-1e2bace11fb8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55001::DEBUG::2014-05-16 17:57:22,446::task::579::TaskManager.Task::(_updateState) Task=`a2661d54-7f4f-4b94-bde3-1e2bace11fb8`::moving from state preparing -> state finished >Thread-55001::DEBUG::2014-05-16 17:57:22,446::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55001::DEBUG::2014-05-16 17:57:22,446::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55001::DEBUG::2014-05-16 17:57:22,447::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55001::DEBUG::2014-05-16 17:57:22,447::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55001::DEBUG::2014-05-16 17:57:22,447::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55001::DEBUG::2014-05-16 17:57:22,447::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55001::DEBUG::2014-05-16 17:57:22,447::task::974::TaskManager.Task::(_decref) Task=`a2661d54-7f4f-4b94-bde3-1e2bace11fb8`::ref 0 aborting False >Thread-55002::DEBUG::2014-05-16 17:57:22,549::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmCreate with ({'custom': {'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=429bcb58-e00e-49b9-ab34-b7ab6b09e7e2, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=38fa4ef6-d053-454a-8380-d09138293503, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2device_7bdb33d0-b63d-43c6-b962-c725d4c4d404device_af15269e-19fe-4c91-bac8-2a9b93a75035': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=af15269e-19fe-4c91-bac8-2a9b93a75035, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2device_7bdb33d0-b63d-43c6-b962-c725d4c4d404device_af15269e-19fe-4c91-bac8-2a9b93a75035device_d0aa358d-7f01-4dcc-bccf-bdfc62b1290c': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=d0aa358d-7f01-4dcc-bccf-bdfc62b1290c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2device_7bdb33d0-b63d-43c6-b962-c725d4c4d404': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=7bdb33d0-b63d-43c6-b962-c725d4c4d404, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}'}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'cpuType': 'Nehalem', 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'devices': [{'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bW9uZXk8L0NvbXB1dGVyTmFtZT4NCiAg\nICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9SZWdpc3RlcmVk\nT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2VyPC9SZWdpc3Rl\ncmVkT3duZXI+DQogICAgICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9\nIk1pY3Jvc29mdC1XaW5kb3dzLVVuYXR0ZW5kZWRKb2luIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9\nIng4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFs\nIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3Nv\nZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3Jn\nLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxJZGVudGlmaWNhdGlvbj4N\nCiAgICAgICAgICAgICAgICA8Q3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgICAgIDxEb21h\naW4+PC9Eb21haW4+DQogICAgICAgICAgICAgICAgICAgIDxQYXNzd29yZD48L1Bhc3N3b3JkPg0K\nICAgICAgICAgICAgICAgICAgICA8VXNlcm5hbWU+PC9Vc2VybmFtZT4NCiAgICAgICAgICAgICAg\nICA8L0NyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgIDxEZWJ1Z0pvaW4+dHJ1ZTwvRGVidWdK\nb2luPg0KICAgICAgICAgICAgICAgIDxKb2luRG9tYWluPjwvSm9pbkRvbWFpbj4NCiAgICAgICAg\nICAgIDwvSWRlbnRpZmljYXRpb24+DQogICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGlu\nZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9Im9vYmVTeXN0ZW0iPg0KICAgICAgICA8Y29tcG9uZW50\nIG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLUlFLUNsaWVudE5ldHdvcmtQcm90b2NvbEltcGxlbWVu\ndGF0aW9uIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYz\nODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1s\nbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRl\nIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4N\nCiAgICAgICAgICAgIDxIS0xNUHJveHlFbmFibGU+ZmFsc2U8L0hLTE1Qcm94eUVuYWJsZT4NCiAg\nICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdp\nbmRvd3MtSW50ZXJuYXRpb25hbC1Db3JlIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5\nPC9JbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxv\nY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAg\nICAgICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9u\nZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNoZWxsLVNl\ndHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2\nYWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6\nd2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4\nbWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAg\nICAgICAgICAgIDxEaXNwbGF5Pg0KICAgICAgICAgICAgICAgIDxDb2xvckRlcHRoPjMyPC9Db2xv\nckRlcHRoPg0KICAgICAgICAgICAgICAgIDxIb3Jpem9udGFsUmVzb2x1dGlvbj4xMDI0PC9Ib3Jp\nem9udGFsUmVzb2x1dGlvbj4NCiAgICAgICAgICAgICAgICA8UmVmcmVzaFJhdGU+NzU8L1JlZnJl\nc2hSYXRlPg0KICAgICAgICAgICAgICAgIDxWZXJ0aWNhbFJlc29sdXRpb24+NzY4PC9WZXJ0aWNh\nbFJlc29sdXRpb24+DQogICAgICAgICAgICA8L0Rpc3BsYXk+DQogICAgICAgICAgICA8T09CRT4N\nCiAgICAgICAgICAgICAgICA8SGlkZUVVTEFQYWdlPnRydWU8L0hpZGVFVUxBUGFnZT4NCiAgICAg\nICAgICAgICAgICA8U2tpcFVzZXJPT0JFPnRydWU8L1NraXBVc2VyT09CRT4NCiAgICAgICAgICAg\nIDwvT09CRT4NCiAgICAgICAgICAgIDxVc2VyQWNjb3VudHM+DQogICAgICAgICAgICAgICAgPEFk\nbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgICAgICAgICAgPFZhbHVlPjwvVmFsdWU+\nDQogICAgICAgICAgICAgICAgICAgIDxQbGFpblRleHQ+dHJ1ZTwvUGxhaW5UZXh0Pg0KICAgICAg\nICAgICAgICAgIDwvQWRtaW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgPC9Vc2VyQWNj\nb3VudHM+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwv\nUmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNl\ncjwvUmVnaXN0ZXJlZE93bmVyPg0KICAgICAgICAgICAgPFRpbWVab25lPjg1PC9UaW1lWm9uZT4N\nCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5ncz4NCiAgICA8c2V0dGluZ3MgcGFz\ncz0id2luZG93c1BFIj4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93\ncy1JbnRlcm5hdGlvbmFsLUNvcmUtV2luUEUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBw\ndWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNp\nb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20v\nV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9Y\nTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPFNldHVwVUlMYW5ndWFnZT4NCiAgICAg\nICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDwv\nU2V0dXBVSUxhbmd1YWdlPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+\nDQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2NhbGU+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2V0dXAiIHBy\nb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUz\nNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0\ndHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhz\naT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAg\nICAgPFVzZXJEYXRhPg0KICAgICAgICAgICAgICAgIDxQcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgICAgICA8S2V5PjwvS2V5Pg0KICAgICAgICAgICAgICAgICAgICA8V2lsbFNob3dVST5OZXZl\ncjwvV2lsbFNob3dVST4NCiAgICAgICAgICAgICAgICA8L1Byb2R1Y3RLZXk+DQogICAgICAgICAg\nICAgICAgPEFjY2VwdEV1bGE+dHJ1ZTwvQWNjZXB0RXVsYT4NCiAgICAgICAgICAgICAgICA8T3Jn\nYW5pemF0aW9uPmF3YXlmYXIub3JnPC9Pcmdhbml6YXRpb24+DQogICAgICAgICAgICAgICAgPEZ1\nbGxOYW1lPlVzZXI8L0Z1bGxOYW1lPg0KICAgICAgICAgICAgPC9Vc2VyRGF0YT4NCiAgICAgICAg\nPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5ncz4NCiAgICA8Y3BpOm9mZmxpbmVJbWFnZSBjcGk6\nc291cmNlPSJjYXRhbG9nOi8vY2F0YWxvZ3Mvd2luZG93czIwMDgteDg2L3NvdXJjZXMvaW5zdGFs\nbF93aW5kb3dzIGxvbmdob3JuIHNlcnZlcmVudGVycHJpc2UuY2xnIiB4bWxuczpjcGk9InVybjpz\nY2hlbWFzLW1pY3Jvc29mdC1jb206Y3BpIiAvPg0KPC91bmF0dGVuZD4NCg==\n'}}}, 'readonly': 'true', 'deviceId': 'f7b0a69b-3970-4e2f-a242-9953ccf46da1', 'path': '', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '72fb2570-439a-4d86-99e3-87c41871b775'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': 'c4ad1abc-8c00-4bd7-b655-a9f85f8a6487', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'volumeID': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476', 'specParams': {}, 'readonly': 'false', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'optional': 'false', 'deviceId': '01628de4-d767-4b97-bdcf-c1e3459c1476', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '85f9c5d6-6017-4a42-86eb-85323987f41f'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '46ba3697-488c-473d-a69c-35d14f95ec71'}, {'specParams': {}, 'deviceId': 'c45d3a63-aa43-47ed-9542-a31bef486eb1', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '2', 'vmType': 'kvm', 'smartcardEnable': 'true', 'timeOffset': '3600', 'memSize': 2048, 'spiceSslCipherSuite': 'DEFAULT', 'smpCoresPerSocket': '1', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'memGuaranteedSize': 1024, 'vmName': 'money', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} flowID [455c3afc] >Thread-55002::INFO::2014-05-16 17:57:22,560::API::648::vds::(_getNetworkIp) network None: using 0 >Thread-55002::INFO::2014-05-16 17:57:22,560::clientIF::394::vds::(createVm) vmContainerLock acquired by vm d5713fb4-0915-4447-9053-b09812aadda9 >Thread-55003::DEBUG::2014-05-16 17:57:22,563::vm::2156::vm.Vm::(_startUnderlyingVm) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Start >Thread-55002::DEBUG::2014-05-16 17:57:22,563::clientIF::407::vds::(createVm) Total desktops after creation of d5713fb4-0915-4447-9053-b09812aadda9 is 1 >Thread-55002::DEBUG::2014-05-16 17:57:22,563::BindingXMLRPC::982::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=429bcb58-e00e-49b9-ab34-b7ab6b09e7e2, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=38fa4ef6-d053-454a-8380-d09138293503, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2device_7bdb33d0-b63d-43c6-b962-c725d4c4d404device_af15269e-19fe-4c91-bac8-2a9b93a75035': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=af15269e-19fe-4c91-bac8-2a9b93a75035, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2device_7bdb33d0-b63d-43c6-b962-c725d4c4d404device_af15269e-19fe-4c91-bac8-2a9b93a75035device_d0aa358d-7f01-4dcc-bccf-bdfc62b1290c': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=d0aa358d-7f01-4dcc-bccf-bdfc62b1290c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2device_7bdb33d0-b63d-43c6-b962-c725d4c4d404': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=7bdb33d0-b63d-43c6-b962-c725d4c4d404, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bW9uZXk8L0NvbXB1dGVyTmFtZT4NCiAg\nICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9SZWdpc3RlcmVk\nT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2VyPC9SZWdpc3Rl\ncmVkT3duZXI+DQogICAgICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9\nIk1pY3Jvc29mdC1XaW5kb3dzLVVuYXR0ZW5kZWRKb2luIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9\nIng4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFs\nIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3Nv\nZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3Jn\nLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxJZGVudGlmaWNhdGlvbj4N\nCiAgICAgICAgICAgICAgICA8Q3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgICAgIDxEb21h\naW4+PC9Eb21haW4+DQogICAgICAgICAgICAgICAgICAgIDxQYXNzd29yZD48L1Bhc3N3b3JkPg0K\nICAgICAgICAgICAgICAgICAgICA8VXNlcm5hbWU+PC9Vc2VybmFtZT4NCiAgICAgICAgICAgICAg\nICA8L0NyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgIDxEZWJ1Z0pvaW4+dHJ1ZTwvRGVidWdK\nb2luPg0KICAgICAgICAgICAgICAgIDxKb2luRG9tYWluPjwvSm9pbkRvbWFpbj4NCiAgICAgICAg\nICAgIDwvSWRlbnRpZmljYXRpb24+DQogICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGlu\nZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9Im9vYmVTeXN0ZW0iPg0KICAgICAgICA8Y29tcG9uZW50\nIG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLUlFLUNsaWVudE5ldHdvcmtQcm90b2NvbEltcGxlbWVu\ndGF0aW9uIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYz\nODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1s\nbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRl\nIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4N\nCiAgICAgICAgICAgIDxIS0xNUHJveHlFbmFibGU+ZmFsc2U8L0hLTE1Qcm94eUVuYWJsZT4NCiAg\nICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdp\nbmRvd3MtSW50ZXJuYXRpb25hbC1Db3JlIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5\nPC9JbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxv\nY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAg\nICAgICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9u\nZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNoZWxsLVNl\ndHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2\nYWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6\nd2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4\nbWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAg\nICAgICAgICAgIDxEaXNwbGF5Pg0KICAgICAgICAgICAgICAgIDxDb2xvckRlcHRoPjMyPC9Db2xv\nckRlcHRoPg0KICAgICAgICAgICAgICAgIDxIb3Jpem9udGFsUmVzb2x1dGlvbj4xMDI0PC9Ib3Jp\nem9udGFsUmVzb2x1dGlvbj4NCiAgICAgICAgICAgICAgICA8UmVmcmVzaFJhdGU+NzU8L1JlZnJl\nc2hSYXRlPg0KICAgICAgICAgICAgICAgIDxWZXJ0aWNhbFJlc29sdXRpb24+NzY4PC9WZXJ0aWNh\nbFJlc29sdXRpb24+DQogICAgICAgICAgICA8L0Rpc3BsYXk+DQogICAgICAgICAgICA8T09CRT4N\nCiAgICAgICAgICAgICAgICA8SGlkZUVVTEFQYWdlPnRydWU8L0hpZGVFVUxBUGFnZT4NCiAgICAg\nICAgICAgICAgICA8U2tpcFVzZXJPT0JFPnRydWU8L1NraXBVc2VyT09CRT4NCiAgICAgICAgICAg\nIDwvT09CRT4NCiAgICAgICAgICAgIDxVc2VyQWNjb3VudHM+DQogICAgICAgICAgICAgICAgPEFk\nbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgICAgICAgICAgPFZhbHVlPjwvVmFsdWU+\nDQogICAgICAgICAgICAgICAgICAgIDxQbGFpblRleHQ+dHJ1ZTwvUGxhaW5UZXh0Pg0KICAgICAg\nICAgICAgICAgIDwvQWRtaW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgPC9Vc2VyQWNj\nb3VudHM+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwv\nUmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNl\ncjwvUmVnaXN0ZXJlZE93bmVyPg0KICAgICAgICAgICAgPFRpbWVab25lPjg1PC9UaW1lWm9uZT4N\nCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5ncz4NCiAgICA8c2V0dGluZ3MgcGFz\ncz0id2luZG93c1BFIj4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93\ncy1JbnRlcm5hdGlvbmFsLUNvcmUtV2luUEUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBw\ndWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNp\nb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20v\nV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9Y\nTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPFNldHVwVUlMYW5ndWFnZT4NCiAgICAg\nICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDwv\nU2V0dXBVSUxhbmd1YWdlPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+\nDQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2NhbGU+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2V0dXAiIHBy\nb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUz\nNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0\ndHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhz\naT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAg\nICAgPFVzZXJEYXRhPg0KICAgICAgICAgICAgICAgIDxQcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgICAgICA8S2V5PjwvS2V5Pg0KICAgICAgICAgICAgICAgICAgICA8V2lsbFNob3dVST5OZXZl\ncjwvV2lsbFNob3dVST4NCiAgICAgICAgICAgICAgICA8L1Byb2R1Y3RLZXk+DQogICAgICAgICAg\nICAgICAgPEFjY2VwdEV1bGE+dHJ1ZTwvQWNjZXB0RXVsYT4NCiAgICAgICAgICAgICAgICA8T3Jn\nYW5pemF0aW9uPmF3YXlmYXIub3JnPC9Pcmdhbml6YXRpb24+DQogICAgICAgICAgICAgICAgPEZ1\nbGxOYW1lPlVzZXI8L0Z1bGxOYW1lPg0KICAgICAgICAgICAgPC9Vc2VyRGF0YT4NCiAgICAgICAg\nPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5ncz4NCiAgICA8Y3BpOm9mZmxpbmVJbWFnZSBjcGk6\nc291cmNlPSJjYXRhbG9nOi8vY2F0YWxvZ3Mvd2luZG93czIwMDgteDg2L3NvdXJjZXMvaW5zdGFs\nbF93aW5kb3dzIGxvbmdob3JuIHNlcnZlcmVudGVycHJpc2UuY2xnIiB4bWxuczpjcGk9InVybjpz\nY2hlbWFzLW1pY3Jvc29mdC1jb206Y3BpIiAvPg0KPC91bmF0dGVuZD4NCg==\n'}}}, 'readonly': 'true', 'deviceId': 'f7b0a69b-3970-4e2f-a242-9953ccf46da1', 'path': '', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '72fb2570-439a-4d86-99e3-87c41871b775'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': 'c4ad1abc-8c00-4bd7-b655-a9f85f8a6487', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'volumeID': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476', 'specParams': {}, 'readonly': 'false', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'optional': 'false', 'deviceId': '01628de4-d767-4b97-bdcf-c1e3459c1476', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '85f9c5d6-6017-4a42-86eb-85323987f41f'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '46ba3697-488c-473d-a69c-35d14f95ec71'}, {'specParams': {}, 'deviceId': 'c45d3a63-aa43-47ed-9542-a31bef486eb1', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'money', 'display': 'qxl', 'nice': '0'}} >Thread-55003::DEBUG::2014-05-16 17:57:22,564::vm::2160::vm.Vm::(_startUnderlyingVm) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::_ongoingCreations acquired >Thread-55003::INFO::2014-05-16 17:57:22,565::vm::3011::vm.Vm::(_run) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::VM wrapper has started >Thread-55003::DEBUG::2014-05-16 17:57:22,565::task::579::TaskManager.Task::(_updateState) Task=`622cf482-eede-4234-b553-03a3e9442703`::moving from state init -> state preparing >Thread-55003::INFO::2014-05-16 17:57:22,565::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='01628de4-d767-4b97-bdcf-c1e3459c1476', volUUID='458ec5f0-63fa-49a6-a086-e06ecc27582a', options=None) >Thread-55003::INFO::2014-05-16 17:57:22,565::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55003::DEBUG::2014-05-16 17:57:22,565::task::1168::TaskManager.Task::(prepare) Task=`622cf482-eede-4234-b553-03a3e9442703`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55003::DEBUG::2014-05-16 17:57:22,566::task::579::TaskManager.Task::(_updateState) Task=`622cf482-eede-4234-b553-03a3e9442703`::moving from state preparing -> state finished >Thread-55003::DEBUG::2014-05-16 17:57:22,566::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55003::DEBUG::2014-05-16 17:57:22,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55003::DEBUG::2014-05-16 17:57:22,566::task::974::TaskManager.Task::(_decref) Task=`622cf482-eede-4234-b553-03a3e9442703`::ref 0 aborting False >Thread-55003::INFO::2014-05-16 17:57:22,640::clientIF::353::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/d5713fb4-0915-4447-9053-b09812aadda9.170b5fa88f908f48699ebfcd06135a3a.img >Thread-55003::INFO::2014-05-16 17:57:22,641::clientIF::353::vds::(prepareVolumePath) prepared volume path: >Thread-55003::DEBUG::2014-05-16 17:57:22,641::task::579::TaskManager.Task::(_updateState) Task=`bb06d9bd-dc18-468c-b3b2-a3fa7d6c5390`::moving from state init -> state preparing >Thread-55003::INFO::2014-05-16 17:57:22,641::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='01628de4-d767-4b97-bdcf-c1e3459c1476', leafUUID='458ec5f0-63fa-49a6-a086-e06ecc27582a') >Thread-55003::DEBUG::2014-05-16 17:57:22,641::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`8ef64596-c6a4-4272-ac7d-a4a2170d3e69`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage' >Thread-55003::DEBUG::2014-05-16 17:57:22,642::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55003::DEBUG::2014-05-16 17:57:22,642::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55003::DEBUG::2014-05-16 17:57:22,642::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`8ef64596-c6a4-4272-ac7d-a4a2170d3e69`::Granted request >Thread-55003::DEBUG::2014-05-16 17:57:22,642::task::811::TaskManager.Task::(resourceAcquired) Task=`bb06d9bd-dc18-468c-b3b2-a3fa7d6c5390`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55003::DEBUG::2014-05-16 17:57:22,642::task::974::TaskManager.Task::(_decref) Task=`bb06d9bd-dc18-468c-b3b2-a3fa7d6c5390`::ref 1 aborting False >Thread-55003::DEBUG::2014-05-16 17:57:22,643::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55003::DEBUG::2014-05-16 17:57:22,643::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:22,749::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55003::DEBUG::2014-05-16 17:57:22,820::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55003::DEBUG::2014-05-16 17:57:22,856::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55003::DEBUG::2014-05-16 17:57:22,857::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55003::DEBUG::2014-05-16 17:57:22,860::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca f79908bf-a757-4a71-9ab5-3a12ede5f65c/458ec5f0-63fa-49a6-a086-e06ecc27582a' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:22,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328968 s, 31.1 MB/s\n'; <rc> = 0 >Thread-55003::DEBUG::2014-05-16 17:57:23,072::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55003::DEBUG::2014-05-16 17:57:23,072::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55003::DEBUG::2014-05-16 17:57:23,073::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55003::DEBUG::2014-05-16 17:57:23,074::blockSD::1039::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476 >Thread-55003::DEBUG::2014-05-16 17:57:23,074::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55003::DEBUG::2014-05-16 17:57:23,075::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55003::DEBUG::2014-05-16 17:57:23,220::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55003::DEBUG::2014-05-16 17:57:23,235::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55003::DEBUG::2014-05-16 17:57:23,235::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55003::INFO::2014-05-16 17:57:23,236::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a', 'volumeID': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a', 'imgVolumesInfo': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a', 'volumeID': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}]} >Thread-55003::DEBUG::2014-05-16 17:57:23,236::task::1168::TaskManager.Task::(prepare) Task=`bb06d9bd-dc18-468c-b3b2-a3fa7d6c5390`::finished: {'info': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a', 'volumeID': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a', 'imgVolumesInfo': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a', 'volumeID': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}]} >Thread-55003::DEBUG::2014-05-16 17:57:23,237::task::579::TaskManager.Task::(_updateState) Task=`bb06d9bd-dc18-468c-b3b2-a3fa7d6c5390`::moving from state preparing -> state finished >Thread-55003::DEBUG::2014-05-16 17:57:23,237::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55003::DEBUG::2014-05-16 17:57:23,237::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55003::DEBUG::2014-05-16 17:57:23,237::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55003::DEBUG::2014-05-16 17:57:23,237::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55003::DEBUG::2014-05-16 17:57:23,238::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55003::DEBUG::2014-05-16 17:57:23,238::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55003::DEBUG::2014-05-16 17:57:23,238::task::974::TaskManager.Task::(_decref) Task=`bb06d9bd-dc18-468c-b3b2-a3fa7d6c5390`::ref 0 aborting False >Thread-55003::INFO::2014-05-16 17:57:23,238::clientIF::353::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a >Thread-55003::DEBUG::2014-05-16 17:57:23,252::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-55003::DEBUG::2014-05-16 17:57:23,323::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55003::INFO::2014-05-16 17:57:23,323::hooks::100::root::(_runHooksDir) >Thread-55003::DEBUG::2014-05-16 17:57:23,323::vm::3073::vm.Vm::(_run) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>money</name> > <uuid>d5713fb4-0915-4447-9053-b09812aadda9</uuid> > <memory>2097152</memory> > <currentMemory>2097152</currentMemory> > <vcpu>2</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/d5713fb4-0915-4447-9053-b09812aadda9.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/d5713fb4-0915-4447-9053-b09812aadda9.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <smartcard mode="passthrough" type="spicevmc"/> > <controller model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" type="qxl" vram="32768"/> > </video> > <disk device="floppy" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/d5713fb4-0915-4447-9053-b09812aadda9.170b5fa88f908f48699ebfcd06135a3a.img" startupPolicy="optional"/> > <target bus="fdc" dev="fda"/> > <readonly/> > <serial/> > <readonly/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a"/> > <target bus="virtio" dev="vda"/> > <serial>01628de4-d767-4b97-bdcf-c1e3459c1476</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > <memballoon model="virtio"/> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140407.0.el6ev</entry> > <entry name="serial">44454C4C-3500-1054-8036-C6C04F5A5131</entry> > <entry name="uuid">d5713fb4-0915-4447-9053-b09812aadda9</entry> > </system> > </sysinfo> > <clock adjustment="3600" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Nehalem</model> > <topology cores="1" sockets="2" threads="1"/> > </cpu> ></domain> > >libvirtEventLoop::DEBUG::2014-05-16 17:57:23,801::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::event Started detail 0 opaque None >Thread-55003::DEBUG::2014-05-16 17:57:23,890::sampling::285::vm.Vm::(start) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Start statistics collection >Thread-55006::DEBUG::2014-05-16 17:57:23,891::sampling::314::vm.Vm::(run) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Stats thread started >Thread-55006::DEBUG::2014-05-16 17:57:23,898::task::579::TaskManager.Task::(_updateState) Task=`723b51a9-0b29-4b19-ad4d-2fb6623c5a68`::moving from state init -> state preparing >Thread-55003::DEBUG::2014-05-16 17:57:23,898::vmChannels::194::vds::(register) Add fileno 38 to listener's channels. >Thread-55006::INFO::2014-05-16 17:57:23,899::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='01628de4-d767-4b97-bdcf-c1e3459c1476', volUUID='458ec5f0-63fa-49a6-a086-e06ecc27582a', options=None) >Thread-55006::INFO::2014-05-16 17:57:23,901::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55006::DEBUG::2014-05-16 17:57:23,901::task::1168::TaskManager.Task::(prepare) Task=`723b51a9-0b29-4b19-ad4d-2fb6623c5a68`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55006::DEBUG::2014-05-16 17:57:23,902::task::579::TaskManager.Task::(_updateState) Task=`723b51a9-0b29-4b19-ad4d-2fb6623c5a68`::moving from state preparing -> state finished >Thread-55006::DEBUG::2014-05-16 17:57:23,902::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55006::DEBUG::2014-05-16 17:57:23,902::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55006::DEBUG::2014-05-16 17:57:23,903::task::974::TaskManager.Task::(_decref) Task=`723b51a9-0b29-4b19-ad4d-2fb6623c5a68`::ref 0 aborting False >Thread-55003::WARNING::2014-05-16 17:57:23,901::vm::3578::vm.Vm::(_readPauseCode) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::_readPauseCode unsupported by libvirt vm >Thread-30::DEBUG::2014-05-16 17:57:23,909::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-55003::DEBUG::2014-05-16 17:57:23,919::vm::2177::vm.Vm::(_startUnderlyingVm) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::_ongoingCreations released >Thread-30::DEBUG::2014-05-16 17:57:23,938::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000533158 s, 7.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-05-16 17:57:24,509::vmChannels::102::vds::(_do_add_channels) fileno 38 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-05-16 17:57:24,510::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 38. >VM Channels Listener::DEBUG::2014-05-16 17:57:24,510::guestIF::147::vm.Vm::(_connect) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Attempting connection to /var/lib/libvirt/qemu/channels/d5713fb4-0915-4447-9053-b09812aadda9.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-05-16 17:57:24,510::guestIF::150::vm.Vm::(_connect) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Connected to /var/lib/libvirt/qemu/channels/d5713fb4-0915-4447-9053-b09812aadda9.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-05-16 17:57:24,511::vmChannels::144::vds::(_handle_unconnected) Connecting to fileno 38 succeeded. >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,624::vm::600::vm.Vm::(_getCpuStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,624::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,624::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,624::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,625::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,625::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,625::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,626::vm::600::vm.Vm::(_getCpuStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,626::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,626::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,627::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,627::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,627::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:24,627::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Dummy-51::DEBUG::2014-05-16 17:57:24,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:24,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038214 s, 26.8 MB/s\n'; <rc> = 0 >Thread-55007::DEBUG::2014-05-16 17:57:26,558::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55007::DEBUG::2014-05-16 17:57:26,558::task::579::TaskManager.Task::(_updateState) Task=`b3d46d46-bd5b-40b3-a3e7-3750e2291bcc`::moving from state init -> state preparing >Thread-55007::INFO::2014-05-16 17:57:26,559::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55007::INFO::2014-05-16 17:57:26,559::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55007::DEBUG::2014-05-16 17:57:26,559::task::1168::TaskManager.Task::(prepare) Task=`b3d46d46-bd5b-40b3-a3e7-3750e2291bcc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55007::DEBUG::2014-05-16 17:57:26,559::task::579::TaskManager.Task::(_updateState) Task=`b3d46d46-bd5b-40b3-a3e7-3750e2291bcc`::moving from state preparing -> state finished >Thread-55007::DEBUG::2014-05-16 17:57:26,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55007::DEBUG::2014-05-16 17:57:26,560::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55007::DEBUG::2014-05-16 17:57:26,560::task::974::TaskManager.Task::(_decref) Task=`b3d46d46-bd5b-40b3-a3e7-3750e2291bcc`::ref 0 aborting False >Thread-55008::DEBUG::2014-05-16 17:57:26,569::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55008::DEBUG::2014-05-16 17:57:26,570::task::579::TaskManager.Task::(_updateState) Task=`e4524add-014f-47bb-80fe-1e51bdc8d73d`::moving from state init -> state preparing >Thread-55008::INFO::2014-05-16 17:57:26,570::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55008::DEBUG::2014-05-16 17:57:26,570::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8734a7c4-2b73-4ee3-812f-7bb13306b02b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55008::DEBUG::2014-05-16 17:57:26,570::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55008::DEBUG::2014-05-16 17:57:26,571::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55008::DEBUG::2014-05-16 17:57:26,571::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8734a7c4-2b73-4ee3-812f-7bb13306b02b`::Granted request >Thread-55008::DEBUG::2014-05-16 17:57:26,571::task::811::TaskManager.Task::(resourceAcquired) Task=`e4524add-014f-47bb-80fe-1e51bdc8d73d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55008::DEBUG::2014-05-16 17:57:26,571::task::974::TaskManager.Task::(_decref) Task=`e4524add-014f-47bb-80fe-1e51bdc8d73d`::ref 1 aborting False >Thread-55008::INFO::2014-05-16 17:57:26,572::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55008::DEBUG::2014-05-16 17:57:26,572::task::1168::TaskManager.Task::(prepare) Task=`e4524add-014f-47bb-80fe-1e51bdc8d73d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55008::DEBUG::2014-05-16 17:57:26,572::task::579::TaskManager.Task::(_updateState) Task=`e4524add-014f-47bb-80fe-1e51bdc8d73d`::moving from state preparing -> state finished >Thread-55008::DEBUG::2014-05-16 17:57:26,572::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55008::DEBUG::2014-05-16 17:57:26,573::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55008::DEBUG::2014-05-16 17:57:26,573::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55008::DEBUG::2014-05-16 17:57:26,573::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55008::DEBUG::2014-05-16 17:57:26,573::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55008::DEBUG::2014-05-16 17:57:26,573::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55008::DEBUG::2014-05-16 17:57:26,573::task::974::TaskManager.Task::(_decref) Task=`e4524add-014f-47bb-80fe-1e51bdc8d73d`::ref 0 aborting False >Thread-55010::DEBUG::2014-05-16 17:57:26,893::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} >Thread-55010::DEBUG::2014-05-16 17:57:26,893::vm::600::vm.Vm::(_getCpuStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-55010::DEBUG::2014-05-16 17:57:26,893::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55010::DEBUG::2014-05-16 17:57:26,893::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55010::DEBUG::2014-05-16 17:57:26,893::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55010::DEBUG::2014-05-16 17:57:26,893::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55010::DEBUG::2014-05-16 17:57:26,894::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55010::DEBUG::2014-05-16 17:57:26,894::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55010::DEBUG::2014-05-16 17:57:26,895::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '30001', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '6307977719734491521', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.93', 'elapsedTime': '4', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Dummy-51::DEBUG::2014-05-16 17:57:26,991::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:27,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028169 s, 36.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:57:29,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:29,141::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351059 s, 29.2 MB/s\n'; <rc> = 0 >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,633::vm::600::vm.Vm::(_getCpuStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,633::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,634::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,634::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,634::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,634::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,635::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,636::vm::600::vm.Vm::(_getCpuStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,636::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,637::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,637::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,637::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,638::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:29,638::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55012::DEBUG::2014-05-16 17:57:30,111::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 50706001.000000 / 8.019303 / 262500000.000000 = 2.408759 >Thread-55012::DEBUG::2014-05-16 17:57:30,111::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.11499790760413753, 'statsAge': 1.2930481433868408, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 2.4087594873118761, 'rxDropped': 0} >Thread-55012::DEBUG::2014-05-16 17:57:30,111::task::579::TaskManager.Task::(_updateState) Task=`ff076834-a9a6-41cb-87aa-8cc11ebd37a6`::moving from state init -> state preparing >Thread-55012::INFO::2014-05-16 17:57:30,112::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55012::INFO::2014-05-16 17:57:30,112::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533158', 'lastCheck': '6.0', 'valid': True}} >Thread-55012::DEBUG::2014-05-16 17:57:30,112::task::1168::TaskManager.Task::(prepare) Task=`ff076834-a9a6-41cb-87aa-8cc11ebd37a6`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533158', 'lastCheck': '6.0', 'valid': True}} >Thread-55012::DEBUG::2014-05-16 17:57:30,112::task::579::TaskManager.Task::(_updateState) Task=`ff076834-a9a6-41cb-87aa-8cc11ebd37a6`::moving from state preparing -> state finished >Thread-55012::DEBUG::2014-05-16 17:57:30,112::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55012::DEBUG::2014-05-16 17:57:30,112::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55012::DEBUG::2014-05-16 17:57:30,112::task::974::TaskManager.Task::(_decref) Task=`ff076834-a9a6-41cb-87aa-8cc11ebd37a6`::ref 0 aborting False >Thread-55013::DEBUG::2014-05-16 17:57:30,163::vm::600::vm.Vm::(_getCpuStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-55013::DEBUG::2014-05-16 17:57:30,164::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55013::DEBUG::2014-05-16 17:57:30,164::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55013::DEBUG::2014-05-16 17:57:30,164::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55013::DEBUG::2014-05-16 17:57:30,164::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55013::DEBUG::2014-05-16 17:57:30,164::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55013::DEBUG::2014-05-16 17:57:30,164::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Dummy-51::DEBUG::2014-05-16 17:57:31,154::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:31,228::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349881 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:57:33,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55015::DEBUG::2014-05-16 17:57:33,311::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} >Thread-55015::DEBUG::2014-05-16 17:57:33,313::vm::600::vm.Vm::(_getCpuStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-55015::DEBUG::2014-05-16 17:57:33,314::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55015::DEBUG::2014-05-16 17:57:33,315::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55015::DEBUG::2014-05-16 17:57:33,317::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55015::DEBUG::2014-05-16 17:57:33,318::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55015::DEBUG::2014-05-16 17:57:33,319::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55015::DEBUG::2014-05-16 17:57:33,320::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55015::DEBUG::2014-05-16 17:57:33,323::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '30001', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '6307977719734491521', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.34', 'elapsedTime': '10', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Dummy-51::DEBUG::2014-05-16 17:57:33,348::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422906 s, 24.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:57:34,089::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:57:34,100::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000496209 s, 8.3 MB/s\n'; <rc> = 0 >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,644::vm::600::vm.Vm::(_getCpuStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,645::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,645::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,645::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,645::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,646::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,646::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,647::vm::600::vm.Vm::(_getCpuStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,647::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,648::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,648::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,648::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,648::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:34,648::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Dummy-51::DEBUG::2014-05-16 17:57:35,360::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:35,443::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400566 s, 25.6 MB/s\n'; <rc> = 0 >Thread-55017::DEBUG::2014-05-16 17:57:36,360::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} >Thread-55017::DEBUG::2014-05-16 17:57:36,361::vm::600::vm.Vm::(_getCpuStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-55017::DEBUG::2014-05-16 17:57:36,361::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55017::DEBUG::2014-05-16 17:57:36,361::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55017::DEBUG::2014-05-16 17:57:36,361::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55017::DEBUG::2014-05-16 17:57:36,361::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55017::DEBUG::2014-05-16 17:57:36,361::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55017::DEBUG::2014-05-16 17:57:36,361::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55017::DEBUG::2014-05-16 17:57:36,363::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '30001', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '6307977719734491521', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.38', 'elapsedTime': '13', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-55018::DEBUG::2014-05-16 17:57:36,638::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55018::DEBUG::2014-05-16 17:57:36,638::task::579::TaskManager.Task::(_updateState) Task=`3c55192a-e10e-4008-8c3b-fc95e59b1a57`::moving from state init -> state preparing >Thread-55018::INFO::2014-05-16 17:57:36,638::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55018::INFO::2014-05-16 17:57:36,639::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55018::DEBUG::2014-05-16 17:57:36,639::task::1168::TaskManager.Task::(prepare) Task=`3c55192a-e10e-4008-8c3b-fc95e59b1a57`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55018::DEBUG::2014-05-16 17:57:36,639::task::579::TaskManager.Task::(_updateState) Task=`3c55192a-e10e-4008-8c3b-fc95e59b1a57`::moving from state preparing -> state finished >Thread-55018::DEBUG::2014-05-16 17:57:36,639::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55018::DEBUG::2014-05-16 17:57:36,639::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55018::DEBUG::2014-05-16 17:57:36,639::task::974::TaskManager.Task::(_decref) Task=`3c55192a-e10e-4008-8c3b-fc95e59b1a57`::ref 0 aborting False >Thread-55019::DEBUG::2014-05-16 17:57:36,662::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55019::DEBUG::2014-05-16 17:57:36,662::task::579::TaskManager.Task::(_updateState) Task=`77eec66c-d83b-4386-89da-d175928d1fa4`::moving from state init -> state preparing >Thread-55019::INFO::2014-05-16 17:57:36,662::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55019::DEBUG::2014-05-16 17:57:36,663::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bf8763cf-dea2-4665-9574-935a75ecde22`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55019::DEBUG::2014-05-16 17:57:36,663::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55019::DEBUG::2014-05-16 17:57:36,663::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55019::DEBUG::2014-05-16 17:57:36,663::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bf8763cf-dea2-4665-9574-935a75ecde22`::Granted request >Thread-55019::DEBUG::2014-05-16 17:57:36,663::task::811::TaskManager.Task::(resourceAcquired) Task=`77eec66c-d83b-4386-89da-d175928d1fa4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55019::DEBUG::2014-05-16 17:57:36,664::task::974::TaskManager.Task::(_decref) Task=`77eec66c-d83b-4386-89da-d175928d1fa4`::ref 1 aborting False >Thread-55019::INFO::2014-05-16 17:57:36,664::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55019::DEBUG::2014-05-16 17:57:36,664::task::1168::TaskManager.Task::(prepare) Task=`77eec66c-d83b-4386-89da-d175928d1fa4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55019::DEBUG::2014-05-16 17:57:36,664::task::579::TaskManager.Task::(_updateState) Task=`77eec66c-d83b-4386-89da-d175928d1fa4`::moving from state preparing -> state finished >Thread-55019::DEBUG::2014-05-16 17:57:36,665::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55019::DEBUG::2014-05-16 17:57:36,665::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55019::DEBUG::2014-05-16 17:57:36,665::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55019::DEBUG::2014-05-16 17:57:36,665::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55019::DEBUG::2014-05-16 17:57:36,665::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55019::DEBUG::2014-05-16 17:57:36,665::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55019::DEBUG::2014-05-16 17:57:36,665::task::974::TaskManager.Task::(_decref) Task=`77eec66c-d83b-4386-89da-d175928d1fa4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:57:37,456::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:37,534::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033975 s, 30.1 MB/s\n'; <rc> = 0 >Thread-55021::DEBUG::2014-05-16 17:57:39,395::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} >Thread-55021::DEBUG::2014-05-16 17:57:39,395::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55021::DEBUG::2014-05-16 17:57:39,396::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55021::DEBUG::2014-05-16 17:57:39,396::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55021::DEBUG::2014-05-16 17:57:39,396::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55021::DEBUG::2014-05-16 17:57:39,396::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55021::DEBUG::2014-05-16 17:57:39,396::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55021::DEBUG::2014-05-16 17:57:39,397::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '30001', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '6307977719734491521', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'displayType': 'qxl', 'cpuUser': '54.86', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.41', 'elapsedTime': '16', 'vmType': 'kvm', 'cpuSys': '31.76', 'appsList': [], 'guestIPs': ''}]} >Dummy-51::DEBUG::2014-05-16 17:57:39,546::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:39,639::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384301 s, 26.6 MB/s\n'; <rc> = 0 >GuestMonitor-money::DEBUG::2014-05-16 17:57:39,656::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:39,656::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:39,656::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:39,656::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:39,657::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:39,657::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:39,659::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:39,659::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:39,659::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:39,659::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:39,660::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:39,660::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Dummy-51::DEBUG::2014-05-16 17:57:41,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:41,723::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336886 s, 30.4 MB/s\n'; <rc> = 0 >Thread-55023::DEBUG::2014-05-16 17:57:42,427::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} >Thread-55023::DEBUG::2014-05-16 17:57:42,427::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55023::DEBUG::2014-05-16 17:57:42,427::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55023::DEBUG::2014-05-16 17:57:42,428::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55023::DEBUG::2014-05-16 17:57:42,428::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55023::DEBUG::2014-05-16 17:57:42,428::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55023::DEBUG::2014-05-16 17:57:42,428::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55023::DEBUG::2014-05-16 17:57:42,429::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '30001', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '6307977719734491521', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'displayType': 'qxl', 'cpuUser': '54.86', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.43', 'elapsedTime': '19', 'vmType': 'kvm', 'cpuSys': '31.76', 'appsList': [], 'guestIPs': ''}]} >Dummy-51::DEBUG::2014-05-16 17:57:43,735::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:43,826::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0403183 s, 25.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:57:44,145::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:57:44,156::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000504599 s, 8.1 MB/s\n'; <rc> = 0 >GuestMonitor-money::DEBUG::2014-05-16 17:57:44,666::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:44,667::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:44,667::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:44,667::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:44,668::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:44,668::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:44,670::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:44,670::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:44,670::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:44,670::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:44,670::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:44,670::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55024::DEBUG::2014-05-16 17:57:45,450::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 64388197.000000 / 8.008919 / 262500000.000000 = 3.062690 >Thread-55024::DEBUG::2014-05-16 17:57:45,450::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.17366800092151063, 'statsAge': 0.6134340763092041, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 3.062690102180444, 'rxDropped': 0} >Thread-55024::DEBUG::2014-05-16 17:57:45,450::task::579::TaskManager.Task::(_updateState) Task=`f5856dca-3c4c-4919-9f4d-62418d733861`::moving from state init -> state preparing >Thread-55024::INFO::2014-05-16 17:57:45,450::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55024::INFO::2014-05-16 17:57:45,451::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504599', 'lastCheck': '1.3', 'valid': True}} >Thread-55024::DEBUG::2014-05-16 17:57:45,451::task::1168::TaskManager.Task::(prepare) Task=`f5856dca-3c4c-4919-9f4d-62418d733861`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504599', 'lastCheck': '1.3', 'valid': True}} >Thread-55024::DEBUG::2014-05-16 17:57:45,451::task::579::TaskManager.Task::(_updateState) Task=`f5856dca-3c4c-4919-9f4d-62418d733861`::moving from state preparing -> state finished >Thread-55024::DEBUG::2014-05-16 17:57:45,451::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55024::DEBUG::2014-05-16 17:57:45,451::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55024::DEBUG::2014-05-16 17:57:45,451::task::974::TaskManager.Task::(_decref) Task=`f5856dca-3c4c-4919-9f4d-62418d733861`::ref 0 aborting False >Thread-55025::DEBUG::2014-05-16 17:57:45,470::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55025::DEBUG::2014-05-16 17:57:45,471::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55025::DEBUG::2014-05-16 17:57:45,471::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55025::DEBUG::2014-05-16 17:57:45,471::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55025::DEBUG::2014-05-16 17:57:45,471::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55025::DEBUG::2014-05-16 17:57:45,471::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55026::DEBUG::2014-05-16 17:57:45,569::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmSetTicket with ('d5713fb4-0915-4447-9053-b09812aadda9', '0eHQ8JF99Yxw', '120', 'disconnect', {'userName': 'admin@internal', 'userId': 'fdfc627c-d875-11e0-90f0-83df133b58cc'}) {} flowID [3965c93d] >Thread-55026::DEBUG::2014-05-16 17:57:45,579::BindingXMLRPC::982::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >Dummy-51::DEBUG::2014-05-16 17:57:45,840::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:45,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049579 s, 20.7 MB/s\n'; <rc> = 0 >Thread-55027::DEBUG::2014-05-16 17:57:47,342::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55027::DEBUG::2014-05-16 17:57:47,343::task::579::TaskManager.Task::(_updateState) Task=`432a083f-e7dc-4958-9141-d4c360474337`::moving from state init -> state preparing >Thread-55027::INFO::2014-05-16 17:57:47,343::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55027::INFO::2014-05-16 17:57:47,343::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55027::DEBUG::2014-05-16 17:57:47,343::task::1168::TaskManager.Task::(prepare) Task=`432a083f-e7dc-4958-9141-d4c360474337`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55027::DEBUG::2014-05-16 17:57:47,344::task::579::TaskManager.Task::(_updateState) Task=`432a083f-e7dc-4958-9141-d4c360474337`::moving from state preparing -> state finished >Thread-55027::DEBUG::2014-05-16 17:57:47,344::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55027::DEBUG::2014-05-16 17:57:47,344::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55027::DEBUG::2014-05-16 17:57:47,344::task::974::TaskManager.Task::(_decref) Task=`432a083f-e7dc-4958-9141-d4c360474337`::ref 0 aborting False >Thread-55028::DEBUG::2014-05-16 17:57:47,353::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55028::DEBUG::2014-05-16 17:57:47,353::task::579::TaskManager.Task::(_updateState) Task=`a6f5cd58-9cbe-4c6b-b987-515e47c7b479`::moving from state init -> state preparing >Thread-55028::INFO::2014-05-16 17:57:47,353::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55028::DEBUG::2014-05-16 17:57:47,355::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a9f7ff22-6a7d-46bf-9b77-8c8f5a3361fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55028::DEBUG::2014-05-16 17:57:47,355::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55028::DEBUG::2014-05-16 17:57:47,355::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55028::DEBUG::2014-05-16 17:57:47,355::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a9f7ff22-6a7d-46bf-9b77-8c8f5a3361fc`::Granted request >Thread-55028::DEBUG::2014-05-16 17:57:47,356::task::811::TaskManager.Task::(resourceAcquired) Task=`a6f5cd58-9cbe-4c6b-b987-515e47c7b479`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55028::DEBUG::2014-05-16 17:57:47,356::task::974::TaskManager.Task::(_decref) Task=`a6f5cd58-9cbe-4c6b-b987-515e47c7b479`::ref 1 aborting False >Thread-55028::INFO::2014-05-16 17:57:47,357::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55028::DEBUG::2014-05-16 17:57:47,357::task::1168::TaskManager.Task::(prepare) Task=`a6f5cd58-9cbe-4c6b-b987-515e47c7b479`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55028::DEBUG::2014-05-16 17:57:47,357::task::579::TaskManager.Task::(_updateState) Task=`a6f5cd58-9cbe-4c6b-b987-515e47c7b479`::moving from state preparing -> state finished >Thread-55028::DEBUG::2014-05-16 17:57:47,357::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55028::DEBUG::2014-05-16 17:57:47,357::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55028::DEBUG::2014-05-16 17:57:47,357::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55028::DEBUG::2014-05-16 17:57:47,358::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55028::DEBUG::2014-05-16 17:57:47,358::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55028::DEBUG::2014-05-16 17:57:47,358::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55028::DEBUG::2014-05-16 17:57:47,358::task::974::TaskManager.Task::(_decref) Task=`a6f5cd58-9cbe-4c6b-b987-515e47c7b479`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:57:47,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55030::DEBUG::2014-05-16 17:57:48,605::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} >Thread-55030::DEBUG::2014-05-16 17:57:48,605::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55030::DEBUG::2014-05-16 17:57:48,606::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55030::DEBUG::2014-05-16 17:57:48,606::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55030::DEBUG::2014-05-16 17:57:48,606::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55030::DEBUG::2014-05-16 17:57:48,606::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55030::DEBUG::2014-05-16 17:57:48,606::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55030::DEBUG::2014-05-16 17:57:48,607::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '30001', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '6307977719734491521', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'displayType': 'qxl', 'cpuUser': '54.86', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.60', 'elapsedTime': '26', 'vmType': 'kvm', 'cpuSys': '31.76', 'appsList': [], 'guestIPs': ''}]} >Dummy-51::DEBUG::2014-05-16 17:57:48,741::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.753978 s, 1.4 MB/s\n'; <rc> = 0 >GuestMonitor-money::DEBUG::2014-05-16 17:57:49,672::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:49,672::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:49,673::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:49,673::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:49,673::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:49,673::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:49,674::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:49,674::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:49,675::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:49,675::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:49,675::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:49,675::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Dummy-51::DEBUG::2014-05-16 17:57:50,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:50,832::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0430844 s, 23.8 MB/s\n'; <rc> = 0 >Thread-55032::DEBUG::2014-05-16 17:57:51,648::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} >Thread-55032::DEBUG::2014-05-16 17:57:51,648::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55032::DEBUG::2014-05-16 17:57:51,649::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55032::DEBUG::2014-05-16 17:57:51,649::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55032::DEBUG::2014-05-16 17:57:51,649::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55032::DEBUG::2014-05-16 17:57:51,649::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55032::DEBUG::2014-05-16 17:57:51,649::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55032::DEBUG::2014-05-16 17:57:51,650::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '30001', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '6307977719734491521', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'displayType': 'qxl', 'cpuUser': '54.86', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.64', 'elapsedTime': '29', 'vmType': 'kvm', 'cpuSys': '31.76', 'appsList': [], 'guestIPs': ''}]} >libvirtEventLoop::DEBUG::2014-05-16 17:57:51,969::clientIF::586::vm.Vm::(dispatchLibvirtEvents) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::graphics event phase 0 localAddr {'node': '192.168.2.111', 'service': '', 'family': 0} remoteAddr {'node': '192.168.2.74', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-05-16 17:57:52,084::clientIF::586::vm.Vm::(dispatchLibvirtEvents) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::graphics event phase 1 localAddr {'node': '192.168.2.111', 'service': '', 'family': 0} remoteAddr {'node': '192.168.2.74', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-05-16 17:57:52,096::clientIF::586::vm.Vm::(dispatchLibvirtEvents) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::graphics event phase 0 localAddr {'node': '192.168.2.111', 'service': '', 'family': 0} remoteAddr {'node': '192.168.2.74', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-05-16 17:57:52,132::clientIF::586::vm.Vm::(dispatchLibvirtEvents) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::graphics event phase 1 localAddr {'node': '192.168.2.111', 'service': '', 'family': 0} remoteAddr {'node': '192.168.2.74', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-05-16 17:57:52,254::clientIF::586::vm.Vm::(dispatchLibvirtEvents) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::graphics event phase 0 localAddr {'node': '192.168.2.111', 'service': '', 'family': 0} remoteAddr {'node': '192.168.2.74', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-05-16 17:57:52,260::clientIF::586::vm.Vm::(dispatchLibvirtEvents) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::graphics event phase 0 localAddr {'node': '192.168.2.111', 'service': '', 'family': 0} remoteAddr {'node': '192.168.2.74', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-05-16 17:57:52,269::clientIF::586::vm.Vm::(dispatchLibvirtEvents) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::graphics event phase 0 localAddr {'node': '192.168.2.111', 'service': '', 'family': 0} remoteAddr {'node': '192.168.2.74', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-05-16 17:57:52,270::clientIF::586::vm.Vm::(dispatchLibvirtEvents) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::graphics event phase 1 localAddr {'node': '192.168.2.111', 'service': '', 'family': 0} remoteAddr {'node': '192.168.2.74', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-05-16 17:57:52,300::clientIF::586::vm.Vm::(dispatchLibvirtEvents) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::graphics event phase 1 localAddr {'node': '192.168.2.111', 'service': '', 'family': 0} remoteAddr {'node': '192.168.2.74', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-05-16 17:57:52,300::clientIF::586::vm.Vm::(dispatchLibvirtEvents) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::graphics event phase 1 localAddr {'node': '192.168.2.111', 'service': '', 'family': 0} remoteAddr {'node': '192.168.2.74', 'service': '', 'family': 0}authScheme spice subject [] >Dummy-51::DEBUG::2014-05-16 17:57:52,844::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:52,924::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419026 s, 24.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:57:54,194::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:57:54,219::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0151586 s, 270 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-05-16 17:57:54,547::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 38. >GuestMonitor-money::DEBUG::2014-05-16 17:57:54,681::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:54,682::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:54,682::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:54,683::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:54,683::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:54,683::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:54,685::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:54,685::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:54,685::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:54,685::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:54,685::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:54,685::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55034::DEBUG::2014-05-16 17:57:54,724::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} >Thread-55034::DEBUG::2014-05-16 17:57:54,724::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55034::DEBUG::2014-05-16 17:57:54,725::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55034::DEBUG::2014-05-16 17:57:54,725::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55034::DEBUG::2014-05-16 17:57:54,725::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55034::DEBUG::2014-05-16 17:57:54,725::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55034::DEBUG::2014-05-16 17:57:54,725::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55034::DEBUG::2014-05-16 17:57:54,726::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '30001', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '6307977719734491521', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '192.168.2.74', 'kvmEnable': 'true', 'network': {}, 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'displayType': 'qxl', 'cpuUser': '33.27', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.71', 'elapsedTime': '32', 'vmType': 'kvm', 'cpuSys': '15.30', 'appsList': [], 'guestIPs': ''}]} >Dummy-51::DEBUG::2014-05-16 17:57:54,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:55,023::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0432254 s, 23.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:57:57,036::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:57,116::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351978 s, 29.1 MB/s\n'; <rc> = 0 >Thread-55035::DEBUG::2014-05-16 17:57:57,620::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [db6c4f8] >Thread-55035::DEBUG::2014-05-16 17:57:57,620::task::579::TaskManager.Task::(_updateState) Task=`edb6caab-35b0-4da1-9a07-7daa32cf40af`::moving from state init -> state preparing >Thread-55035::INFO::2014-05-16 17:57:57,621::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55035::INFO::2014-05-16 17:57:57,621::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55035::DEBUG::2014-05-16 17:57:57,621::task::1168::TaskManager.Task::(prepare) Task=`edb6caab-35b0-4da1-9a07-7daa32cf40af`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55035::DEBUG::2014-05-16 17:57:57,621::task::579::TaskManager.Task::(_updateState) Task=`edb6caab-35b0-4da1-9a07-7daa32cf40af`::moving from state preparing -> state finished >Thread-55035::DEBUG::2014-05-16 17:57:57,621::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55035::DEBUG::2014-05-16 17:57:57,622::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55035::DEBUG::2014-05-16 17:57:57,622::task::974::TaskManager.Task::(_decref) Task=`edb6caab-35b0-4da1-9a07-7daa32cf40af`::ref 0 aborting False >Thread-55036::DEBUG::2014-05-16 17:57:57,630::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [db6c4f8] >Thread-55036::DEBUG::2014-05-16 17:57:57,631::task::579::TaskManager.Task::(_updateState) Task=`08f927c1-1a08-4090-a0f1-b774fc1a2aa5`::moving from state init -> state preparing >Thread-55036::INFO::2014-05-16 17:57:57,631::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55036::DEBUG::2014-05-16 17:57:57,631::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`be1403b2-87bf-44ea-8e43-4d6110e6a70a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55036::DEBUG::2014-05-16 17:57:57,631::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55036::DEBUG::2014-05-16 17:57:57,632::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55036::DEBUG::2014-05-16 17:57:57,632::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`be1403b2-87bf-44ea-8e43-4d6110e6a70a`::Granted request >Thread-55036::DEBUG::2014-05-16 17:57:57,632::task::811::TaskManager.Task::(resourceAcquired) Task=`08f927c1-1a08-4090-a0f1-b774fc1a2aa5`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55036::DEBUG::2014-05-16 17:57:57,632::task::974::TaskManager.Task::(_decref) Task=`08f927c1-1a08-4090-a0f1-b774fc1a2aa5`::ref 1 aborting False >Thread-55036::INFO::2014-05-16 17:57:57,633::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55036::DEBUG::2014-05-16 17:57:57,633::task::1168::TaskManager.Task::(prepare) Task=`08f927c1-1a08-4090-a0f1-b774fc1a2aa5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55036::DEBUG::2014-05-16 17:57:57,633::task::579::TaskManager.Task::(_updateState) Task=`08f927c1-1a08-4090-a0f1-b774fc1a2aa5`::moving from state preparing -> state finished >Thread-55036::DEBUG::2014-05-16 17:57:57,633::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55036::DEBUG::2014-05-16 17:57:57,634::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55036::DEBUG::2014-05-16 17:57:57,634::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55036::DEBUG::2014-05-16 17:57:57,634::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55036::DEBUG::2014-05-16 17:57:57,634::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55036::DEBUG::2014-05-16 17:57:57,635::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55036::DEBUG::2014-05-16 17:57:57,635::task::974::TaskManager.Task::(_decref) Task=`08f927c1-1a08-4090-a0f1-b774fc1a2aa5`::ref 0 aborting False >Thread-55038::DEBUG::2014-05-16 17:57:57,776::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} flowID [62fee17b] >Thread-55038::DEBUG::2014-05-16 17:57:57,776::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55038::DEBUG::2014-05-16 17:57:57,777::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55038::DEBUG::2014-05-16 17:57:57,777::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55038::DEBUG::2014-05-16 17:57:57,777::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55038::DEBUG::2014-05-16 17:57:57,777::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55038::DEBUG::2014-05-16 17:57:57,777::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55038::DEBUG::2014-05-16 17:57:57,778::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '30001', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '6307977719734491521', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '192.168.2.74', 'kvmEnable': 'true', 'network': {}, 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'displayType': 'qxl', 'cpuUser': '33.27', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.75', 'elapsedTime': '35', 'vmType': 'kvm', 'cpuSys': '15.30', 'appsList': [], 'guestIPs': ''}]} >Dummy-51::DEBUG::2014-05-16 17:57:59,130::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:57:59,216::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.043164 s, 23.7 MB/s\n'; <rc> = 0 >GuestMonitor-money::DEBUG::2014-05-16 17:57:59,692::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:59,692::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:59,693::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:59,693::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:59,693::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:59,693::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:59,695::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:59,695::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:59,695::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:59,695::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:59,695::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:57:59,696::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55039::DEBUG::2014-05-16 17:58:00,795::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 46047035.000000 / 8.017195 / 262500000.000000 = 2.188013 >Thread-55039::DEBUG::2014-05-16 17:58:00,796::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.84677909847786914, 'statsAge': 1.9356491565704346, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 2.1880130954689858, 'rxDropped': 0} >Thread-55039::DEBUG::2014-05-16 17:58:00,796::task::579::TaskManager.Task::(_updateState) Task=`f0a071b0-7e23-40a9-8ddb-1ab0b5724a0b`::moving from state init -> state preparing >Thread-55039::INFO::2014-05-16 17:58:00,796::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55039::INFO::2014-05-16 17:58:00,796::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0151586', 'lastCheck': '6.6', 'valid': True}} >Thread-55039::DEBUG::2014-05-16 17:58:00,797::task::1168::TaskManager.Task::(prepare) Task=`f0a071b0-7e23-40a9-8ddb-1ab0b5724a0b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0151586', 'lastCheck': '6.6', 'valid': True}} >Thread-55039::DEBUG::2014-05-16 17:58:00,797::task::579::TaskManager.Task::(_updateState) Task=`f0a071b0-7e23-40a9-8ddb-1ab0b5724a0b`::moving from state preparing -> state finished >Thread-55039::DEBUG::2014-05-16 17:58:00,797::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55039::DEBUG::2014-05-16 17:58:00,797::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55039::DEBUG::2014-05-16 17:58:00,797::task::974::TaskManager.Task::(_decref) Task=`f0a071b0-7e23-40a9-8ddb-1ab0b5724a0b`::ref 0 aborting False >Thread-55040::DEBUG::2014-05-16 17:58:00,813::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55040::DEBUG::2014-05-16 17:58:00,813::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55040::DEBUG::2014-05-16 17:58:00,814::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55040::DEBUG::2014-05-16 17:58:00,814::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55040::DEBUG::2014-05-16 17:58:00,814::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55040::DEBUG::2014-05-16 17:58:00,814::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Dummy-51::DEBUG::2014-05-16 17:58:01,229::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:01,342::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0634019 s, 16.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:03,356::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:03,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0489316 s, 20.9 MB/s\n'; <rc> = 0 >Thread-55042::DEBUG::2014-05-16 17:58:03,928::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} >Thread-55042::DEBUG::2014-05-16 17:58:03,928::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55042::DEBUG::2014-05-16 17:58:03,929::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55042::DEBUG::2014-05-16 17:58:03,929::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55042::DEBUG::2014-05-16 17:58:03,929::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55042::DEBUG::2014-05-16 17:58:03,929::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55042::DEBUG::2014-05-16 17:58:03,929::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55042::DEBUG::2014-05-16 17:58:03,930::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '30001', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '6307977719734491521', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '192.168.2.74', 'kvmEnable': 'true', 'network': {}, 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'displayType': 'qxl', 'cpuUser': '33.27', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.89', 'elapsedTime': '41', 'vmType': 'kvm', 'cpuSys': '15.30', 'appsList': [], 'guestIPs': ''}]} >Thread-30::DEBUG::2014-05-16 17:58:04,278::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:58:04,289::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000589974 s, 6.9 MB/s\n'; <rc> = 0 >GuestMonitor-money::DEBUG::2014-05-16 17:58:04,702::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:04,703::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:04,703::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:04,703::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:04,703::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:04,704::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:04,705::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:04,705::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:04,705::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:04,705::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:04,706::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:04,706::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Dummy-51::DEBUG::2014-05-16 17:58:05,462::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:05,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0405911 s, 25.2 MB/s\n'; <rc> = 0 >Thread-55044::DEBUG::2014-05-16 17:58:06,962::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} >Thread-55044::DEBUG::2014-05-16 17:58:06,963::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55044::DEBUG::2014-05-16 17:58:06,963::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55044::DEBUG::2014-05-16 17:58:06,963::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55044::DEBUG::2014-05-16 17:58:06,963::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55044::DEBUG::2014-05-16 17:58:06,963::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55044::DEBUG::2014-05-16 17:58:06,963::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55044::DEBUG::2014-05-16 17:58:06,965::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '30001', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '6307977719734491521', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '192.168.2.74', 'kvmEnable': 'true', 'network': {}, 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'displayType': 'qxl', 'cpuUser': '33.27', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.91', 'elapsedTime': '44', 'vmType': 'kvm', 'cpuSys': '15.30', 'appsList': [], 'guestIPs': ''}]} >Dummy-51::DEBUG::2014-05-16 17:58:07,557::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55045::DEBUG::2014-05-16 17:58:07,773::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55045::DEBUG::2014-05-16 17:58:07,773::task::579::TaskManager.Task::(_updateState) Task=`3dd3b507-6173-45f8-b35a-2fa05189da41`::moving from state init -> state preparing >Thread-55045::INFO::2014-05-16 17:58:07,774::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55045::INFO::2014-05-16 17:58:07,774::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55045::DEBUG::2014-05-16 17:58:07,774::task::1168::TaskManager.Task::(prepare) Task=`3dd3b507-6173-45f8-b35a-2fa05189da41`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55045::DEBUG::2014-05-16 17:58:07,774::task::579::TaskManager.Task::(_updateState) Task=`3dd3b507-6173-45f8-b35a-2fa05189da41`::moving from state preparing -> state finished >Thread-55045::DEBUG::2014-05-16 17:58:07,775::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55045::DEBUG::2014-05-16 17:58:07,775::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55045::DEBUG::2014-05-16 17:58:07,775::task::974::TaskManager.Task::(_decref) Task=`3dd3b507-6173-45f8-b35a-2fa05189da41`::ref 0 aborting False >Thread-55046::DEBUG::2014-05-16 17:58:07,784::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55046::DEBUG::2014-05-16 17:58:07,784::task::579::TaskManager.Task::(_updateState) Task=`e10b6b9d-753d-45b4-bee6-8473633c3e7d`::moving from state init -> state preparing >Thread-55046::INFO::2014-05-16 17:58:07,784::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55046::DEBUG::2014-05-16 17:58:07,785::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`09ba6cff-5a02-46d2-ad1a-d77d61409572`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55046::DEBUG::2014-05-16 17:58:07,785::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55046::DEBUG::2014-05-16 17:58:07,785::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55046::DEBUG::2014-05-16 17:58:07,785::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`09ba6cff-5a02-46d2-ad1a-d77d61409572`::Granted request >Thread-55046::DEBUG::2014-05-16 17:58:07,786::task::811::TaskManager.Task::(resourceAcquired) Task=`e10b6b9d-753d-45b4-bee6-8473633c3e7d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55046::DEBUG::2014-05-16 17:58:07,786::task::974::TaskManager.Task::(_decref) Task=`e10b6b9d-753d-45b4-bee6-8473633c3e7d`::ref 1 aborting False >Thread-55046::INFO::2014-05-16 17:58:07,787::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55046::DEBUG::2014-05-16 17:58:07,787::task::1168::TaskManager.Task::(prepare) Task=`e10b6b9d-753d-45b4-bee6-8473633c3e7d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55046::DEBUG::2014-05-16 17:58:07,787::task::579::TaskManager.Task::(_updateState) Task=`e10b6b9d-753d-45b4-bee6-8473633c3e7d`::moving from state preparing -> state finished >Thread-55046::DEBUG::2014-05-16 17:58:07,787::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55046::DEBUG::2014-05-16 17:58:07,787::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55046::DEBUG::2014-05-16 17:58:07,787::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55046::DEBUG::2014-05-16 17:58:07,788::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55046::DEBUG::2014-05-16 17:58:07,788::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55046::DEBUG::2014-05-16 17:58:07,788::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55046::DEBUG::2014-05-16 17:58:07,788::task::974::TaskManager.Task::(_decref) Task=`e10b6b9d-753d-45b4-bee6-8473633c3e7d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:58:07,885::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.284052 s, 3.6 MB/s\n'; <rc> = 0 >GuestMonitor-money::DEBUG::2014-05-16 17:58:09,712::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:09,712::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:09,713::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:09,713::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:09,713::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:09,714::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:09,715::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:09,715::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:09,715::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:09,716::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:09,716::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >GuestMonitor-money::DEBUG::2014-05-16 17:58:09,716::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Dummy-51::DEBUG::2014-05-16 17:58:09,899::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:09,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408622 s, 25.1 MB/s\n'; <rc> = 0 >Thread-55048::DEBUG::2014-05-16 17:58:10,023::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} >Thread-55048::DEBUG::2014-05-16 17:58:10,023::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda stats not available >Thread-55048::DEBUG::2014-05-16 17:58:10,023::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc stats not available >Thread-55048::DEBUG::2014-05-16 17:58:10,024::vm::656::vm.Vm::(_getDiskStats) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda stats not available >Thread-55048::DEBUG::2014-05-16 17:58:10,024::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk fda latency not available >Thread-55048::DEBUG::2014-05-16 17:58:10,024::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk hdc latency not available >Thread-55048::DEBUG::2014-05-16 17:58:10,024::vm::695::vm.Vm::(_getDiskLatency) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Disk vda latency not available >Thread-55048::DEBUG::2014-05-16 17:58:10,025::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '30001', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '6307977719734491521', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '192.168.2.74', 'kvmEnable': 'true', 'network': {}, 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'displayType': 'qxl', 'cpuUser': '59.93', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.96', 'elapsedTime': '47', 'vmType': 'kvm', 'cpuSys': '8.71', 'appsList': [], 'guestIPs': ''}]} >Thread-55049::DEBUG::2014-05-16 17:58:10,302::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmDestroy with ('d5713fb4-0915-4447-9053-b09812aadda9',) {} flowID [8da46fe] >Thread-55049::INFO::2014-05-16 17:58:10,302::API::324::vds::(destroy) vmContainerLock acquired by vm d5713fb4-0915-4447-9053-b09812aadda9 >Thread-55049::DEBUG::2014-05-16 17:58:10,302::vm::4533::vm.Vm::(destroy) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::destroy Called >Thread-55049::INFO::2014-05-16 17:58:10,312::vm::4479::vm.Vm::(releaseVm) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Release VM resources >Thread-55049::DEBUG::2014-05-16 17:58:10,323::sampling::292::vm.Vm::(stop) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Stop statistics collection >Thread-55049::DEBUG::2014-05-16 17:58:10,323::vmChannels::205::vds::(unregister) Delete fileno 38 from listener. >Thread-55006::DEBUG::2014-05-16 17:58:10,323::sampling::323::vm.Vm::(run) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Stats thread finished >VM Channels Listener::DEBUG::2014-05-16 17:58:10,568::vmChannels::112::vds::(_do_del_channels) fileno 38 was removed from listener. >libvirtEventLoop::DEBUG::2014-05-16 17:58:10,756::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::event Stopped detail 1 opaque None >libvirtEventLoop::INFO::2014-05-16 17:58:10,757::vm::2238::vm.Vm::(_onQemuDeath) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::underlying process disconnected >Thread-55049::WARNING::2014-05-16 17:58:10,755::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7ff55c05e750>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7ff55c05e750>> _deviceXML:<disk device="floppy" snapshot="no" type="file"><source file="/var/run/vdsm/payload/d5713fb4-0915-4447-9053-b09812aadda9.170b5fa88f908f48699ebfcd06135a3a.img" startupPolicy="optional"/><target bus="fdc" dev="fda"/><readonly/><serial></serial><readonly/></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7ff55c05e750>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7ff55c05e750>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7ff55c05e750>> address:{u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'} alias:fdc0-0-0 apparentsize:0 blockDev:False cache:none conf:{'status': 'Up', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'pid': '30001', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=429bcb58-e00e-49b9-ab34-b7ab6b09e7e2, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=38fa4ef6-d053-454a-8380-d09138293503, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2device_7bdb33d0-b63d-43c6-b962-c725d4c4d404device_af15269e-19fe-4c91-bac8-2a9b93a75035': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=af15269e-19fe-4c91-bac8-2a9b93a75035, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2device_7bdb33d0-b63d-43c6-b962-c725d4c4d404device_af15269e-19fe-4c91-bac8-2a9b93a75035device_d0aa358d-7f01-4dcc-bccf-bdfc62b1290c': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=d0aa358d-7f01-4dcc-bccf-bdfc62b1290c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2device_7bdb33d0-b63d-43c6-b962-c725d4c4d404': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=7bdb33d0-b63d-43c6-b962-c725d4c4d404, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}'}, 'pauseCode': 'NOERR', 'clientIp': '192.168.2.74', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'alias': u'smartcard0', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'deviceId': '85f9c5d6-6017-4a42-86eb-85323987f41f', 'address': {u'slot': u'0', u'controller': u'0', u'type': u'ccid'}, 'device': 'smartcard', 'type': 'smartcard'}, {'alias': u'scsi0', 'specParams': {}, 'deviceId': 'c45d3a63-aa43-47ed-9542-a31bef486eb1', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': '72fb2570-439a-4d86-99e3-87c41871b775', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'index': '0', 'iface': 'fdc', 'name': u'fda', 'alias': u'fdc0-0-0', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bW9uZXk8L0NvbXB1dGVyTmFtZT4NCiAg\nICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9SZWdpc3RlcmVk\nT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2VyPC9SZWdpc3Rl\ncmVkT3duZXI+DQogICAgICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9\nIk1pY3Jvc29mdC1XaW5kb3dzLVVuYXR0ZW5kZWRKb2luIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9\nIng4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFs\nIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3Nv\nZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3Jn\nLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxJZGVudGlmaWNhdGlvbj4N\nCiAgICAgICAgICAgICAgICA8Q3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgICAgIDxEb21h\naW4+PC9Eb21haW4+DQogICAgICAgICAgICAgICAgICAgIDxQYXNzd29yZD48L1Bhc3N3b3JkPg0K\nICAgICAgICAgICAgICAgICAgICA8VXNlcm5hbWU+PC9Vc2VybmFtZT4NCiAgICAgICAgICAgICAg\nICA8L0NyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgIDxEZWJ1Z0pvaW4+dHJ1ZTwvRGVidWdK\nb2luPg0KICAgICAgICAgICAgICAgIDxKb2luRG9tYWluPjwvSm9pbkRvbWFpbj4NCiAgICAgICAg\nICAgIDwvSWRlbnRpZmljYXRpb24+DQogICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGlu\nZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9Im9vYmVTeXN0ZW0iPg0KICAgICAgICA8Y29tcG9uZW50\nIG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLUlFLUNsaWVudE5ldHdvcmtQcm90b2NvbEltcGxlbWVu\ndGF0aW9uIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYz\nODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1s\nbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRl\nIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4N\nCiAgICAgICAgICAgIDxIS0xNUHJveHlFbmFibGU+ZmFsc2U8L0hLTE1Qcm94eUVuYWJsZT4NCiAg\nICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdp\nbmRvd3MtSW50ZXJuYXRpb25hbC1Db3JlIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5\nPC9JbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxv\nY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAg\nICAgICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9u\nZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNoZWxsLVNl\ndHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2\nYWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6\nd2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4\nbWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAg\nICAgICAgICAgIDxEaXNwbGF5Pg0KICAgICAgICAgICAgICAgIDxDb2xvckRlcHRoPjMyPC9Db2xv\nckRlcHRoPg0KICAgICAgICAgICAgICAgIDxIb3Jpem9udGFsUmVzb2x1dGlvbj4xMDI0PC9Ib3Jp\nem9udGFsUmVzb2x1dGlvbj4NCiAgICAgICAgICAgICAgICA8UmVmcmVzaFJhdGU+NzU8L1JlZnJl\nc2hSYXRlPg0KICAgICAgICAgICAgICAgIDxWZXJ0aWNhbFJlc29sdXRpb24+NzY4PC9WZXJ0aWNh\nbFJlc29sdXRpb24+DQogICAgICAgICAgICA8L0Rpc3BsYXk+DQogICAgICAgICAgICA8T09CRT4N\nCiAgICAgICAgICAgICAgICA8SGlkZUVVTEFQYWdlPnRydWU8L0hpZGVFVUxBUGFnZT4NCiAgICAg\nICAgICAgICAgICA8U2tpcFVzZXJPT0JFPnRydWU8L1NraXBVc2VyT09CRT4NCiAgICAgICAgICAg\nIDwvT09CRT4NCiAgICAgICAgICAgIDxVc2VyQWNjb3VudHM+DQogICAgICAgICAgICAgICAgPEFk\nbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgICAgICAgICAgPFZhbHVlPjwvVmFsdWU+\nDQogICAgICAgICAgICAgICAgICAgIDxQbGFpblRleHQ+dHJ1ZTwvUGxhaW5UZXh0Pg0KICAgICAg\nICAgICAgICAgIDwvQWRtaW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgPC9Vc2VyQWNj\nb3VudHM+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwv\nUmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNl\ncjwvUmVnaXN0ZXJlZE93bmVyPg0KICAgICAgICAgICAgPFRpbWVab25lPjg1PC9UaW1lWm9uZT4N\nCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5ncz4NCiAgICA8c2V0dGluZ3MgcGFz\ncz0id2luZG93c1BFIj4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93\ncy1JbnRlcm5hdGlvbmFsLUNvcmUtV2luUEUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBw\ndWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNp\nb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20v\nV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9Y\nTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPFNldHVwVUlMYW5ndWFnZT4NCiAgICAg\nICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDwv\nU2V0dXBVSUxhbmd1YWdlPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+\nDQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2NhbGU+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2V0dXAiIHBy\nb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUz\nNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0\ndHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhz\naT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAg\nICAgPFVzZXJEYXRhPg0KICAgICAgICAgICAgICAgIDxQcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgICAgICA8S2V5PjwvS2V5Pg0KICAgICAgICAgICAgICAgICAgICA8V2lsbFNob3dVST5OZXZl\ncjwvV2lsbFNob3dVST4NCiAgICAgICAgICAgICAgICA8L1Byb2R1Y3RLZXk+DQogICAgICAgICAg\nICAgICAgPEFjY2VwdEV1bGE+dHJ1ZTwvQWNjZXB0RXVsYT4NCiAgICAgICAgICAgICAgICA8T3Jn\nYW5pemF0aW9uPmF3YXlmYXIub3JnPC9Pcmdhbml6YXRpb24+DQogICAgICAgICAgICAgICAgPEZ1\nbGxOYW1lPlVzZXI8L0Z1bGxOYW1lPg0KICAgICAgICAgICAgPC9Vc2VyRGF0YT4NCiAgICAgICAg\nPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5ncz4NCiAgICA8Y3BpOm9mZmxpbmVJbWFnZSBjcGk6\nc291cmNlPSJjYXRhbG9nOi8vY2F0YWxvZ3Mvd2luZG93czIwMDgteDg2L3NvdXJjZXMvaW5zdGFs\nbF93aW5kb3dzIGxvbmdob3JuIHNlcnZlcmVudGVycHJpc2UuY2xnIiB4bWxuczpjcGk9InVybjpz\nY2hlbWFzLW1pY3Jvc29mdC1jb206Y3BpIiAvPg0KPC91bmF0dGVuZD4NCg==\n'}}}, 'readonly': 'True', 'deviceId': 'f7b0a69b-3970-4e2f-a242-9953ccf46da1', 'path': '/var/run/vdsm/payload/d5713fb4-0915-4447-9053-b09812aadda9.170b5fa88f908f48699ebfcd06135a3a.img', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'True', 'deviceId': 'c4ad1abc-8c00-4bd7-b655-a9f85f8a6487', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a', 'volumeID': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk0', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'reqsize': '0', 'format': 'cow', 'deviceId': '01628de4-d767-4b97-bdcf-c1e3459c1476', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'bootOrder': u'1', 'volumeID': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'specParams': {}, 'volumeChain': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a', 'volumeID': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}]}, {'target': 2097152, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': '46ba3697-488c-473d-a69c-35d14f95ec71', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'money', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7ff55c05e750>> device:floppy deviceId:f7b0a69b-3970-4e2f-a242-9953ccf46da1 drv:raw extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7ff55c05e750>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7ff55c05e750>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7ff55c05e750>> hasVolumeLeases:False iface:fdc index:0 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7ff55c05e750>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7ff55c05e750>> log:<logUtils.SimpleLogAdapter instance at 0x7ff53433e758> name:fda networkDev:False path:/var/run/vdsm/payload/d5713fb4-0915-4447-9053-b09812aadda9.170b5fa88f908f48699ebfcd06135a3a.img readonly:True reqsize:0 serial: shared:false specParams:{'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bW9uZXk8L0NvbXB1dGVyTmFtZT4NCiAg\nICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9SZWdpc3RlcmVk\nT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2VyPC9SZWdpc3Rl\ncmVkT3duZXI+DQogICAgICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9\nIk1pY3Jvc29mdC1XaW5kb3dzLVVuYXR0ZW5kZWRKb2luIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9\nIng4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFs\nIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3Nv\nZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3Jn\nLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxJZGVudGlmaWNhdGlvbj4N\nCiAgICAgICAgICAgICAgICA8Q3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgICAgIDxEb21h\naW4+PC9Eb21haW4+DQogICAgICAgICAgICAgICAgICAgIDxQYXNzd29yZD48L1Bhc3N3b3JkPg0K\nICAgICAgICAgICAgICAgICAgICA8VXNlcm5hbWU+PC9Vc2VybmFtZT4NCiAgICAgICAgICAgICAg\nICA8L0NyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgIDxEZWJ1Z0pvaW4+dHJ1ZTwvRGVidWdK\nb2luPg0KICAgICAgICAgICAgICAgIDxKb2luRG9tYWluPjwvSm9pbkRvbWFpbj4NCiAgICAgICAg\nICAgIDwvSWRlbnRpZmljYXRpb24+DQogICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGlu\nZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9Im9vYmVTeXN0ZW0iPg0KICAgICAgICA8Y29tcG9uZW50\nIG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLUlFLUNsaWVudE5ldHdvcmtQcm90b2NvbEltcGxlbWVu\ndGF0aW9uIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYz\nODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1s\nbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRl\nIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4N\nCiAgICAgICAgICAgIDxIS0xNUHJveHlFbmFibGU+ZmFsc2U8L0hLTE1Qcm94eUVuYWJsZT4NCiAg\nICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdp\nbmRvd3MtSW50ZXJuYXRpb25hbC1Db3JlIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5\nPC9JbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxv\nY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAg\nICAgICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9u\nZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNoZWxsLVNl\ndHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2\nYWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6\nd2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4\nbWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAg\nICAgICAgICAgIDxEaXNwbGF5Pg0KICAgICAgICAgICAgICAgIDxDb2xvckRlcHRoPjMyPC9Db2xv\nckRlcHRoPg0KICAgICAgICAgICAgICAgIDxIb3Jpem9udGFsUmVzb2x1dGlvbj4xMDI0PC9Ib3Jp\nem9udGFsUmVzb2x1dGlvbj4NCiAgICAgICAgICAgICAgICA8UmVmcmVzaFJhdGU+NzU8L1JlZnJl\nc2hSYXRlPg0KICAgICAgICAgICAgICAgIDxWZXJ0aWNhbFJlc29sdXRpb24+NzY4PC9WZXJ0aWNh\nbFJlc29sdXRpb24+DQogICAgICAgICAgICA8L0Rpc3BsYXk+DQogICAgICAgICAgICA8T09CRT4N\nCiAgICAgICAgICAgICAgICA8SGlkZUVVTEFQYWdlPnRydWU8L0hpZGVFVUxBUGFnZT4NCiAgICAg\nICAgICAgICAgICA8U2tpcFVzZXJPT0JFPnRydWU8L1NraXBVc2VyT09CRT4NCiAgICAgICAgICAg\nIDwvT09CRT4NCiAgICAgICAgICAgIDxVc2VyQWNjb3VudHM+DQogICAgICAgICAgICAgICAgPEFk\nbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgICAgICAgICAgPFZhbHVlPjwvVmFsdWU+\nDQogICAgICAgICAgICAgICAgICAgIDxQbGFpblRleHQ+dHJ1ZTwvUGxhaW5UZXh0Pg0KICAgICAg\nICAgICAgICAgIDwvQWRtaW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgPC9Vc2VyQWNj\nb3VudHM+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwv\nUmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNl\ncjwvUmVnaXN0ZXJlZE93bmVyPg0KICAgICAgICAgICAgPFRpbWVab25lPjg1PC9UaW1lWm9uZT4N\nCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5ncz4NCiAgICA8c2V0dGluZ3MgcGFz\ncz0id2luZG93c1BFIj4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93\ncy1JbnRlcm5hdGlvbmFsLUNvcmUtV2luUEUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBw\ndWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNp\nb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20v\nV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9Y\nTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPFNldHVwVUlMYW5ndWFnZT4NCiAgICAg\nICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDwv\nU2V0dXBVSUxhbmd1YWdlPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+\nDQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2NhbGU+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2V0dXAiIHBy\nb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUz\nNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0\ndHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhz\naT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAg\nICAgPFVzZXJEYXRhPg0KICAgICAgICAgICAgICAgIDxQcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgICAgICA8S2V5PjwvS2V5Pg0KICAgICAgICAgICAgICAgICAgICA8V2lsbFNob3dVST5OZXZl\ncjwvV2lsbFNob3dVST4NCiAgICAgICAgICAgICAgICA8L1Byb2R1Y3RLZXk+DQogICAgICAgICAg\nICAgICAgPEFjY2VwdEV1bGE+dHJ1ZTwvQWNjZXB0RXVsYT4NCiAgICAgICAgICAgICAgICA8T3Jn\nYW5pemF0aW9uPmF3YXlmYXIub3JnPC9Pcmdhbml6YXRpb24+DQogICAgICAgICAgICAgICAgPEZ1\nbGxOYW1lPlVzZXI8L0Z1bGxOYW1lPg0KICAgICAgICAgICAgPC9Vc2VyRGF0YT4NCiAgICAgICAg\nPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5ncz4NCiAgICA8Y3BpOm9mZmxpbmVJbWFnZSBjcGk6\nc291cmNlPSJjYXRhbG9nOi8vY2F0YWxvZ3Mvd2luZG93czIwMDgteDg2L3NvdXJjZXMvaW5zdGFs\nbF93aW5kb3dzIGxvbmdob3JuIHNlcnZlcmVudGVycHJpc2UuY2xnIiB4bWxuczpjcGk9InVybjpz\nY2hlbWFzLW1pY3Jvc29mdC1jb206Y3BpIiAvPg0KPC91bmF0dGVuZD4NCg==\n'}}} transientDisk:False truesize:0 type:floppy volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath > File "/usr/share/vdsm/vm.py", line 1431, in __getitem__ >KeyError: 'domainID' >Thread-55049::WARNING::2014-05-16 17:58:10,759::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7ff55c05e090>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7ff55c05e090>> _deviceXML:<disk device="cdrom" snapshot="no" type="file"><address bus="1" controller="0" target="0" type="drive" unit="0"/><source file="" startupPolicy="optional"/><target bus="ide" dev="hdc"/><readonly/><serial></serial></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7ff55c05e090>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7ff55c05e090>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7ff55c05e090>> address:{u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'} alias:ide0-1-0 apparentsize:0 blockDev:False cache:none conf:{'status': 'Up', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'd5713fb4-0915-4447-9053-b09812aadda9', 'pid': '30001', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=429bcb58-e00e-49b9-ab34-b7ab6b09e7e2, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=38fa4ef6-d053-454a-8380-d09138293503, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2device_7bdb33d0-b63d-43c6-b962-c725d4c4d404device_af15269e-19fe-4c91-bac8-2a9b93a75035': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=af15269e-19fe-4c91-bac8-2a9b93a75035, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2device_7bdb33d0-b63d-43c6-b962-c725d4c4d404device_af15269e-19fe-4c91-bac8-2a9b93a75035device_d0aa358d-7f01-4dcc-bccf-bdfc62b1290c': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=d0aa358d-7f01-4dcc-bccf-bdfc62b1290c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_38fa4ef6-d053-454a-8380-d09138293503device_429bcb58-e00e-49b9-ab34-b7ab6b09e7e2device_7bdb33d0-b63d-43c6-b962-c725d4c4d404': 'VmDevice {vmId=d5713fb4-0915-4447-9053-b09812aadda9, deviceId=7bdb33d0-b63d-43c6-b962-c725d4c4d404, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}'}, 'pauseCode': 'NOERR', 'clientIp': '192.168.2.74', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'alias': u'smartcard0', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'deviceId': '85f9c5d6-6017-4a42-86eb-85323987f41f', 'address': {u'slot': u'0', u'controller': u'0', u'type': u'ccid'}, 'device': 'smartcard', 'type': 'smartcard'}, {'alias': u'scsi0', 'specParams': {}, 'deviceId': 'c45d3a63-aa43-47ed-9542-a31bef486eb1', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': '72fb2570-439a-4d86-99e3-87c41871b775', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'index': '0', 'iface': 'fdc', 'name': u'fda', 'alias': u'fdc0-0-0', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bW9uZXk8L0NvbXB1dGVyTmFtZT4NCiAg\nICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9SZWdpc3RlcmVk\nT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2VyPC9SZWdpc3Rl\ncmVkT3duZXI+DQogICAgICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9\nIk1pY3Jvc29mdC1XaW5kb3dzLVVuYXR0ZW5kZWRKb2luIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9\nIng4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFs\nIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3Nv\nZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3Jn\nLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxJZGVudGlmaWNhdGlvbj4N\nCiAgICAgICAgICAgICAgICA8Q3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgICAgIDxEb21h\naW4+PC9Eb21haW4+DQogICAgICAgICAgICAgICAgICAgIDxQYXNzd29yZD48L1Bhc3N3b3JkPg0K\nICAgICAgICAgICAgICAgICAgICA8VXNlcm5hbWU+PC9Vc2VybmFtZT4NCiAgICAgICAgICAgICAg\nICA8L0NyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgIDxEZWJ1Z0pvaW4+dHJ1ZTwvRGVidWdK\nb2luPg0KICAgICAgICAgICAgICAgIDxKb2luRG9tYWluPjwvSm9pbkRvbWFpbj4NCiAgICAgICAg\nICAgIDwvSWRlbnRpZmljYXRpb24+DQogICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGlu\nZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9Im9vYmVTeXN0ZW0iPg0KICAgICAgICA8Y29tcG9uZW50\nIG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLUlFLUNsaWVudE5ldHdvcmtQcm90b2NvbEltcGxlbWVu\ndGF0aW9uIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYz\nODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1s\nbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRl\nIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4N\nCiAgICAgICAgICAgIDxIS0xNUHJveHlFbmFibGU+ZmFsc2U8L0hLTE1Qcm94eUVuYWJsZT4NCiAg\nICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdp\nbmRvd3MtSW50ZXJuYXRpb25hbC1Db3JlIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5\nPC9JbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxv\nY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAg\nICAgICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9u\nZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNoZWxsLVNl\ndHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2\nYWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6\nd2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4\nbWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAg\nICAgICAgICAgIDxEaXNwbGF5Pg0KICAgICAgICAgICAgICAgIDxDb2xvckRlcHRoPjMyPC9Db2xv\nckRlcHRoPg0KICAgICAgICAgICAgICAgIDxIb3Jpem9udGFsUmVzb2x1dGlvbj4xMDI0PC9Ib3Jp\nem9udGFsUmVzb2x1dGlvbj4NCiAgICAgICAgICAgICAgICA8UmVmcmVzaFJhdGU+NzU8L1JlZnJl\nc2hSYXRlPg0KICAgICAgICAgICAgICAgIDxWZXJ0aWNhbFJlc29sdXRpb24+NzY4PC9WZXJ0aWNh\nbFJlc29sdXRpb24+DQogICAgICAgICAgICA8L0Rpc3BsYXk+DQogICAgICAgICAgICA8T09CRT4N\nCiAgICAgICAgICAgICAgICA8SGlkZUVVTEFQYWdlPnRydWU8L0hpZGVFVUxBUGFnZT4NCiAgICAg\nICAgICAgICAgICA8U2tpcFVzZXJPT0JFPnRydWU8L1NraXBVc2VyT09CRT4NCiAgICAgICAgICAg\nIDwvT09CRT4NCiAgICAgICAgICAgIDxVc2VyQWNjb3VudHM+DQogICAgICAgICAgICAgICAgPEFk\nbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgICAgICAgICAgPFZhbHVlPjwvVmFsdWU+\nDQogICAgICAgICAgICAgICAgICAgIDxQbGFpblRleHQ+dHJ1ZTwvUGxhaW5UZXh0Pg0KICAgICAg\nICAgICAgICAgIDwvQWRtaW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgPC9Vc2VyQWNj\nb3VudHM+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwv\nUmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNl\ncjwvUmVnaXN0ZXJlZE93bmVyPg0KICAgICAgICAgICAgPFRpbWVab25lPjg1PC9UaW1lWm9uZT4N\nCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5ncz4NCiAgICA8c2V0dGluZ3MgcGFz\ncz0id2luZG93c1BFIj4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93\ncy1JbnRlcm5hdGlvbmFsLUNvcmUtV2luUEUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBw\ndWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNp\nb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20v\nV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9Y\nTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPFNldHVwVUlMYW5ndWFnZT4NCiAgICAg\nICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDwv\nU2V0dXBVSUxhbmd1YWdlPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+\nDQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2NhbGU+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2V0dXAiIHBy\nb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUz\nNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0\ndHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhz\naT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAg\nICAgPFVzZXJEYXRhPg0KICAgICAgICAgICAgICAgIDxQcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgICAgICA8S2V5PjwvS2V5Pg0KICAgICAgICAgICAgICAgICAgICA8V2lsbFNob3dVST5OZXZl\ncjwvV2lsbFNob3dVST4NCiAgICAgICAgICAgICAgICA8L1Byb2R1Y3RLZXk+DQogICAgICAgICAg\nICAgICAgPEFjY2VwdEV1bGE+dHJ1ZTwvQWNjZXB0RXVsYT4NCiAgICAgICAgICAgICAgICA8T3Jn\nYW5pemF0aW9uPmF3YXlmYXIub3JnPC9Pcmdhbml6YXRpb24+DQogICAgICAgICAgICAgICAgPEZ1\nbGxOYW1lPlVzZXI8L0Z1bGxOYW1lPg0KICAgICAgICAgICAgPC9Vc2VyRGF0YT4NCiAgICAgICAg\nPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5ncz4NCiAgICA8Y3BpOm9mZmxpbmVJbWFnZSBjcGk6\nc291cmNlPSJjYXRhbG9nOi8vY2F0YWxvZ3Mvd2luZG93czIwMDgteDg2L3NvdXJjZXMvaW5zdGFs\nbF93aW5kb3dzIGxvbmdob3JuIHNlcnZlcmVudGVycHJpc2UuY2xnIiB4bWxuczpjcGk9InVybjpz\nY2hlbWFzLW1pY3Jvc29mdC1jb206Y3BpIiAvPg0KPC91bmF0dGVuZD4NCg==\n'}}}, 'readonly': 'True', 'deviceId': 'f7b0a69b-3970-4e2f-a242-9953ccf46da1', 'path': '/var/run/vdsm/payload/d5713fb4-0915-4447-9053-b09812aadda9.170b5fa88f908f48699ebfcd06135a3a.img', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'True', 'deviceId': 'c4ad1abc-8c00-4bd7-b655-a9f85f8a6487', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a', 'volumeID': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk0', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'reqsize': '0', 'format': 'cow', 'deviceId': '01628de4-d767-4b97-bdcf-c1e3459c1476', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'bootOrder': u'1', 'volumeID': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'specParams': {}, 'volumeChain': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a', 'volumeID': '458ec5f0-63fa-49a6-a086-e06ecc27582a', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '01628de4-d767-4b97-bdcf-c1e3459c1476'}]}, {'target': 2097152, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': '46ba3697-488c-473d-a69c-35d14f95ec71', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'money', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7ff55c05e090>> device:cdrom deviceId:c4ad1abc-8c00-4bd7-b655-a9f85f8a6487 drv:raw extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7ff55c05e090>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7ff55c05e090>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7ff55c05e090>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7ff55c05e090>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7ff55c05e090>> log:<logUtils.SimpleLogAdapter instance at 0x7ff53433e758> name:hdc networkDev:False path: readonly:True reqsize:0 serial: shared:false specParams:{'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'} transientDisk:False truesize:0 type:cdrom volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath > File "/usr/share/vdsm/vm.py", line 1431, in __getitem__ >KeyError: 'domainID' >Thread-55049::DEBUG::2014-05-16 17:58:10,760::task::579::TaskManager.Task::(_updateState) Task=`9a58918a-a030-458d-99f6-4c61cf2b11f0`::moving from state init -> state preparing >Thread-55049::INFO::2014-05-16 17:58:10,760::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='01628de4-d767-4b97-bdcf-c1e3459c1476', volUUID=None) >Thread-55049::DEBUG::2014-05-16 17:58:10,761::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`a411be7a-bbe3-4438-b9b9-db1eca45823a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'teardownImage' >Thread-55049::DEBUG::2014-05-16 17:58:10,761::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55049::DEBUG::2014-05-16 17:58:10,761::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55049::DEBUG::2014-05-16 17:58:10,761::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`a411be7a-bbe3-4438-b9b9-db1eca45823a`::Granted request >Thread-55049::DEBUG::2014-05-16 17:58:10,762::task::811::TaskManager.Task::(resourceAcquired) Task=`9a58918a-a030-458d-99f6-4c61cf2b11f0`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55049::DEBUG::2014-05-16 17:58:10,762::task::974::TaskManager.Task::(_decref) Task=`9a58918a-a030-458d-99f6-4c61cf2b11f0`::ref 1 aborting False >Thread-55049::DEBUG::2014-05-16 17:58:10,762::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55049::DEBUG::2014-05-16 17:58:10,763::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55049::DEBUG::2014-05-16 17:58:10,953::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55049::DEBUG::2014-05-16 17:58:10,969::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55049::DEBUG::2014-05-16 17:58:10,969::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55049::DEBUG::2014-05-16 17:58:10,970::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/458ec5f0-63fa-49a6-a086-e06ecc27582a' (cwd None) >Thread-55049::DEBUG::2014-05-16 17:58:11,166::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55049::DEBUG::2014-05-16 17:58:11,166::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55049::DEBUG::2014-05-16 17:58:11,166::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55049::INFO::2014-05-16 17:58:11,167::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-55049::DEBUG::2014-05-16 17:58:11,167::task::1168::TaskManager.Task::(prepare) Task=`9a58918a-a030-458d-99f6-4c61cf2b11f0`::finished: None >Thread-55049::DEBUG::2014-05-16 17:58:11,167::task::579::TaskManager.Task::(_updateState) Task=`9a58918a-a030-458d-99f6-4c61cf2b11f0`::moving from state preparing -> state finished >Thread-55049::DEBUG::2014-05-16 17:58:11,167::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55049::DEBUG::2014-05-16 17:58:11,167::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55049::DEBUG::2014-05-16 17:58:11,168::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55049::DEBUG::2014-05-16 17:58:11,168::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55049::DEBUG::2014-05-16 17:58:11,168::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55049::DEBUG::2014-05-16 17:58:11,168::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55049::DEBUG::2014-05-16 17:58:11,169::task::974::TaskManager.Task::(_decref) Task=`9a58918a-a030-458d-99f6-4c61cf2b11f0`::ref 0 aborting False >Thread-55049::DEBUG::2014-05-16 17:58:11,171::task::579::TaskManager.Task::(_updateState) Task=`3e23f7be-3606-4fcc-ae66-997085b9e84e`::moving from state init -> state preparing >Thread-55049::INFO::2014-05-16 17:58:11,171::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='d5713fb4-0915-4447-9053-b09812aadda9') >Thread-55049::INFO::2014-05-16 17:58:11,177::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-55049::DEBUG::2014-05-16 17:58:11,177::task::1168::TaskManager.Task::(prepare) Task=`3e23f7be-3606-4fcc-ae66-997085b9e84e`::finished: None >Thread-55049::DEBUG::2014-05-16 17:58:11,177::task::579::TaskManager.Task::(_updateState) Task=`3e23f7be-3606-4fcc-ae66-997085b9e84e`::moving from state preparing -> state finished >Thread-55049::DEBUG::2014-05-16 17:58:11,177::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55049::DEBUG::2014-05-16 17:58:11,178::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55049::DEBUG::2014-05-16 17:58:11,178::task::974::TaskManager.Task::(_decref) Task=`3e23f7be-3606-4fcc-ae66-997085b9e84e`::ref 0 aborting False >Thread-55049::DEBUG::2014-05-16 17:58:11,179::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd' (cwd None) >Thread-55049::DEBUG::2014-05-16 17:58:11,453::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55049::INFO::2014-05-16 17:58:11,453::hooks::100::root::(_runHooksDir) >Thread-55049::DEBUG::2014-05-16 17:58:11,454::vm::4527::vm.Vm::(deleteVm) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Total desktops after destroy of d5713fb4-0915-4447-9053-b09812aadda9 is 0 >Thread-55049::DEBUG::2014-05-16 17:58:11,454::BindingXMLRPC::982::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >libvirtEventLoop::DEBUG::2014-05-16 17:58:11,455::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid 'd5713fb4-0915-4447-9053-b09812aadda9' >libvirtEventLoop::DEBUG::2014-05-16 17:58:11,455::vm::2657::vm.Vm::(setDownStatus) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Changed state to Down: Admin shut down >libvirtEventLoop::DEBUG::2014-05-16 17:58:11,456::sampling::292::vm.Vm::(stop) vmId=`d5713fb4-0915-4447-9053-b09812aadda9`::Stop statistics collection >libvirtEventLoop::DEBUG::2014-05-16 17:58:11,456::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid 'd5713fb4-0915-4447-9053-b09812aadda9' >Dummy-51::DEBUG::2014-05-16 17:58:12,003::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:12,071::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316684 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:14,083::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:14,155::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351711 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:58:14,327::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:58:14,338::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000787792 s, 5.2 MB/s\n'; <rc> = 0 >Thread-55052::DEBUG::2014-05-16 17:58:16,071::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 21475061.000000 / 8.009730 / 262500000.000000 = 1.021380 >Thread-55052::DEBUG::2014-05-16 17:58:16,071::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.62963067995587807, 'statsAge': 1.1926219463348389, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 1.0213796864893612, 'rxDropped': 0} >Thread-55052::DEBUG::2014-05-16 17:58:16,071::task::579::TaskManager.Task::(_updateState) Task=`ac0ef95d-6ae7-45a4-a673-771ac5de9aaa`::moving from state init -> state preparing >Thread-55052::INFO::2014-05-16 17:58:16,071::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55052::INFO::2014-05-16 17:58:16,072::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787792', 'lastCheck': '1.7', 'valid': True}} >Thread-55052::DEBUG::2014-05-16 17:58:16,072::task::1168::TaskManager.Task::(prepare) Task=`ac0ef95d-6ae7-45a4-a673-771ac5de9aaa`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787792', 'lastCheck': '1.7', 'valid': True}} >Thread-55052::DEBUG::2014-05-16 17:58:16,072::task::579::TaskManager.Task::(_updateState) Task=`ac0ef95d-6ae7-45a4-a673-771ac5de9aaa`::moving from state preparing -> state finished >Thread-55052::DEBUG::2014-05-16 17:58:16,072::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55052::DEBUG::2014-05-16 17:58:16,072::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55052::DEBUG::2014-05-16 17:58:16,072::task::974::TaskManager.Task::(_decref) Task=`ac0ef95d-6ae7-45a4-a673-771ac5de9aaa`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:58:16,167::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:16,239::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348292 s, 29.4 MB/s\n'; <rc> = 0 >Thread-55054::DEBUG::2014-05-16 17:58:17,854::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55054::DEBUG::2014-05-16 17:58:17,855::task::579::TaskManager.Task::(_updateState) Task=`f1d3728b-3b3e-4d78-b3bd-f7937a18a402`::moving from state init -> state preparing >Thread-55054::INFO::2014-05-16 17:58:17,855::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55054::INFO::2014-05-16 17:58:17,855::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55054::DEBUG::2014-05-16 17:58:17,856::task::1168::TaskManager.Task::(prepare) Task=`f1d3728b-3b3e-4d78-b3bd-f7937a18a402`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55054::DEBUG::2014-05-16 17:58:17,856::task::579::TaskManager.Task::(_updateState) Task=`f1d3728b-3b3e-4d78-b3bd-f7937a18a402`::moving from state preparing -> state finished >Thread-55054::DEBUG::2014-05-16 17:58:17,856::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55054::DEBUG::2014-05-16 17:58:17,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55054::DEBUG::2014-05-16 17:58:17,856::task::974::TaskManager.Task::(_decref) Task=`f1d3728b-3b3e-4d78-b3bd-f7937a18a402`::ref 0 aborting False >Thread-55055::DEBUG::2014-05-16 17:58:17,867::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55055::DEBUG::2014-05-16 17:58:17,867::task::579::TaskManager.Task::(_updateState) Task=`49ae848b-c803-49ee-bdfe-7bf4e94c3cbc`::moving from state init -> state preparing >Thread-55055::INFO::2014-05-16 17:58:17,867::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55055::DEBUG::2014-05-16 17:58:17,867::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`59028611-f760-4413-bfaf-89d171d3cd2d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55055::DEBUG::2014-05-16 17:58:17,868::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55055::DEBUG::2014-05-16 17:58:17,868::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55055::DEBUG::2014-05-16 17:58:17,868::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`59028611-f760-4413-bfaf-89d171d3cd2d`::Granted request >Thread-55055::DEBUG::2014-05-16 17:58:17,868::task::811::TaskManager.Task::(resourceAcquired) Task=`49ae848b-c803-49ee-bdfe-7bf4e94c3cbc`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55055::DEBUG::2014-05-16 17:58:17,868::task::974::TaskManager.Task::(_decref) Task=`49ae848b-c803-49ee-bdfe-7bf4e94c3cbc`::ref 1 aborting False >Thread-55055::INFO::2014-05-16 17:58:17,869::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55055::DEBUG::2014-05-16 17:58:17,869::task::1168::TaskManager.Task::(prepare) Task=`49ae848b-c803-49ee-bdfe-7bf4e94c3cbc`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55055::DEBUG::2014-05-16 17:58:17,869::task::579::TaskManager.Task::(_updateState) Task=`49ae848b-c803-49ee-bdfe-7bf4e94c3cbc`::moving from state preparing -> state finished >Thread-55055::DEBUG::2014-05-16 17:58:17,870::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55055::DEBUG::2014-05-16 17:58:17,870::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55055::DEBUG::2014-05-16 17:58:17,870::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55055::DEBUG::2014-05-16 17:58:17,870::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55055::DEBUG::2014-05-16 17:58:17,870::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55055::DEBUG::2014-05-16 17:58:17,870::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55055::DEBUG::2014-05-16 17:58:17,871::task::974::TaskManager.Task::(_decref) Task=`49ae848b-c803-49ee-bdfe-7bf4e94c3cbc`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:58:18,250::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:18,318::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312312 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:20,330::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:20,403::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356896 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:22,415::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:22,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354534 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:58:24,373::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:58:24,384::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000901645 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:24,498::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:24,568::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352286 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:26,580::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:26,651::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357493 s, 28.6 MB/s\n'; <rc> = 0 >Thread-55059::DEBUG::2014-05-16 17:58:27,907::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55059::DEBUG::2014-05-16 17:58:27,908::task::579::TaskManager.Task::(_updateState) Task=`a3bd8714-27bb-4ca6-b788-539b9c29e2d3`::moving from state init -> state preparing >Thread-55059::INFO::2014-05-16 17:58:27,908::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55059::INFO::2014-05-16 17:58:27,908::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55059::DEBUG::2014-05-16 17:58:27,908::task::1168::TaskManager.Task::(prepare) Task=`a3bd8714-27bb-4ca6-b788-539b9c29e2d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55059::DEBUG::2014-05-16 17:58:27,908::task::579::TaskManager.Task::(_updateState) Task=`a3bd8714-27bb-4ca6-b788-539b9c29e2d3`::moving from state preparing -> state finished >Thread-55059::DEBUG::2014-05-16 17:58:27,908::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55059::DEBUG::2014-05-16 17:58:27,909::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55059::DEBUG::2014-05-16 17:58:27,909::task::974::TaskManager.Task::(_decref) Task=`a3bd8714-27bb-4ca6-b788-539b9c29e2d3`::ref 0 aborting False >Thread-55060::DEBUG::2014-05-16 17:58:27,918::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55060::DEBUG::2014-05-16 17:58:27,919::task::579::TaskManager.Task::(_updateState) Task=`ff0bc702-1ddd-4589-a78a-32781f521e12`::moving from state init -> state preparing >Thread-55060::INFO::2014-05-16 17:58:27,919::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55060::DEBUG::2014-05-16 17:58:27,919::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b2567a27-d5ad-4c88-868e-a92eb97daa83`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55060::DEBUG::2014-05-16 17:58:27,919::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55060::DEBUG::2014-05-16 17:58:27,920::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55060::DEBUG::2014-05-16 17:58:27,920::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b2567a27-d5ad-4c88-868e-a92eb97daa83`::Granted request >Thread-55060::DEBUG::2014-05-16 17:58:27,920::task::811::TaskManager.Task::(resourceAcquired) Task=`ff0bc702-1ddd-4589-a78a-32781f521e12`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55060::DEBUG::2014-05-16 17:58:27,920::task::974::TaskManager.Task::(_decref) Task=`ff0bc702-1ddd-4589-a78a-32781f521e12`::ref 1 aborting False >Thread-55060::INFO::2014-05-16 17:58:27,921::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55060::DEBUG::2014-05-16 17:58:27,921::task::1168::TaskManager.Task::(prepare) Task=`ff0bc702-1ddd-4589-a78a-32781f521e12`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55060::DEBUG::2014-05-16 17:58:27,921::task::579::TaskManager.Task::(_updateState) Task=`ff0bc702-1ddd-4589-a78a-32781f521e12`::moving from state preparing -> state finished >Thread-55060::DEBUG::2014-05-16 17:58:27,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55060::DEBUG::2014-05-16 17:58:27,921::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55060::DEBUG::2014-05-16 17:58:27,922::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55060::DEBUG::2014-05-16 17:58:27,922::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55060::DEBUG::2014-05-16 17:58:27,922::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55060::DEBUG::2014-05-16 17:58:27,922::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55060::DEBUG::2014-05-16 17:58:27,922::task::974::TaskManager.Task::(_decref) Task=`ff0bc702-1ddd-4589-a78a-32781f521e12`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:58:28,663::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:28,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307187 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:30,741::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:30,809::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308735 s, 33.2 MB/s\n'; <rc> = 0 >Thread-55062::DEBUG::2014-05-16 17:58:31,254::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5416777.000000 / 8.008879 / 262500000.000000 = 0.257656 >Thread-55062::DEBUG::2014-05-16 17:58:31,254::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0067426118270498313, 'statsAge': 0.35862994194030762, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25765579790543697, 'rxDropped': 0} >Thread-55062::DEBUG::2014-05-16 17:58:31,255::task::579::TaskManager.Task::(_updateState) Task=`f1f61ab5-ccac-4512-b51b-2d1635c26b01`::moving from state init -> state preparing >Thread-55062::INFO::2014-05-16 17:58:31,255::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55062::INFO::2014-05-16 17:58:31,255::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000901645', 'lastCheck': '6.9', 'valid': True}} >Thread-55062::DEBUG::2014-05-16 17:58:31,256::task::1168::TaskManager.Task::(prepare) Task=`f1f61ab5-ccac-4512-b51b-2d1635c26b01`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000901645', 'lastCheck': '6.9', 'valid': True}} >Thread-55062::DEBUG::2014-05-16 17:58:31,256::task::579::TaskManager.Task::(_updateState) Task=`f1f61ab5-ccac-4512-b51b-2d1635c26b01`::moving from state preparing -> state finished >Thread-55062::DEBUG::2014-05-16 17:58:31,256::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55062::DEBUG::2014-05-16 17:58:31,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55062::DEBUG::2014-05-16 17:58:31,256::task::974::TaskManager.Task::(_decref) Task=`f1f61ab5-ccac-4512-b51b-2d1635c26b01`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:58:32,820::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:32,892::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358561 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:58:34,417::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:58:34,428::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105404 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:34,908::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:34,978::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344004 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:36,990::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:37,062::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356938 s, 28.7 MB/s\n'; <rc> = 0 >Thread-55066::DEBUG::2014-05-16 17:58:37,996::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55066::DEBUG::2014-05-16 17:58:37,997::task::579::TaskManager.Task::(_updateState) Task=`bbf1305a-d140-46bb-b339-ce61a952e801`::moving from state init -> state preparing >Thread-55066::INFO::2014-05-16 17:58:37,997::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55066::INFO::2014-05-16 17:58:37,997::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55066::DEBUG::2014-05-16 17:58:37,997::task::1168::TaskManager.Task::(prepare) Task=`bbf1305a-d140-46bb-b339-ce61a952e801`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55066::DEBUG::2014-05-16 17:58:37,997::task::579::TaskManager.Task::(_updateState) Task=`bbf1305a-d140-46bb-b339-ce61a952e801`::moving from state preparing -> state finished >Thread-55066::DEBUG::2014-05-16 17:58:37,998::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55066::DEBUG::2014-05-16 17:58:37,998::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55066::DEBUG::2014-05-16 17:58:37,998::task::974::TaskManager.Task::(_decref) Task=`bbf1305a-d140-46bb-b339-ce61a952e801`::ref 0 aborting False >Thread-55067::DEBUG::2014-05-16 17:58:38,006::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55067::DEBUG::2014-05-16 17:58:38,007::task::579::TaskManager.Task::(_updateState) Task=`ff95dd17-a629-4517-ae35-1e6df85d0e68`::moving from state init -> state preparing >Thread-55067::INFO::2014-05-16 17:58:38,007::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55067::DEBUG::2014-05-16 17:58:38,007::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`afa62e50-ec32-47ce-a703-5c8040030443`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55067::DEBUG::2014-05-16 17:58:38,007::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55067::DEBUG::2014-05-16 17:58:38,008::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55067::DEBUG::2014-05-16 17:58:38,008::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`afa62e50-ec32-47ce-a703-5c8040030443`::Granted request >Thread-55067::DEBUG::2014-05-16 17:58:38,009::task::811::TaskManager.Task::(resourceAcquired) Task=`ff95dd17-a629-4517-ae35-1e6df85d0e68`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55067::DEBUG::2014-05-16 17:58:38,009::task::974::TaskManager.Task::(_decref) Task=`ff95dd17-a629-4517-ae35-1e6df85d0e68`::ref 1 aborting False >Thread-55067::INFO::2014-05-16 17:58:38,010::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55067::DEBUG::2014-05-16 17:58:38,010::task::1168::TaskManager.Task::(prepare) Task=`ff95dd17-a629-4517-ae35-1e6df85d0e68`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55067::DEBUG::2014-05-16 17:58:38,010::task::579::TaskManager.Task::(_updateState) Task=`ff95dd17-a629-4517-ae35-1e6df85d0e68`::moving from state preparing -> state finished >Thread-55067::DEBUG::2014-05-16 17:58:38,010::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55067::DEBUG::2014-05-16 17:58:38,010::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55067::DEBUG::2014-05-16 17:58:38,011::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55067::DEBUG::2014-05-16 17:58:38,011::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55067::DEBUG::2014-05-16 17:58:38,011::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55067::DEBUG::2014-05-16 17:58:38,011::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55067::DEBUG::2014-05-16 17:58:38,011::task::974::TaskManager.Task::(_decref) Task=`ff95dd17-a629-4517-ae35-1e6df85d0e68`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:58:39,073::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:39,140::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310527 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:41,152::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:41,223::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347584 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:43,236::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:43,376::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.104156 s, 9.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:58:44,465::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:58:44,475::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728576 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:45,387::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:45,454::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030809 s, 33.2 MB/s\n'; <rc> = 0 >Thread-55070::DEBUG::2014-05-16 17:58:46,445::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318062.000000 / 8.008448 / 262500000.000000 = 0.205405 >Thread-55070::DEBUG::2014-05-16 17:58:46,446::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053687116696885173, 'statsAge': 1.5326220989227295, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20540509515903088, 'rxDropped': 0} >Thread-55070::DEBUG::2014-05-16 17:58:46,446::task::579::TaskManager.Task::(_updateState) Task=`f73855eb-046d-4ea5-8b92-c38c1f4ad377`::moving from state init -> state preparing >Thread-55070::INFO::2014-05-16 17:58:46,446::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55070::INFO::2014-05-16 17:58:46,447::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728576', 'lastCheck': '2.0', 'valid': True}} >Thread-55070::DEBUG::2014-05-16 17:58:46,447::task::1168::TaskManager.Task::(prepare) Task=`f73855eb-046d-4ea5-8b92-c38c1f4ad377`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728576', 'lastCheck': '2.0', 'valid': True}} >Thread-55070::DEBUG::2014-05-16 17:58:46,447::task::579::TaskManager.Task::(_updateState) Task=`f73855eb-046d-4ea5-8b92-c38c1f4ad377`::moving from state preparing -> state finished >Thread-55070::DEBUG::2014-05-16 17:58:46,447::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55070::DEBUG::2014-05-16 17:58:46,447::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55070::DEBUG::2014-05-16 17:58:46,447::task::974::TaskManager.Task::(_decref) Task=`f73855eb-046d-4ea5-8b92-c38c1f4ad377`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:58:47,465::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:47,537::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348116 s, 29.4 MB/s\n'; <rc> = 0 >Thread-55072::DEBUG::2014-05-16 17:58:48,049::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55072::DEBUG::2014-05-16 17:58:48,050::task::579::TaskManager.Task::(_updateState) Task=`91465706-3844-45a2-a286-3761b5cd6217`::moving from state init -> state preparing >Thread-55072::INFO::2014-05-16 17:58:48,050::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55072::INFO::2014-05-16 17:58:48,050::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55072::DEBUG::2014-05-16 17:58:48,051::task::1168::TaskManager.Task::(prepare) Task=`91465706-3844-45a2-a286-3761b5cd6217`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55072::DEBUG::2014-05-16 17:58:48,051::task::579::TaskManager.Task::(_updateState) Task=`91465706-3844-45a2-a286-3761b5cd6217`::moving from state preparing -> state finished >Thread-55072::DEBUG::2014-05-16 17:58:48,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55072::DEBUG::2014-05-16 17:58:48,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55072::DEBUG::2014-05-16 17:58:48,051::task::974::TaskManager.Task::(_decref) Task=`91465706-3844-45a2-a286-3761b5cd6217`::ref 0 aborting False >Thread-55073::DEBUG::2014-05-16 17:58:48,059::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55073::DEBUG::2014-05-16 17:58:48,060::task::579::TaskManager.Task::(_updateState) Task=`245ec306-face-446c-84c2-657cf8e9f1ef`::moving from state init -> state preparing >Thread-55073::INFO::2014-05-16 17:58:48,060::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55073::DEBUG::2014-05-16 17:58:48,060::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b8ee3bfe-70e0-4bac-9405-9014d4ccd9c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55073::DEBUG::2014-05-16 17:58:48,060::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55073::DEBUG::2014-05-16 17:58:48,061::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55073::DEBUG::2014-05-16 17:58:48,061::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b8ee3bfe-70e0-4bac-9405-9014d4ccd9c5`::Granted request >Thread-55073::DEBUG::2014-05-16 17:58:48,061::task::811::TaskManager.Task::(resourceAcquired) Task=`245ec306-face-446c-84c2-657cf8e9f1ef`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55073::DEBUG::2014-05-16 17:58:48,061::task::974::TaskManager.Task::(_decref) Task=`245ec306-face-446c-84c2-657cf8e9f1ef`::ref 1 aborting False >Thread-55073::INFO::2014-05-16 17:58:48,062::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55073::DEBUG::2014-05-16 17:58:48,062::task::1168::TaskManager.Task::(prepare) Task=`245ec306-face-446c-84c2-657cf8e9f1ef`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55073::DEBUG::2014-05-16 17:58:48,062::task::579::TaskManager.Task::(_updateState) Task=`245ec306-face-446c-84c2-657cf8e9f1ef`::moving from state preparing -> state finished >Thread-55073::DEBUG::2014-05-16 17:58:48,062::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55073::DEBUG::2014-05-16 17:58:48,062::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55073::DEBUG::2014-05-16 17:58:48,063::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55073::DEBUG::2014-05-16 17:58:48,063::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55073::DEBUG::2014-05-16 17:58:48,063::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55073::DEBUG::2014-05-16 17:58:48,063::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55073::DEBUG::2014-05-16 17:58:48,063::task::974::TaskManager.Task::(_decref) Task=`245ec306-face-446c-84c2-657cf8e9f1ef`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:58:49,549::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:49,615::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297436 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:51,627::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:51,699::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363521 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:53,711::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:53,783::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359315 s, 28.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:58:54,510::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:58:54,520::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000830559 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:55,795::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:55,867::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354886 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:58:57,879::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:58:57,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317348 s, 32.3 MB/s\n'; <rc> = 0 >Thread-55077::DEBUG::2014-05-16 17:58:58,145::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55077::DEBUG::2014-05-16 17:58:58,145::task::579::TaskManager.Task::(_updateState) Task=`970cbe3e-aa62-4976-b130-1b67479fe2dc`::moving from state init -> state preparing >Thread-55077::INFO::2014-05-16 17:58:58,146::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55077::INFO::2014-05-16 17:58:58,146::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55077::DEBUG::2014-05-16 17:58:58,146::task::1168::TaskManager.Task::(prepare) Task=`970cbe3e-aa62-4976-b130-1b67479fe2dc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55077::DEBUG::2014-05-16 17:58:58,146::task::579::TaskManager.Task::(_updateState) Task=`970cbe3e-aa62-4976-b130-1b67479fe2dc`::moving from state preparing -> state finished >Thread-55077::DEBUG::2014-05-16 17:58:58,146::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55077::DEBUG::2014-05-16 17:58:58,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55077::DEBUG::2014-05-16 17:58:58,147::task::974::TaskManager.Task::(_decref) Task=`970cbe3e-aa62-4976-b130-1b67479fe2dc`::ref 0 aborting False >Thread-55078::DEBUG::2014-05-16 17:58:58,156::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55078::DEBUG::2014-05-16 17:58:58,156::task::579::TaskManager.Task::(_updateState) Task=`2beb7eaf-64b9-4153-b507-ed3e67e18601`::moving from state init -> state preparing >Thread-55078::INFO::2014-05-16 17:58:58,157::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55078::DEBUG::2014-05-16 17:58:58,157::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fe53387a-1a30-4343-989e-9b75abd34eb5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55078::DEBUG::2014-05-16 17:58:58,157::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55078::DEBUG::2014-05-16 17:58:58,157::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55078::DEBUG::2014-05-16 17:58:58,158::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fe53387a-1a30-4343-989e-9b75abd34eb5`::Granted request >Thread-55078::DEBUG::2014-05-16 17:58:58,158::task::811::TaskManager.Task::(resourceAcquired) Task=`2beb7eaf-64b9-4153-b507-ed3e67e18601`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55078::DEBUG::2014-05-16 17:58:58,158::task::974::TaskManager.Task::(_decref) Task=`2beb7eaf-64b9-4153-b507-ed3e67e18601`::ref 1 aborting False >Thread-55078::INFO::2014-05-16 17:58:58,159::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55078::DEBUG::2014-05-16 17:58:58,159::task::1168::TaskManager.Task::(prepare) Task=`2beb7eaf-64b9-4153-b507-ed3e67e18601`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55078::DEBUG::2014-05-16 17:58:58,159::task::579::TaskManager.Task::(_updateState) Task=`2beb7eaf-64b9-4153-b507-ed3e67e18601`::moving from state preparing -> state finished >Thread-55078::DEBUG::2014-05-16 17:58:58,159::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55078::DEBUG::2014-05-16 17:58:58,159::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55078::DEBUG::2014-05-16 17:58:58,160::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55078::DEBUG::2014-05-16 17:58:58,160::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55078::DEBUG::2014-05-16 17:58:58,160::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55078::DEBUG::2014-05-16 17:58:58,160::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55078::DEBUG::2014-05-16 17:58:58,160::task::974::TaskManager.Task::(_decref) Task=`2beb7eaf-64b9-4153-b507-ed3e67e18601`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:58:59,958::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:00,026::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311289 s, 32.9 MB/s\n'; <rc> = 0 >Thread-55080::DEBUG::2014-05-16 17:59:01,628::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316330.000000 / 8.008707 / 262500000.000000 = 0.205316 >Thread-55080::DEBUG::2014-05-16 17:59:01,628::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005316880034903845, 'statsAge': 0.69772505760192871, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20531606785943773, 'rxDropped': 0} >Thread-55080::DEBUG::2014-05-16 17:59:01,629::task::579::TaskManager.Task::(_updateState) Task=`bcaeee4c-74bf-4755-897c-fb653151e9ea`::moving from state init -> state preparing >Thread-55080::INFO::2014-05-16 17:59:01,629::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55080::INFO::2014-05-16 17:59:01,629::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830559', 'lastCheck': '7.1', 'valid': True}} >Thread-55080::DEBUG::2014-05-16 17:59:01,629::task::1168::TaskManager.Task::(prepare) Task=`bcaeee4c-74bf-4755-897c-fb653151e9ea`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830559', 'lastCheck': '7.1', 'valid': True}} >Thread-55080::DEBUG::2014-05-16 17:59:01,629::task::579::TaskManager.Task::(_updateState) Task=`bcaeee4c-74bf-4755-897c-fb653151e9ea`::moving from state preparing -> state finished >Thread-55080::DEBUG::2014-05-16 17:59:01,629::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55080::DEBUG::2014-05-16 17:59:01,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55080::DEBUG::2014-05-16 17:59:01,630::task::974::TaskManager.Task::(_decref) Task=`bcaeee4c-74bf-4755-897c-fb653151e9ea`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:59:02,038::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:02,109::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360206 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:04,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:04,189::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314594 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:59:04,557::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:59:04,567::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000850669 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:06,200::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:06,268::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314381 s, 32.6 MB/s\n'; <rc> = 0 >Thread-55084::DEBUG::2014-05-16 17:59:08,193::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55084::DEBUG::2014-05-16 17:59:08,193::task::579::TaskManager.Task::(_updateState) Task=`09a54c6e-304e-4184-ac28-973a430cb5aa`::moving from state init -> state preparing >Thread-55084::INFO::2014-05-16 17:59:08,194::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55084::INFO::2014-05-16 17:59:08,194::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55084::DEBUG::2014-05-16 17:59:08,194::task::1168::TaskManager.Task::(prepare) Task=`09a54c6e-304e-4184-ac28-973a430cb5aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55084::DEBUG::2014-05-16 17:59:08,194::task::579::TaskManager.Task::(_updateState) Task=`09a54c6e-304e-4184-ac28-973a430cb5aa`::moving from state preparing -> state finished >Thread-55084::DEBUG::2014-05-16 17:59:08,194::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55084::DEBUG::2014-05-16 17:59:08,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55084::DEBUG::2014-05-16 17:59:08,195::task::974::TaskManager.Task::(_decref) Task=`09a54c6e-304e-4184-ac28-973a430cb5aa`::ref 0 aborting False >Thread-55085::DEBUG::2014-05-16 17:59:08,203::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55085::DEBUG::2014-05-16 17:59:08,203::task::579::TaskManager.Task::(_updateState) Task=`a9a059be-a3f7-42f9-8477-8ee96491996f`::moving from state init -> state preparing >Thread-55085::INFO::2014-05-16 17:59:08,203::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55085::DEBUG::2014-05-16 17:59:08,203::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8ab7beca-6443-413c-b179-d8f6e5213263`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55085::DEBUG::2014-05-16 17:59:08,204::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55085::DEBUG::2014-05-16 17:59:08,204::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55085::DEBUG::2014-05-16 17:59:08,204::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8ab7beca-6443-413c-b179-d8f6e5213263`::Granted request >Thread-55085::DEBUG::2014-05-16 17:59:08,204::task::811::TaskManager.Task::(resourceAcquired) Task=`a9a059be-a3f7-42f9-8477-8ee96491996f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55085::DEBUG::2014-05-16 17:59:08,205::task::974::TaskManager.Task::(_decref) Task=`a9a059be-a3f7-42f9-8477-8ee96491996f`::ref 1 aborting False >Thread-55085::INFO::2014-05-16 17:59:08,205::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55085::DEBUG::2014-05-16 17:59:08,205::task::1168::TaskManager.Task::(prepare) Task=`a9a059be-a3f7-42f9-8477-8ee96491996f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55085::DEBUG::2014-05-16 17:59:08,206::task::579::TaskManager.Task::(_updateState) Task=`a9a059be-a3f7-42f9-8477-8ee96491996f`::moving from state preparing -> state finished >Thread-55085::DEBUG::2014-05-16 17:59:08,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55085::DEBUG::2014-05-16 17:59:08,206::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55085::DEBUG::2014-05-16 17:59:08,206::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55085::DEBUG::2014-05-16 17:59:08,206::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55085::DEBUG::2014-05-16 17:59:08,206::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55085::DEBUG::2014-05-16 17:59:08,207::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55085::DEBUG::2014-05-16 17:59:08,207::task::974::TaskManager.Task::(_decref) Task=`a9a059be-a3f7-42f9-8477-8ee96491996f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:59:08,280::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:08,351::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358276 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:10,363::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:10,431::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030487 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:12,442::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:12,510::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313409 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:14,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 17:59:14,711::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:59:14,739::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749389 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:14,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421407 s, 24.3 MB/s\n'; <rc> = 0 >Thread-55088::DEBUG::2014-05-16 17:59:16,784::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5422149.000000 / 8.008663 / 262500000.000000 = 0.257918 >Thread-55088::DEBUG::2014-05-16 17:59:16,784::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066390964532775159, 'statsAge': 1.8382790088653564, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25791828013528667, 'rxDropped': 0} >Thread-55088::DEBUG::2014-05-16 17:59:16,784::task::579::TaskManager.Task::(_updateState) Task=`375f03fa-c146-459c-a1ac-e9f2609a2493`::moving from state init -> state preparing >Thread-55088::INFO::2014-05-16 17:59:16,785::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55088::INFO::2014-05-16 17:59:16,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749389', 'lastCheck': '2.0', 'valid': True}} >Thread-55088::DEBUG::2014-05-16 17:59:16,785::task::1168::TaskManager.Task::(prepare) Task=`375f03fa-c146-459c-a1ac-e9f2609a2493`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749389', 'lastCheck': '2.0', 'valid': True}} >Thread-55088::DEBUG::2014-05-16 17:59:16,785::task::579::TaskManager.Task::(_updateState) Task=`375f03fa-c146-459c-a1ac-e9f2609a2493`::moving from state preparing -> state finished >Thread-55088::DEBUG::2014-05-16 17:59:16,785::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55088::DEBUG::2014-05-16 17:59:16,785::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55088::DEBUG::2014-05-16 17:59:16,786::task::974::TaskManager.Task::(_decref) Task=`375f03fa-c146-459c-a1ac-e9f2609a2493`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:59:16,841::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:16,913::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352497 s, 29.0 MB/s\n'; <rc> = 0 >Thread-55090::DEBUG::2014-05-16 17:59:18,240::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55090::DEBUG::2014-05-16 17:59:18,240::task::579::TaskManager.Task::(_updateState) Task=`496d8f14-559b-47f7-b30d-b04d3a570710`::moving from state init -> state preparing >Thread-55090::INFO::2014-05-16 17:59:18,240::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55090::INFO::2014-05-16 17:59:18,240::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55090::DEBUG::2014-05-16 17:59:18,241::task::1168::TaskManager.Task::(prepare) Task=`496d8f14-559b-47f7-b30d-b04d3a570710`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55090::DEBUG::2014-05-16 17:59:18,241::task::579::TaskManager.Task::(_updateState) Task=`496d8f14-559b-47f7-b30d-b04d3a570710`::moving from state preparing -> state finished >Thread-55090::DEBUG::2014-05-16 17:59:18,241::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55090::DEBUG::2014-05-16 17:59:18,241::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55090::DEBUG::2014-05-16 17:59:18,241::task::974::TaskManager.Task::(_decref) Task=`496d8f14-559b-47f7-b30d-b04d3a570710`::ref 0 aborting False >Thread-55091::DEBUG::2014-05-16 17:59:18,250::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55091::DEBUG::2014-05-16 17:59:18,250::task::579::TaskManager.Task::(_updateState) Task=`344dd245-6713-4612-a705-1a4a48d61850`::moving from state init -> state preparing >Thread-55091::INFO::2014-05-16 17:59:18,250::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55091::DEBUG::2014-05-16 17:59:18,251::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`feffa367-7053-4be0-a8c2-c73edb53a8e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55091::DEBUG::2014-05-16 17:59:18,251::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55091::DEBUG::2014-05-16 17:59:18,251::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55091::DEBUG::2014-05-16 17:59:18,251::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`feffa367-7053-4be0-a8c2-c73edb53a8e0`::Granted request >Thread-55091::DEBUG::2014-05-16 17:59:18,252::task::811::TaskManager.Task::(resourceAcquired) Task=`344dd245-6713-4612-a705-1a4a48d61850`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55091::DEBUG::2014-05-16 17:59:18,252::task::974::TaskManager.Task::(_decref) Task=`344dd245-6713-4612-a705-1a4a48d61850`::ref 1 aborting False >Thread-55091::INFO::2014-05-16 17:59:18,252::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55091::DEBUG::2014-05-16 17:59:18,252::task::1168::TaskManager.Task::(prepare) Task=`344dd245-6713-4612-a705-1a4a48d61850`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55091::DEBUG::2014-05-16 17:59:18,253::task::579::TaskManager.Task::(_updateState) Task=`344dd245-6713-4612-a705-1a4a48d61850`::moving from state preparing -> state finished >Thread-55091::DEBUG::2014-05-16 17:59:18,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55091::DEBUG::2014-05-16 17:59:18,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55091::DEBUG::2014-05-16 17:59:18,253::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55091::DEBUG::2014-05-16 17:59:18,253::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55091::DEBUG::2014-05-16 17:59:18,253::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55091::DEBUG::2014-05-16 17:59:18,253::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55091::DEBUG::2014-05-16 17:59:18,254::task::974::TaskManager.Task::(_decref) Task=`344dd245-6713-4612-a705-1a4a48d61850`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:59:18,925::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:18,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339311 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:21,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:21,075::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309484 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:23,087::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:23,158::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355273 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:59:24,848::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:59:24,859::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102966 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:25,170::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:25,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034582 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:27,252::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:27,321::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321887 s, 31.8 MB/s\n'; <rc> = 0 >Thread-55095::DEBUG::2014-05-16 17:59:28,283::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55095::DEBUG::2014-05-16 17:59:28,284::task::579::TaskManager.Task::(_updateState) Task=`b8de6c16-2e08-4c97-9722-cc4ff3a2883a`::moving from state init -> state preparing >Thread-55095::INFO::2014-05-16 17:59:28,284::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55095::INFO::2014-05-16 17:59:28,284::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55095::DEBUG::2014-05-16 17:59:28,285::task::1168::TaskManager.Task::(prepare) Task=`b8de6c16-2e08-4c97-9722-cc4ff3a2883a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55095::DEBUG::2014-05-16 17:59:28,285::task::579::TaskManager.Task::(_updateState) Task=`b8de6c16-2e08-4c97-9722-cc4ff3a2883a`::moving from state preparing -> state finished >Thread-55095::DEBUG::2014-05-16 17:59:28,285::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55095::DEBUG::2014-05-16 17:59:28,285::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55095::DEBUG::2014-05-16 17:59:28,285::task::974::TaskManager.Task::(_decref) Task=`b8de6c16-2e08-4c97-9722-cc4ff3a2883a`::ref 0 aborting False >Thread-55096::DEBUG::2014-05-16 17:59:28,308::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55096::DEBUG::2014-05-16 17:59:28,308::task::579::TaskManager.Task::(_updateState) Task=`6d72cb76-6e49-41a8-8cc5-0e0eb0b618d0`::moving from state init -> state preparing >Thread-55096::INFO::2014-05-16 17:59:28,308::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55096::DEBUG::2014-05-16 17:59:28,308::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`382560e0-ebfc-433f-a775-9835c1950ad9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55096::DEBUG::2014-05-16 17:59:28,309::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55096::DEBUG::2014-05-16 17:59:28,309::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55096::DEBUG::2014-05-16 17:59:28,309::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`382560e0-ebfc-433f-a775-9835c1950ad9`::Granted request >Thread-55096::DEBUG::2014-05-16 17:59:28,309::task::811::TaskManager.Task::(resourceAcquired) Task=`6d72cb76-6e49-41a8-8cc5-0e0eb0b618d0`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55096::DEBUG::2014-05-16 17:59:28,310::task::974::TaskManager.Task::(_decref) Task=`6d72cb76-6e49-41a8-8cc5-0e0eb0b618d0`::ref 1 aborting False >Thread-55096::INFO::2014-05-16 17:59:28,310::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55096::DEBUG::2014-05-16 17:59:28,310::task::1168::TaskManager.Task::(prepare) Task=`6d72cb76-6e49-41a8-8cc5-0e0eb0b618d0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55096::DEBUG::2014-05-16 17:59:28,311::task::579::TaskManager.Task::(_updateState) Task=`6d72cb76-6e49-41a8-8cc5-0e0eb0b618d0`::moving from state preparing -> state finished >Thread-55096::DEBUG::2014-05-16 17:59:28,311::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55096::DEBUG::2014-05-16 17:59:28,311::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55096::DEBUG::2014-05-16 17:59:28,311::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55096::DEBUG::2014-05-16 17:59:28,311::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55096::DEBUG::2014-05-16 17:59:28,311::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55096::DEBUG::2014-05-16 17:59:28,312::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55096::DEBUG::2014-05-16 17:59:28,312::task::974::TaskManager.Task::(_decref) Task=`6d72cb76-6e49-41a8-8cc5-0e0eb0b618d0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:59:29,332::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:29,404::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356591 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:31,416::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:31,492::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309234 s, 33.1 MB/s\n'; <rc> = 0 >Thread-55098::DEBUG::2014-05-16 17:59:31,960::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5420348.000000 / 8.008551 / 262500000.000000 = 0.257836 >Thread-55098::DEBUG::2014-05-16 17:59:31,961::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066442313802237384, 'statsAge': 0.99634790420532227, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25783621095185338, 'rxDropped': 0} >Thread-55098::DEBUG::2014-05-16 17:59:31,961::task::579::TaskManager.Task::(_updateState) Task=`73ed01fa-c31b-4e28-b23e-33fa64df3e26`::moving from state init -> state preparing >Thread-55098::INFO::2014-05-16 17:59:31,961::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55098::INFO::2014-05-16 17:59:31,962::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102966', 'lastCheck': '7.1', 'valid': True}} >Thread-55098::DEBUG::2014-05-16 17:59:31,962::task::1168::TaskManager.Task::(prepare) Task=`73ed01fa-c31b-4e28-b23e-33fa64df3e26`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102966', 'lastCheck': '7.1', 'valid': True}} >Thread-55098::DEBUG::2014-05-16 17:59:31,962::task::579::TaskManager.Task::(_updateState) Task=`73ed01fa-c31b-4e28-b23e-33fa64df3e26`::moving from state preparing -> state finished >Thread-55098::DEBUG::2014-05-16 17:59:31,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55098::DEBUG::2014-05-16 17:59:31,962::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55098::DEBUG::2014-05-16 17:59:31,962::task::974::TaskManager.Task::(_decref) Task=`73ed01fa-c31b-4e28-b23e-33fa64df3e26`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:59:33,504::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:33,571::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315537 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:59:34,896::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:59:34,906::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104079 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:35,583::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:35,654::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350481 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:37,666::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:37,737::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359016 s, 28.5 MB/s\n'; <rc> = 0 >Thread-55102::DEBUG::2014-05-16 17:59:38,350::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55102::DEBUG::2014-05-16 17:59:38,350::task::579::TaskManager.Task::(_updateState) Task=`d9b57754-6542-4250-a10f-ecad64750b28`::moving from state init -> state preparing >Thread-55102::INFO::2014-05-16 17:59:38,350::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55102::INFO::2014-05-16 17:59:38,351::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55102::DEBUG::2014-05-16 17:59:38,351::task::1168::TaskManager.Task::(prepare) Task=`d9b57754-6542-4250-a10f-ecad64750b28`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55102::DEBUG::2014-05-16 17:59:38,351::task::579::TaskManager.Task::(_updateState) Task=`d9b57754-6542-4250-a10f-ecad64750b28`::moving from state preparing -> state finished >Thread-55102::DEBUG::2014-05-16 17:59:38,351::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55102::DEBUG::2014-05-16 17:59:38,351::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55102::DEBUG::2014-05-16 17:59:38,351::task::974::TaskManager.Task::(_decref) Task=`d9b57754-6542-4250-a10f-ecad64750b28`::ref 0 aborting False >Thread-55103::DEBUG::2014-05-16 17:59:38,361::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55103::DEBUG::2014-05-16 17:59:38,361::task::579::TaskManager.Task::(_updateState) Task=`c07233d6-ae95-4468-a5e0-16262fc134b7`::moving from state init -> state preparing >Thread-55103::INFO::2014-05-16 17:59:38,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55103::DEBUG::2014-05-16 17:59:38,361::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6ff1033a-7a75-4078-9ee4-af356d8c483f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55103::DEBUG::2014-05-16 17:59:38,362::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55103::DEBUG::2014-05-16 17:59:38,362::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55103::DEBUG::2014-05-16 17:59:38,362::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6ff1033a-7a75-4078-9ee4-af356d8c483f`::Granted request >Thread-55103::DEBUG::2014-05-16 17:59:38,362::task::811::TaskManager.Task::(resourceAcquired) Task=`c07233d6-ae95-4468-a5e0-16262fc134b7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55103::DEBUG::2014-05-16 17:59:38,363::task::974::TaskManager.Task::(_decref) Task=`c07233d6-ae95-4468-a5e0-16262fc134b7`::ref 1 aborting False >Thread-55103::INFO::2014-05-16 17:59:38,364::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55103::DEBUG::2014-05-16 17:59:38,364::task::1168::TaskManager.Task::(prepare) Task=`c07233d6-ae95-4468-a5e0-16262fc134b7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55103::DEBUG::2014-05-16 17:59:38,364::task::579::TaskManager.Task::(_updateState) Task=`c07233d6-ae95-4468-a5e0-16262fc134b7`::moving from state preparing -> state finished >Thread-55103::DEBUG::2014-05-16 17:59:38,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55103::DEBUG::2014-05-16 17:59:38,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55103::DEBUG::2014-05-16 17:59:38,364::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55103::DEBUG::2014-05-16 17:59:38,365::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55103::DEBUG::2014-05-16 17:59:38,365::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55103::DEBUG::2014-05-16 17:59:38,365::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55103::DEBUG::2014-05-16 17:59:38,365::task::974::TaskManager.Task::(_decref) Task=`c07233d6-ae95-4468-a5e0-16262fc134b7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:59:39,749::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:39,817::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032255 s, 31.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:41,829::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:41,901::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363947 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:43,913::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:43,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304151 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:59:44,944::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:59:44,954::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000867096 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:45,991::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:46,075::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470744 s, 21.8 MB/s\n'; <rc> = 0 >Thread-55106::DEBUG::2014-05-16 17:59:47,150::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314709.000000 / 8.008440 / 262500000.000000 = 0.205246 >Thread-55106::DEBUG::2014-05-16 17:59:47,151::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0050689379735085142, 'statsAge': 0.1694788932800293, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20524579856173936, 'rxDropped': 0} >Thread-55106::DEBUG::2014-05-16 17:59:47,151::task::579::TaskManager.Task::(_updateState) Task=`e171525d-b219-4a00-a86c-da2d2162da56`::moving from state init -> state preparing >Thread-55106::INFO::2014-05-16 17:59:47,152::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55106::INFO::2014-05-16 17:59:47,152::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000867096', 'lastCheck': '2.2', 'valid': True}} >Thread-55106::DEBUG::2014-05-16 17:59:47,152::task::1168::TaskManager.Task::(prepare) Task=`e171525d-b219-4a00-a86c-da2d2162da56`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000867096', 'lastCheck': '2.2', 'valid': True}} >Thread-55106::DEBUG::2014-05-16 17:59:47,152::task::579::TaskManager.Task::(_updateState) Task=`e171525d-b219-4a00-a86c-da2d2162da56`::moving from state preparing -> state finished >Thread-55106::DEBUG::2014-05-16 17:59:47,152::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55106::DEBUG::2014-05-16 17:59:47,152::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55106::DEBUG::2014-05-16 17:59:47,153::task::974::TaskManager.Task::(_decref) Task=`e171525d-b219-4a00-a86c-da2d2162da56`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:59:48,086::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:48,154::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316387 s, 32.4 MB/s\n'; <rc> = 0 >Thread-55108::DEBUG::2014-05-16 17:59:48,420::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55108::DEBUG::2014-05-16 17:59:48,420::task::579::TaskManager.Task::(_updateState) Task=`55aaa50d-8519-4df7-808a-cdfd003ca14d`::moving from state init -> state preparing >Thread-55108::INFO::2014-05-16 17:59:48,420::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55108::INFO::2014-05-16 17:59:48,421::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55108::DEBUG::2014-05-16 17:59:48,421::task::1168::TaskManager.Task::(prepare) Task=`55aaa50d-8519-4df7-808a-cdfd003ca14d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55108::DEBUG::2014-05-16 17:59:48,421::task::579::TaskManager.Task::(_updateState) Task=`55aaa50d-8519-4df7-808a-cdfd003ca14d`::moving from state preparing -> state finished >Thread-55108::DEBUG::2014-05-16 17:59:48,421::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55108::DEBUG::2014-05-16 17:59:48,421::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55108::DEBUG::2014-05-16 17:59:48,422::task::974::TaskManager.Task::(_decref) Task=`55aaa50d-8519-4df7-808a-cdfd003ca14d`::ref 0 aborting False >Thread-55109::DEBUG::2014-05-16 17:59:48,431::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55109::DEBUG::2014-05-16 17:59:48,431::task::579::TaskManager.Task::(_updateState) Task=`aec6b285-4e94-457d-8349-2940694d56f4`::moving from state init -> state preparing >Thread-55109::INFO::2014-05-16 17:59:48,431::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55109::DEBUG::2014-05-16 17:59:48,431::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a85a9f16-bec3-4a9c-9973-ef8daa25b659`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55109::DEBUG::2014-05-16 17:59:48,432::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55109::DEBUG::2014-05-16 17:59:48,432::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55109::DEBUG::2014-05-16 17:59:48,432::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a85a9f16-bec3-4a9c-9973-ef8daa25b659`::Granted request >Thread-55109::DEBUG::2014-05-16 17:59:48,432::task::811::TaskManager.Task::(resourceAcquired) Task=`aec6b285-4e94-457d-8349-2940694d56f4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55109::DEBUG::2014-05-16 17:59:48,432::task::974::TaskManager.Task::(_decref) Task=`aec6b285-4e94-457d-8349-2940694d56f4`::ref 1 aborting False >Thread-55109::INFO::2014-05-16 17:59:48,433::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55109::DEBUG::2014-05-16 17:59:48,433::task::1168::TaskManager.Task::(prepare) Task=`aec6b285-4e94-457d-8349-2940694d56f4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55109::DEBUG::2014-05-16 17:59:48,433::task::579::TaskManager.Task::(_updateState) Task=`aec6b285-4e94-457d-8349-2940694d56f4`::moving from state preparing -> state finished >Thread-55109::DEBUG::2014-05-16 17:59:48,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55109::DEBUG::2014-05-16 17:59:48,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55109::DEBUG::2014-05-16 17:59:48,434::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55109::DEBUG::2014-05-16 17:59:48,434::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55109::DEBUG::2014-05-16 17:59:48,434::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55109::DEBUG::2014-05-16 17:59:48,434::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55109::DEBUG::2014-05-16 17:59:48,435::task::974::TaskManager.Task::(_decref) Task=`aec6b285-4e94-457d-8349-2940694d56f4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:59:50,165::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:50,243::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347397 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:52,255::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:52,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354972 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:54,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:54,405::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031431 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 17:59:54,996::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 17:59:55,006::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000787737 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 17:59:56,417::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:56,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347388 s, 29.5 MB/s\n'; <rc> = 0 >Thread-55113::DEBUG::2014-05-16 17:59:58,460::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55113::DEBUG::2014-05-16 17:59:58,461::task::579::TaskManager.Task::(_updateState) Task=`b859c64f-3cab-4706-875a-bc50a6ca2c30`::moving from state init -> state preparing >Thread-55113::INFO::2014-05-16 17:59:58,461::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55113::INFO::2014-05-16 17:59:58,461::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55113::DEBUG::2014-05-16 17:59:58,461::task::1168::TaskManager.Task::(prepare) Task=`b859c64f-3cab-4706-875a-bc50a6ca2c30`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55113::DEBUG::2014-05-16 17:59:58,462::task::579::TaskManager.Task::(_updateState) Task=`b859c64f-3cab-4706-875a-bc50a6ca2c30`::moving from state preparing -> state finished >Thread-55113::DEBUG::2014-05-16 17:59:58,462::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55113::DEBUG::2014-05-16 17:59:58,462::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55113::DEBUG::2014-05-16 17:59:58,462::task::974::TaskManager.Task::(_decref) Task=`b859c64f-3cab-4706-875a-bc50a6ca2c30`::ref 0 aborting False >Thread-55114::DEBUG::2014-05-16 17:59:58,471::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55114::DEBUG::2014-05-16 17:59:58,471::task::579::TaskManager.Task::(_updateState) Task=`d488c549-3f39-4a8d-8595-59994f9405dc`::moving from state init -> state preparing >Thread-55114::INFO::2014-05-16 17:59:58,471::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55114::DEBUG::2014-05-16 17:59:58,471::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`aa6eb3ee-9374-4a47-a5d5-027096863fe6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55114::DEBUG::2014-05-16 17:59:58,471::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55114::DEBUG::2014-05-16 17:59:58,472::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55114::DEBUG::2014-05-16 17:59:58,472::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`aa6eb3ee-9374-4a47-a5d5-027096863fe6`::Granted request >Thread-55114::DEBUG::2014-05-16 17:59:58,472::task::811::TaskManager.Task::(resourceAcquired) Task=`d488c549-3f39-4a8d-8595-59994f9405dc`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55114::DEBUG::2014-05-16 17:59:58,472::task::974::TaskManager.Task::(_decref) Task=`d488c549-3f39-4a8d-8595-59994f9405dc`::ref 1 aborting False >Thread-55114::INFO::2014-05-16 17:59:58,473::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55114::DEBUG::2014-05-16 17:59:58,473::task::1168::TaskManager.Task::(prepare) Task=`d488c549-3f39-4a8d-8595-59994f9405dc`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55114::DEBUG::2014-05-16 17:59:58,473::task::579::TaskManager.Task::(_updateState) Task=`d488c549-3f39-4a8d-8595-59994f9405dc`::moving from state preparing -> state finished >Thread-55114::DEBUG::2014-05-16 17:59:58,473::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55114::DEBUG::2014-05-16 17:59:58,473::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55114::DEBUG::2014-05-16 17:59:58,473::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55114::DEBUG::2014-05-16 17:59:58,474::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55114::DEBUG::2014-05-16 17:59:58,474::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55114::DEBUG::2014-05-16 17:59:58,474::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55114::DEBUG::2014-05-16 17:59:58,474::task::974::TaskManager.Task::(_decref) Task=`d488c549-3f39-4a8d-8595-59994f9405dc`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 17:59:58,499::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 17:59:58,568::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318501 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:00,580::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:00,647::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311508 s, 32.9 MB/s\n'; <rc> = 0 >Thread-55116::DEBUG::2014-05-16 18:00:02,317::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315353.000000 / 8.011905 / 262500000.000000 = 0.205188 >Thread-55116::DEBUG::2014-05-16 18:00:02,322::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053892182951374382, 'statsAge': 1.3176231384277344, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20518765627548682, 'rxDropped': 0} >Thread-55116::DEBUG::2014-05-16 18:00:02,323::task::579::TaskManager.Task::(_updateState) Task=`fead1a88-ee6c-45c6-acb5-e1616948065f`::moving from state init -> state preparing >Thread-55116::INFO::2014-05-16 18:00:02,323::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55116::INFO::2014-05-16 18:00:02,323::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787737', 'lastCheck': '7.3', 'valid': True}} >Thread-55116::DEBUG::2014-05-16 18:00:02,323::task::1168::TaskManager.Task::(prepare) Task=`fead1a88-ee6c-45c6-acb5-e1616948065f`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787737', 'lastCheck': '7.3', 'valid': True}} >Thread-55116::DEBUG::2014-05-16 18:00:02,323::task::579::TaskManager.Task::(_updateState) Task=`fead1a88-ee6c-45c6-acb5-e1616948065f`::moving from state preparing -> state finished >Thread-55116::DEBUG::2014-05-16 18:00:02,324::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55116::DEBUG::2014-05-16 18:00:02,324::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55116::DEBUG::2014-05-16 18:00:02,324::task::974::TaskManager.Task::(_decref) Task=`fead1a88-ee6c-45c6-acb5-e1616948065f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:00:02,659::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:02,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357706 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:04,743::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:04,812::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308754 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:00:05,045::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:00:05,056::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734811 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:06,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:06,896::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355816 s, 28.8 MB/s\n'; <rc> = 0 >Thread-55120::DEBUG::2014-05-16 18:00:08,549::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55120::DEBUG::2014-05-16 18:00:08,550::task::579::TaskManager.Task::(_updateState) Task=`cfe4a4e6-ecd6-4244-81c3-f20f9ab9903e`::moving from state init -> state preparing >Thread-55120::INFO::2014-05-16 18:00:08,550::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55120::INFO::2014-05-16 18:00:08,550::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55120::DEBUG::2014-05-16 18:00:08,551::task::1168::TaskManager.Task::(prepare) Task=`cfe4a4e6-ecd6-4244-81c3-f20f9ab9903e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55120::DEBUG::2014-05-16 18:00:08,551::task::579::TaskManager.Task::(_updateState) Task=`cfe4a4e6-ecd6-4244-81c3-f20f9ab9903e`::moving from state preparing -> state finished >Thread-55120::DEBUG::2014-05-16 18:00:08,551::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55120::DEBUG::2014-05-16 18:00:08,551::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55120::DEBUG::2014-05-16 18:00:08,551::task::974::TaskManager.Task::(_decref) Task=`cfe4a4e6-ecd6-4244-81c3-f20f9ab9903e`::ref 0 aborting False >Thread-55121::DEBUG::2014-05-16 18:00:08,560::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55121::DEBUG::2014-05-16 18:00:08,560::task::579::TaskManager.Task::(_updateState) Task=`306a11f1-65e3-4547-884a-448dc638dfe0`::moving from state init -> state preparing >Thread-55121::INFO::2014-05-16 18:00:08,561::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55121::DEBUG::2014-05-16 18:00:08,561::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`eb81f922-7da5-4bf2-99fe-a6218c06ed69`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55121::DEBUG::2014-05-16 18:00:08,561::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55121::DEBUG::2014-05-16 18:00:08,561::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55121::DEBUG::2014-05-16 18:00:08,562::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`eb81f922-7da5-4bf2-99fe-a6218c06ed69`::Granted request >Thread-55121::DEBUG::2014-05-16 18:00:08,562::task::811::TaskManager.Task::(resourceAcquired) Task=`306a11f1-65e3-4547-884a-448dc638dfe0`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55121::DEBUG::2014-05-16 18:00:08,562::task::974::TaskManager.Task::(_decref) Task=`306a11f1-65e3-4547-884a-448dc638dfe0`::ref 1 aborting False >Thread-55121::INFO::2014-05-16 18:00:08,563::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55121::DEBUG::2014-05-16 18:00:08,563::task::1168::TaskManager.Task::(prepare) Task=`306a11f1-65e3-4547-884a-448dc638dfe0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55121::DEBUG::2014-05-16 18:00:08,563::task::579::TaskManager.Task::(_updateState) Task=`306a11f1-65e3-4547-884a-448dc638dfe0`::moving from state preparing -> state finished >Thread-55121::DEBUG::2014-05-16 18:00:08,563::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55121::DEBUG::2014-05-16 18:00:08,563::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55121::DEBUG::2014-05-16 18:00:08,564::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55121::DEBUG::2014-05-16 18:00:08,564::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55121::DEBUG::2014-05-16 18:00:08,564::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55121::DEBUG::2014-05-16 18:00:08,564::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55121::DEBUG::2014-05-16 18:00:08,564::task::974::TaskManager.Task::(_decref) Task=`306a11f1-65e3-4547-884a-448dc638dfe0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:00:08,907::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:08,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354958 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:10,990::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:11,061::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330539 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:13,073::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:13,141::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322419 s, 31.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:00:15,096::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:00:15,107::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109283 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:15,153::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:15,223::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348975 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:17,235::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:17,309::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364174 s, 28.1 MB/s\n'; <rc> = 0 >Thread-55124::DEBUG::2014-05-16 18:00:17,500::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5420366.000000 / 8.010474 / 262500000.000000 = 0.257775 >Thread-55124::DEBUG::2014-05-16 18:00:17,500::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065556073792277791, 'statsAge': 0.48048901557922363, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25777516792202543, 'rxDropped': 0} >Thread-55124::DEBUG::2014-05-16 18:00:17,501::task::579::TaskManager.Task::(_updateState) Task=`ad97a95c-f00c-4227-81dc-8525a945a38b`::moving from state init -> state preparing >Thread-55124::INFO::2014-05-16 18:00:17,501::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55124::INFO::2014-05-16 18:00:17,501::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109283', 'lastCheck': '2.4', 'valid': True}} >Thread-55124::DEBUG::2014-05-16 18:00:17,501::task::1168::TaskManager.Task::(prepare) Task=`ad97a95c-f00c-4227-81dc-8525a945a38b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109283', 'lastCheck': '2.4', 'valid': True}} >Thread-55124::DEBUG::2014-05-16 18:00:17,501::task::579::TaskManager.Task::(_updateState) Task=`ad97a95c-f00c-4227-81dc-8525a945a38b`::moving from state preparing -> state finished >Thread-55124::DEBUG::2014-05-16 18:00:17,502::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55124::DEBUG::2014-05-16 18:00:17,502::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55124::DEBUG::2014-05-16 18:00:17,502::task::974::TaskManager.Task::(_decref) Task=`ad97a95c-f00c-4227-81dc-8525a945a38b`::ref 0 aborting False >Thread-55126::DEBUG::2014-05-16 18:00:18,632::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55126::DEBUG::2014-05-16 18:00:18,632::task::579::TaskManager.Task::(_updateState) Task=`30739768-482e-4430-9167-f8619639be1e`::moving from state init -> state preparing >Thread-55126::INFO::2014-05-16 18:00:18,632::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55126::INFO::2014-05-16 18:00:18,633::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55126::DEBUG::2014-05-16 18:00:18,633::task::1168::TaskManager.Task::(prepare) Task=`30739768-482e-4430-9167-f8619639be1e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55126::DEBUG::2014-05-16 18:00:18,633::task::579::TaskManager.Task::(_updateState) Task=`30739768-482e-4430-9167-f8619639be1e`::moving from state preparing -> state finished >Thread-55126::DEBUG::2014-05-16 18:00:18,633::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55126::DEBUG::2014-05-16 18:00:18,633::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55126::DEBUG::2014-05-16 18:00:18,633::task::974::TaskManager.Task::(_decref) Task=`30739768-482e-4430-9167-f8619639be1e`::ref 0 aborting False >Thread-55127::DEBUG::2014-05-16 18:00:18,652::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55127::DEBUG::2014-05-16 18:00:18,652::task::579::TaskManager.Task::(_updateState) Task=`249e6fd0-1688-45e2-ba73-8ad8d321dfeb`::moving from state init -> state preparing >Thread-55127::INFO::2014-05-16 18:00:18,652::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55127::DEBUG::2014-05-16 18:00:18,653::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`59a888f0-b96b-40fc-8f38-d164ff159098`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55127::DEBUG::2014-05-16 18:00:18,653::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55127::DEBUG::2014-05-16 18:00:18,653::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55127::DEBUG::2014-05-16 18:00:18,653::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`59a888f0-b96b-40fc-8f38-d164ff159098`::Granted request >Thread-55127::DEBUG::2014-05-16 18:00:18,654::task::811::TaskManager.Task::(resourceAcquired) Task=`249e6fd0-1688-45e2-ba73-8ad8d321dfeb`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55127::DEBUG::2014-05-16 18:00:18,654::task::974::TaskManager.Task::(_decref) Task=`249e6fd0-1688-45e2-ba73-8ad8d321dfeb`::ref 1 aborting False >Thread-55127::INFO::2014-05-16 18:00:18,654::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55127::DEBUG::2014-05-16 18:00:18,654::task::1168::TaskManager.Task::(prepare) Task=`249e6fd0-1688-45e2-ba73-8ad8d321dfeb`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55127::DEBUG::2014-05-16 18:00:18,655::task::579::TaskManager.Task::(_updateState) Task=`249e6fd0-1688-45e2-ba73-8ad8d321dfeb`::moving from state preparing -> state finished >Thread-55127::DEBUG::2014-05-16 18:00:18,655::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55127::DEBUG::2014-05-16 18:00:18,655::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55127::DEBUG::2014-05-16 18:00:18,655::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55127::DEBUG::2014-05-16 18:00:18,655::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55127::DEBUG::2014-05-16 18:00:18,655::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55127::DEBUG::2014-05-16 18:00:18,655::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55127::DEBUG::2014-05-16 18:00:18,656::task::974::TaskManager.Task::(_decref) Task=`249e6fd0-1688-45e2-ba73-8ad8d321dfeb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:00:19,321::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:19,388::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030914 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:21,399::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:21,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309908 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:23,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:23,550::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359454 s, 28.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:00:25,140::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:00:25,151::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000894488 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:25,561::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:25,632::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350753 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:27,644::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:27,711::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314074 s, 32.6 MB/s\n'; <rc> = 0 >Thread-55131::DEBUG::2014-05-16 18:00:28,683::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55131::DEBUG::2014-05-16 18:00:28,684::task::579::TaskManager.Task::(_updateState) Task=`a7788e64-4e09-43f7-af66-7f6bfe5582d2`::moving from state init -> state preparing >Thread-55131::INFO::2014-05-16 18:00:28,684::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55131::INFO::2014-05-16 18:00:28,684::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55131::DEBUG::2014-05-16 18:00:28,685::task::1168::TaskManager.Task::(prepare) Task=`a7788e64-4e09-43f7-af66-7f6bfe5582d2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55131::DEBUG::2014-05-16 18:00:28,685::task::579::TaskManager.Task::(_updateState) Task=`a7788e64-4e09-43f7-af66-7f6bfe5582d2`::moving from state preparing -> state finished >Thread-55131::DEBUG::2014-05-16 18:00:28,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55131::DEBUG::2014-05-16 18:00:28,685::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55131::DEBUG::2014-05-16 18:00:28,685::task::974::TaskManager.Task::(_decref) Task=`a7788e64-4e09-43f7-af66-7f6bfe5582d2`::ref 0 aborting False >Thread-55132::DEBUG::2014-05-16 18:00:28,694::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55132::DEBUG::2014-05-16 18:00:28,694::task::579::TaskManager.Task::(_updateState) Task=`7c23a64b-469b-4622-a155-b4774dcdfe0d`::moving from state init -> state preparing >Thread-55132::INFO::2014-05-16 18:00:28,694::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55132::DEBUG::2014-05-16 18:00:28,695::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dd326ac9-a4d5-42b7-9034-0f46c0dfb74c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55132::DEBUG::2014-05-16 18:00:28,695::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55132::DEBUG::2014-05-16 18:00:28,695::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55132::DEBUG::2014-05-16 18:00:28,695::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dd326ac9-a4d5-42b7-9034-0f46c0dfb74c`::Granted request >Thread-55132::DEBUG::2014-05-16 18:00:28,696::task::811::TaskManager.Task::(resourceAcquired) Task=`7c23a64b-469b-4622-a155-b4774dcdfe0d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55132::DEBUG::2014-05-16 18:00:28,696::task::974::TaskManager.Task::(_decref) Task=`7c23a64b-469b-4622-a155-b4774dcdfe0d`::ref 1 aborting False >Thread-55132::INFO::2014-05-16 18:00:28,696::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55132::DEBUG::2014-05-16 18:00:28,697::task::1168::TaskManager.Task::(prepare) Task=`7c23a64b-469b-4622-a155-b4774dcdfe0d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55132::DEBUG::2014-05-16 18:00:28,697::task::579::TaskManager.Task::(_updateState) Task=`7c23a64b-469b-4622-a155-b4774dcdfe0d`::moving from state preparing -> state finished >Thread-55132::DEBUG::2014-05-16 18:00:28,697::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55132::DEBUG::2014-05-16 18:00:28,697::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55132::DEBUG::2014-05-16 18:00:28,697::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55132::DEBUG::2014-05-16 18:00:28,697::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55132::DEBUG::2014-05-16 18:00:28,698::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55132::DEBUG::2014-05-16 18:00:28,698::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55132::DEBUG::2014-05-16 18:00:28,698::task::974::TaskManager.Task::(_decref) Task=`7c23a64b-469b-4622-a155-b4774dcdfe0d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:00:29,723::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:29,794::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353555 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:31,806::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:31,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344527 s, 29.7 MB/s\n'; <rc> = 0 >Thread-55134::DEBUG::2014-05-16 18:00:32,690::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317434.000000 / 8.008450 / 262500000.000000 = 0.205375 >Thread-55134::DEBUG::2014-05-16 18:00:32,690::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053723254602264956, 'statsAge': 1.6557250022888184, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20537516691501106, 'rxDropped': 0} >Thread-55134::DEBUG::2014-05-16 18:00:32,690::task::579::TaskManager.Task::(_updateState) Task=`fe32d800-49cb-47fc-83b4-ac3e042c730c`::moving from state init -> state preparing >Thread-55134::INFO::2014-05-16 18:00:32,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55134::INFO::2014-05-16 18:00:32,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000894488', 'lastCheck': '7.5', 'valid': True}} >Thread-55134::DEBUG::2014-05-16 18:00:32,691::task::1168::TaskManager.Task::(prepare) Task=`fe32d800-49cb-47fc-83b4-ac3e042c730c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000894488', 'lastCheck': '7.5', 'valid': True}} >Thread-55134::DEBUG::2014-05-16 18:00:32,691::task::579::TaskManager.Task::(_updateState) Task=`fe32d800-49cb-47fc-83b4-ac3e042c730c`::moving from state preparing -> state finished >Thread-55134::DEBUG::2014-05-16 18:00:32,691::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55134::DEBUG::2014-05-16 18:00:32,692::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55134::DEBUG::2014-05-16 18:00:32,692::task::974::TaskManager.Task::(_decref) Task=`fe32d800-49cb-47fc-83b4-ac3e042c730c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:00:33,888::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:33,956::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316789 s, 32.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:00:35,187::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:00:35,197::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011254 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:35,967::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:36,039::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035501 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:38,051::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:38,123::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361155 s, 28.4 MB/s\n'; <rc> = 0 >Thread-55137::DEBUG::2014-05-16 18:00:38,755::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55137::DEBUG::2014-05-16 18:00:38,755::task::579::TaskManager.Task::(_updateState) Task=`45c9920d-9534-49a8-a835-e9a8b698540c`::moving from state init -> state preparing >Thread-55137::INFO::2014-05-16 18:00:38,755::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55137::INFO::2014-05-16 18:00:38,756::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55137::DEBUG::2014-05-16 18:00:38,756::task::1168::TaskManager.Task::(prepare) Task=`45c9920d-9534-49a8-a835-e9a8b698540c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55137::DEBUG::2014-05-16 18:00:38,756::task::579::TaskManager.Task::(_updateState) Task=`45c9920d-9534-49a8-a835-e9a8b698540c`::moving from state preparing -> state finished >Thread-55137::DEBUG::2014-05-16 18:00:38,756::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55137::DEBUG::2014-05-16 18:00:38,756::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55137::DEBUG::2014-05-16 18:00:38,756::task::974::TaskManager.Task::(_decref) Task=`45c9920d-9534-49a8-a835-e9a8b698540c`::ref 0 aborting False >Thread-55138::DEBUG::2014-05-16 18:00:38,766::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55138::DEBUG::2014-05-16 18:00:38,766::task::579::TaskManager.Task::(_updateState) Task=`18acd358-5a91-494b-b0fc-64f6fb437f54`::moving from state init -> state preparing >Thread-55138::INFO::2014-05-16 18:00:38,766::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55138::DEBUG::2014-05-16 18:00:38,766::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dff5f32b-dfb9-4074-8e3d-1e1abbae61b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55138::DEBUG::2014-05-16 18:00:38,767::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55138::DEBUG::2014-05-16 18:00:38,767::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55138::DEBUG::2014-05-16 18:00:38,767::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dff5f32b-dfb9-4074-8e3d-1e1abbae61b6`::Granted request >Thread-55138::DEBUG::2014-05-16 18:00:38,767::task::811::TaskManager.Task::(resourceAcquired) Task=`18acd358-5a91-494b-b0fc-64f6fb437f54`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55138::DEBUG::2014-05-16 18:00:38,767::task::974::TaskManager.Task::(_decref) Task=`18acd358-5a91-494b-b0fc-64f6fb437f54`::ref 1 aborting False >Thread-55138::INFO::2014-05-16 18:00:38,768::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55138::DEBUG::2014-05-16 18:00:38,768::task::1168::TaskManager.Task::(prepare) Task=`18acd358-5a91-494b-b0fc-64f6fb437f54`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55138::DEBUG::2014-05-16 18:00:38,768::task::579::TaskManager.Task::(_updateState) Task=`18acd358-5a91-494b-b0fc-64f6fb437f54`::moving from state preparing -> state finished >Thread-55138::DEBUG::2014-05-16 18:00:38,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55138::DEBUG::2014-05-16 18:00:38,769::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55138::DEBUG::2014-05-16 18:00:38,769::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55138::DEBUG::2014-05-16 18:00:38,769::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55138::DEBUG::2014-05-16 18:00:38,769::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55138::DEBUG::2014-05-16 18:00:38,769::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55138::DEBUG::2014-05-16 18:00:38,770::task::974::TaskManager.Task::(_decref) Task=`18acd358-5a91-494b-b0fc-64f6fb437f54`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:00:40,135::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:40,202::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314076 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:42,214::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:42,281::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311011 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:44,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:44,363::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346595 s, 29.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:00:45,232::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:00:45,242::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000586302 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:46,376::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:46,447::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355962 s, 28.8 MB/s\n'; <rc> = 0 >Thread-55142::DEBUG::2014-05-16 18:00:48,235::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316379.000000 / 8.008616 / 262500000.000000 = 0.205321 >Thread-55142::DEBUG::2014-05-16 18:00:48,235::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053690271013447834, 'statsAge': 1.1835939884185791, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20532072747362473, 'rxDropped': 0} >Thread-55142::DEBUG::2014-05-16 18:00:48,235::task::579::TaskManager.Task::(_updateState) Task=`604332b4-d870-4e53-a1be-fbc1068eb4c2`::moving from state init -> state preparing >Thread-55142::INFO::2014-05-16 18:00:48,236::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55142::INFO::2014-05-16 18:00:48,236::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586302', 'lastCheck': '3.0', 'valid': True}} >Thread-55142::DEBUG::2014-05-16 18:00:48,236::task::1168::TaskManager.Task::(prepare) Task=`604332b4-d870-4e53-a1be-fbc1068eb4c2`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586302', 'lastCheck': '3.0', 'valid': True}} >Thread-55142::DEBUG::2014-05-16 18:00:48,236::task::579::TaskManager.Task::(_updateState) Task=`604332b4-d870-4e53-a1be-fbc1068eb4c2`::moving from state preparing -> state finished >Thread-55142::DEBUG::2014-05-16 18:00:48,236::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55142::DEBUG::2014-05-16 18:00:48,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55142::DEBUG::2014-05-16 18:00:48,237::task::974::TaskManager.Task::(_decref) Task=`604332b4-d870-4e53-a1be-fbc1068eb4c2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:00:48,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:48,529::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340555 s, 30.1 MB/s\n'; <rc> = 0 >Thread-55144::DEBUG::2014-05-16 18:00:48,897::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55144::DEBUG::2014-05-16 18:00:48,897::task::579::TaskManager.Task::(_updateState) Task=`5ea51baa-7185-47f6-8964-4727421e4041`::moving from state init -> state preparing >Thread-55144::INFO::2014-05-16 18:00:48,898::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55144::INFO::2014-05-16 18:00:48,898::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55144::DEBUG::2014-05-16 18:00:48,898::task::1168::TaskManager.Task::(prepare) Task=`5ea51baa-7185-47f6-8964-4727421e4041`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55144::DEBUG::2014-05-16 18:00:48,898::task::579::TaskManager.Task::(_updateState) Task=`5ea51baa-7185-47f6-8964-4727421e4041`::moving from state preparing -> state finished >Thread-55144::DEBUG::2014-05-16 18:00:48,898::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55144::DEBUG::2014-05-16 18:00:48,898::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55144::DEBUG::2014-05-16 18:00:48,899::task::974::TaskManager.Task::(_decref) Task=`5ea51baa-7185-47f6-8964-4727421e4041`::ref 0 aborting False >Thread-55145::DEBUG::2014-05-16 18:00:48,907::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55145::DEBUG::2014-05-16 18:00:48,908::task::579::TaskManager.Task::(_updateState) Task=`64833bf0-cb59-41a5-96c3-6583b83a2e43`::moving from state init -> state preparing >Thread-55145::INFO::2014-05-16 18:00:48,908::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55145::DEBUG::2014-05-16 18:00:48,908::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1ed22cbf-768e-4b95-a59e-7422ce39fee4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55145::DEBUG::2014-05-16 18:00:48,908::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55145::DEBUG::2014-05-16 18:00:48,909::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55145::DEBUG::2014-05-16 18:00:48,909::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1ed22cbf-768e-4b95-a59e-7422ce39fee4`::Granted request >Thread-55145::DEBUG::2014-05-16 18:00:48,909::task::811::TaskManager.Task::(resourceAcquired) Task=`64833bf0-cb59-41a5-96c3-6583b83a2e43`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55145::DEBUG::2014-05-16 18:00:48,909::task::974::TaskManager.Task::(_decref) Task=`64833bf0-cb59-41a5-96c3-6583b83a2e43`::ref 1 aborting False >Thread-55145::INFO::2014-05-16 18:00:48,910::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55145::DEBUG::2014-05-16 18:00:48,910::task::1168::TaskManager.Task::(prepare) Task=`64833bf0-cb59-41a5-96c3-6583b83a2e43`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55145::DEBUG::2014-05-16 18:00:48,910::task::579::TaskManager.Task::(_updateState) Task=`64833bf0-cb59-41a5-96c3-6583b83a2e43`::moving from state preparing -> state finished >Thread-55145::DEBUG::2014-05-16 18:00:48,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55145::DEBUG::2014-05-16 18:00:48,911::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55145::DEBUG::2014-05-16 18:00:48,911::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55145::DEBUG::2014-05-16 18:00:48,911::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55145::DEBUG::2014-05-16 18:00:48,911::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55145::DEBUG::2014-05-16 18:00:48,911::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55145::DEBUG::2014-05-16 18:00:48,911::task::974::TaskManager.Task::(_decref) Task=`64833bf0-cb59-41a5-96c3-6583b83a2e43`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:00:50,540::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:50,611::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352433 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:52,623::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:52,693::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343368 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:54,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:54,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031308 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:00:55,280::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:00:55,290::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000804928 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:56,784::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:56,862::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352661 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:00:58,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:00:58,945::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317246 s, 32.3 MB/s\n'; <rc> = 0 >Thread-55149::DEBUG::2014-05-16 18:00:59,035::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55149::DEBUG::2014-05-16 18:00:59,035::task::579::TaskManager.Task::(_updateState) Task=`df5d6a2b-75f7-4f62-901b-1be3b1d2028d`::moving from state init -> state preparing >Thread-55149::INFO::2014-05-16 18:00:59,036::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55149::INFO::2014-05-16 18:00:59,036::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55149::DEBUG::2014-05-16 18:00:59,036::task::1168::TaskManager.Task::(prepare) Task=`df5d6a2b-75f7-4f62-901b-1be3b1d2028d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55149::DEBUG::2014-05-16 18:00:59,036::task::579::TaskManager.Task::(_updateState) Task=`df5d6a2b-75f7-4f62-901b-1be3b1d2028d`::moving from state preparing -> state finished >Thread-55149::DEBUG::2014-05-16 18:00:59,036::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55149::DEBUG::2014-05-16 18:00:59,037::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55149::DEBUG::2014-05-16 18:00:59,037::task::974::TaskManager.Task::(_decref) Task=`df5d6a2b-75f7-4f62-901b-1be3b1d2028d`::ref 0 aborting False >Thread-55150::DEBUG::2014-05-16 18:00:59,064::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55150::DEBUG::2014-05-16 18:00:59,065::task::579::TaskManager.Task::(_updateState) Task=`533f8675-8482-4ec4-b485-30058801fa38`::moving from state init -> state preparing >Thread-55150::INFO::2014-05-16 18:00:59,066::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55150::DEBUG::2014-05-16 18:00:59,068::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`af450081-6e73-4d8d-93a7-0406771267bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55150::DEBUG::2014-05-16 18:00:59,068::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55150::DEBUG::2014-05-16 18:00:59,069::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55150::DEBUG::2014-05-16 18:00:59,070::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`af450081-6e73-4d8d-93a7-0406771267bd`::Granted request >Thread-55150::DEBUG::2014-05-16 18:00:59,070::task::811::TaskManager.Task::(resourceAcquired) Task=`533f8675-8482-4ec4-b485-30058801fa38`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55150::DEBUG::2014-05-16 18:00:59,070::task::974::TaskManager.Task::(_decref) Task=`533f8675-8482-4ec4-b485-30058801fa38`::ref 1 aborting False >Thread-55150::INFO::2014-05-16 18:00:59,071::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55150::DEBUG::2014-05-16 18:00:59,071::task::1168::TaskManager.Task::(prepare) Task=`533f8675-8482-4ec4-b485-30058801fa38`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55150::DEBUG::2014-05-16 18:00:59,071::task::579::TaskManager.Task::(_updateState) Task=`533f8675-8482-4ec4-b485-30058801fa38`::moving from state preparing -> state finished >Thread-55150::DEBUG::2014-05-16 18:00:59,071::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55150::DEBUG::2014-05-16 18:00:59,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55150::DEBUG::2014-05-16 18:00:59,072::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55150::DEBUG::2014-05-16 18:00:59,072::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55150::DEBUG::2014-05-16 18:00:59,072::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55150::DEBUG::2014-05-16 18:00:59,072::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55150::DEBUG::2014-05-16 18:00:59,072::task::974::TaskManager.Task::(_decref) Task=`533f8675-8482-4ec4-b485-30058801fa38`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:01:00,956::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:01,023::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308279 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:03,035::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:03,111::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409414 s, 25.0 MB/s\n'; <rc> = 0 >Thread-55152::DEBUG::2014-05-16 18:01:04,654::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3245042.000000 / 8.012169 / 262500000.000000 = 0.154291 >Thread-55152::DEBUG::2014-05-16 18:01:04,654::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0040901593678780027, 'statsAge': 1.5822970867156982, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15429111568233944, 'rxDropped': 0} >Thread-55152::DEBUG::2014-05-16 18:01:04,655::task::579::TaskManager.Task::(_updateState) Task=`52c0cabf-7b1b-4a25-a2fb-209b2f1d033a`::moving from state init -> state preparing >Thread-55152::INFO::2014-05-16 18:01:04,655::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55152::INFO::2014-05-16 18:01:04,655::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000804928', 'lastCheck': '9.3', 'valid': True}} >Thread-55152::DEBUG::2014-05-16 18:01:04,655::task::1168::TaskManager.Task::(prepare) Task=`52c0cabf-7b1b-4a25-a2fb-209b2f1d033a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000804928', 'lastCheck': '9.3', 'valid': True}} >Thread-55152::DEBUG::2014-05-16 18:01:04,656::task::579::TaskManager.Task::(_updateState) Task=`52c0cabf-7b1b-4a25-a2fb-209b2f1d033a`::moving from state preparing -> state finished >Thread-55152::DEBUG::2014-05-16 18:01:04,656::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55152::DEBUG::2014-05-16 18:01:04,656::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55152::DEBUG::2014-05-16 18:01:04,656::task::974::TaskManager.Task::(_decref) Task=`52c0cabf-7b1b-4a25-a2fb-209b2f1d033a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:01:05,118::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:05,186::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313773 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:01:05,328::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:01:05,338::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000773983 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:07,197::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:07,269::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352312 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:09,281::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:09,348::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313559 s, 32.7 MB/s\n'; <rc> = 0 >Thread-55154::DEBUG::2014-05-16 18:01:09,458::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55154::DEBUG::2014-05-16 18:01:09,458::task::579::TaskManager.Task::(_updateState) Task=`e16e846e-c2e4-44c9-b9c0-dea1a6743509`::moving from state init -> state preparing >Thread-55154::INFO::2014-05-16 18:01:09,458::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55154::INFO::2014-05-16 18:01:09,459::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55154::DEBUG::2014-05-16 18:01:09,459::task::1168::TaskManager.Task::(prepare) Task=`e16e846e-c2e4-44c9-b9c0-dea1a6743509`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55154::DEBUG::2014-05-16 18:01:09,459::task::579::TaskManager.Task::(_updateState) Task=`e16e846e-c2e4-44c9-b9c0-dea1a6743509`::moving from state preparing -> state finished >Thread-55154::DEBUG::2014-05-16 18:01:09,459::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55154::DEBUG::2014-05-16 18:01:09,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55154::DEBUG::2014-05-16 18:01:09,459::task::974::TaskManager.Task::(_decref) Task=`e16e846e-c2e4-44c9-b9c0-dea1a6743509`::ref 0 aborting False >Thread-55155::DEBUG::2014-05-16 18:01:09,956::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55155::DEBUG::2014-05-16 18:01:09,957::task::579::TaskManager.Task::(_updateState) Task=`bf2972e4-42fc-4c99-9918-99fc382da2a5`::moving from state init -> state preparing >Thread-55155::INFO::2014-05-16 18:01:09,957::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55155::DEBUG::2014-05-16 18:01:09,958::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9a21a1e1-e171-4a4e-9938-ae6420d68167`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55155::DEBUG::2014-05-16 18:01:09,958::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55155::DEBUG::2014-05-16 18:01:09,958::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55155::DEBUG::2014-05-16 18:01:09,958::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9a21a1e1-e171-4a4e-9938-ae6420d68167`::Granted request >Thread-55155::DEBUG::2014-05-16 18:01:09,959::task::811::TaskManager.Task::(resourceAcquired) Task=`bf2972e4-42fc-4c99-9918-99fc382da2a5`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55155::DEBUG::2014-05-16 18:01:09,959::task::974::TaskManager.Task::(_decref) Task=`bf2972e4-42fc-4c99-9918-99fc382da2a5`::ref 1 aborting False >Thread-55155::INFO::2014-05-16 18:01:09,959::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55155::DEBUG::2014-05-16 18:01:09,960::task::1168::TaskManager.Task::(prepare) Task=`bf2972e4-42fc-4c99-9918-99fc382da2a5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55155::DEBUG::2014-05-16 18:01:09,960::task::579::TaskManager.Task::(_updateState) Task=`bf2972e4-42fc-4c99-9918-99fc382da2a5`::moving from state preparing -> state finished >Thread-55155::DEBUG::2014-05-16 18:01:09,960::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55155::DEBUG::2014-05-16 18:01:09,960::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55155::DEBUG::2014-05-16 18:01:09,960::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55155::DEBUG::2014-05-16 18:01:09,960::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55155::DEBUG::2014-05-16 18:01:09,961::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55155::DEBUG::2014-05-16 18:01:09,961::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55155::DEBUG::2014-05-16 18:01:09,961::task::974::TaskManager.Task::(_decref) Task=`bf2972e4-42fc-4c99-9918-99fc382da2a5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:01:11,359::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:11,437::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408946 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:13,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:13,516::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303177 s, 33.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:01:15,373::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:01:15,383::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00098202 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:15,528::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:15,599::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346286 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:17,611::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:17,688::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349711 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:19,700::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:19,768::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308464 s, 33.2 MB/s\n'; <rc> = 0 >Thread-55159::DEBUG::2014-05-16 18:01:20,679::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55159::DEBUG::2014-05-16 18:01:20,680::task::579::TaskManager.Task::(_updateState) Task=`b1182605-173c-4860-b89f-e813bf2ab453`::moving from state init -> state preparing >Thread-55159::INFO::2014-05-16 18:01:20,680::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55159::INFO::2014-05-16 18:01:20,680::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55159::DEBUG::2014-05-16 18:01:20,680::task::1168::TaskManager.Task::(prepare) Task=`b1182605-173c-4860-b89f-e813bf2ab453`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55159::DEBUG::2014-05-16 18:01:20,681::task::579::TaskManager.Task::(_updateState) Task=`b1182605-173c-4860-b89f-e813bf2ab453`::moving from state preparing -> state finished >Thread-55159::DEBUG::2014-05-16 18:01:20,681::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55159::DEBUG::2014-05-16 18:01:20,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55159::DEBUG::2014-05-16 18:01:20,681::task::974::TaskManager.Task::(_decref) Task=`b1182605-173c-4860-b89f-e813bf2ab453`::ref 0 aborting False >Thread-55160::DEBUG::2014-05-16 18:01:20,705::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55160::DEBUG::2014-05-16 18:01:20,706::task::579::TaskManager.Task::(_updateState) Task=`2de4bd97-b9e2-41b6-b826-e5286d5a6815`::moving from state init -> state preparing >Thread-55160::INFO::2014-05-16 18:01:20,706::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55160::DEBUG::2014-05-16 18:01:20,706::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`636d4cd5-e10a-4fbf-ab51-ba575f7c6c05`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55160::DEBUG::2014-05-16 18:01:20,706::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55160::DEBUG::2014-05-16 18:01:20,706::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55160::DEBUG::2014-05-16 18:01:20,707::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`636d4cd5-e10a-4fbf-ab51-ba575f7c6c05`::Granted request >Thread-55160::DEBUG::2014-05-16 18:01:20,707::task::811::TaskManager.Task::(resourceAcquired) Task=`2de4bd97-b9e2-41b6-b826-e5286d5a6815`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55160::DEBUG::2014-05-16 18:01:20,707::task::974::TaskManager.Task::(_decref) Task=`2de4bd97-b9e2-41b6-b826-e5286d5a6815`::ref 1 aborting False >Thread-55160::INFO::2014-05-16 18:01:20,708::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55160::DEBUG::2014-05-16 18:01:20,708::task::1168::TaskManager.Task::(prepare) Task=`2de4bd97-b9e2-41b6-b826-e5286d5a6815`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55160::DEBUG::2014-05-16 18:01:20,708::task::579::TaskManager.Task::(_updateState) Task=`2de4bd97-b9e2-41b6-b826-e5286d5a6815`::moving from state preparing -> state finished >Thread-55160::DEBUG::2014-05-16 18:01:20,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55160::DEBUG::2014-05-16 18:01:20,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55160::DEBUG::2014-05-16 18:01:20,709::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55160::DEBUG::2014-05-16 18:01:20,709::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55160::DEBUG::2014-05-16 18:01:20,709::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55160::DEBUG::2014-05-16 18:01:20,709::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55160::DEBUG::2014-05-16 18:01:20,709::task::974::TaskManager.Task::(_decref) Task=`2de4bd97-b9e2-41b6-b826-e5286d5a6815`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:01:21,779::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:21,847::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312252 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:23,858::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:23,931::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359562 s, 28.5 MB/s\n'; <rc> = 0 >Thread-55162::DEBUG::2014-05-16 18:01:24,133::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318082.000000 / 8.008527 / 262500000.000000 = 0.205404 >Thread-55162::DEBUG::2014-05-16 18:01:24,133::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052753295124141359, 'statsAge': 1.0362238883972168, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20540401633565605, 'rxDropped': 0} >Thread-55162::DEBUG::2014-05-16 18:01:24,133::task::579::TaskManager.Task::(_updateState) Task=`cc6eef41-40e4-4021-9e36-ebcdb50935e9`::moving from state init -> state preparing >Thread-55162::INFO::2014-05-16 18:01:24,133::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55162::INFO::2014-05-16 18:01:24,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00098202', 'lastCheck': '8.7', 'valid': True}} >Thread-55162::DEBUG::2014-05-16 18:01:24,134::task::1168::TaskManager.Task::(prepare) Task=`cc6eef41-40e4-4021-9e36-ebcdb50935e9`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00098202', 'lastCheck': '8.7', 'valid': True}} >Thread-55162::DEBUG::2014-05-16 18:01:24,134::task::579::TaskManager.Task::(_updateState) Task=`cc6eef41-40e4-4021-9e36-ebcdb50935e9`::moving from state preparing -> state finished >Thread-55162::DEBUG::2014-05-16 18:01:24,134::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55162::DEBUG::2014-05-16 18:01:24,134::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55162::DEBUG::2014-05-16 18:01:24,134::task::974::TaskManager.Task::(_decref) Task=`cc6eef41-40e4-4021-9e36-ebcdb50935e9`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:01:25,418::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:01:25,428::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000843388 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:25,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:26,014::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352891 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:28,025::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:28,094::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320811 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:30,105::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:30,174::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320505 s, 31.9 MB/s\n'; <rc> = 0 >Thread-55165::DEBUG::2014-05-16 18:01:31,057::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55165::DEBUG::2014-05-16 18:01:31,058::task::579::TaskManager.Task::(_updateState) Task=`f7d90a9b-2c54-4552-ac33-fe2ef8885f0a`::moving from state init -> state preparing >Thread-55165::INFO::2014-05-16 18:01:31,058::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55165::INFO::2014-05-16 18:01:31,058::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55165::DEBUG::2014-05-16 18:01:31,059::task::1168::TaskManager.Task::(prepare) Task=`f7d90a9b-2c54-4552-ac33-fe2ef8885f0a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55165::DEBUG::2014-05-16 18:01:31,059::task::579::TaskManager.Task::(_updateState) Task=`f7d90a9b-2c54-4552-ac33-fe2ef8885f0a`::moving from state preparing -> state finished >Thread-55165::DEBUG::2014-05-16 18:01:31,059::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55165::DEBUG::2014-05-16 18:01:31,059::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55165::DEBUG::2014-05-16 18:01:31,059::task::974::TaskManager.Task::(_decref) Task=`f7d90a9b-2c54-4552-ac33-fe2ef8885f0a`::ref 0 aborting False >Thread-55167::DEBUG::2014-05-16 18:01:31,280::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55167::DEBUG::2014-05-16 18:01:31,280::task::579::TaskManager.Task::(_updateState) Task=`6285a3ba-5ff1-45aa-ae4f-1dd3d670ade0`::moving from state init -> state preparing >Thread-55167::INFO::2014-05-16 18:01:31,280::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55167::DEBUG::2014-05-16 18:01:31,281::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`03da0c80-db20-463d-a5b1-2dfb464f11cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55167::DEBUG::2014-05-16 18:01:31,281::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55167::DEBUG::2014-05-16 18:01:31,281::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55167::DEBUG::2014-05-16 18:01:31,281::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`03da0c80-db20-463d-a5b1-2dfb464f11cd`::Granted request >Thread-55167::DEBUG::2014-05-16 18:01:31,282::task::811::TaskManager.Task::(resourceAcquired) Task=`6285a3ba-5ff1-45aa-ae4f-1dd3d670ade0`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55167::DEBUG::2014-05-16 18:01:31,282::task::974::TaskManager.Task::(_decref) Task=`6285a3ba-5ff1-45aa-ae4f-1dd3d670ade0`::ref 1 aborting False >Thread-55167::INFO::2014-05-16 18:01:31,283::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55167::DEBUG::2014-05-16 18:01:31,283::task::1168::TaskManager.Task::(prepare) Task=`6285a3ba-5ff1-45aa-ae4f-1dd3d670ade0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55167::DEBUG::2014-05-16 18:01:31,283::task::579::TaskManager.Task::(_updateState) Task=`6285a3ba-5ff1-45aa-ae4f-1dd3d670ade0`::moving from state preparing -> state finished >Thread-55167::DEBUG::2014-05-16 18:01:31,283::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55167::DEBUG::2014-05-16 18:01:31,283::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55167::DEBUG::2014-05-16 18:01:31,283::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55167::DEBUG::2014-05-16 18:01:31,284::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55167::DEBUG::2014-05-16 18:01:31,284::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55167::DEBUG::2014-05-16 18:01:31,284::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55167::DEBUG::2014-05-16 18:01:31,284::task::974::TaskManager.Task::(_decref) Task=`6285a3ba-5ff1-45aa-ae4f-1dd3d670ade0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:01:32,185::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:32,258::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035782 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:34,270::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:34,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313184 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:01:35,448::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 18:01:35,448::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:01:35,466::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:01:35,475::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000721429 s, 2.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:01:35,475::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000721429 s, 2.8 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 18:01:35,475::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 18:01:35,475::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 18:01:35,475::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:01:35,476::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:01:35,476::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:01:35,476::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:01:35,477::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:01:35,477::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:01:35,478::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:01:35,660::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:01:35,662::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:01:35,662::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 18:01:35,663::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 18:01:35,663::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 18:01:35,663::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 18:01:35,664::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:01:35,809::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:01:35,830::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:01:35,840::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000534524 s, 7.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:36,350::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:36,417::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313074 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:38,429::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:38,508::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419282 s, 24.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:40,520::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:40,587::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313997 s, 32.6 MB/s\n'; <rc> = 0 >Thread-55170::DEBUG::2014-05-16 18:01:42,059::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5554657.000000 / 8.008573 / 262500000.000000 = 0.264224 >Thread-55170::DEBUG::2014-05-16 18:01:42,060::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0068411450012027964, 'statsAge': 0.94351696968078613, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.26422432497285542, 'rxDropped': 0} >Thread-55171::DEBUG::2014-05-16 18:01:42,063::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55170::DEBUG::2014-05-16 18:01:42,063::task::579::TaskManager.Task::(_updateState) Task=`82df10d9-748b-45ec-bf85-f37a04095639`::moving from state init -> state preparing >Thread-55171::DEBUG::2014-05-16 18:01:42,065::task::579::TaskManager.Task::(_updateState) Task=`75fff7fc-02a9-4088-a103-cc9801b041d7`::moving from state init -> state preparing >Thread-55170::INFO::2014-05-16 18:01:42,065::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55171::INFO::2014-05-16 18:01:42,067::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55170::INFO::2014-05-16 18:01:42,067::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534524', 'lastCheck': '6.2', 'valid': True}} >Thread-55171::INFO::2014-05-16 18:01:42,069::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55170::DEBUG::2014-05-16 18:01:42,069::task::1168::TaskManager.Task::(prepare) Task=`82df10d9-748b-45ec-bf85-f37a04095639`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534524', 'lastCheck': '6.2', 'valid': True}} >Thread-55171::DEBUG::2014-05-16 18:01:42,070::task::1168::TaskManager.Task::(prepare) Task=`75fff7fc-02a9-4088-a103-cc9801b041d7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55170::DEBUG::2014-05-16 18:01:42,071::task::579::TaskManager.Task::(_updateState) Task=`82df10d9-748b-45ec-bf85-f37a04095639`::moving from state preparing -> state finished >Thread-55171::DEBUG::2014-05-16 18:01:42,072::task::579::TaskManager.Task::(_updateState) Task=`75fff7fc-02a9-4088-a103-cc9801b041d7`::moving from state preparing -> state finished >Thread-55170::DEBUG::2014-05-16 18:01:42,077::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55171::DEBUG::2014-05-16 18:01:42,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55170::DEBUG::2014-05-16 18:01:42,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55171::DEBUG::2014-05-16 18:01:42,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55170::DEBUG::2014-05-16 18:01:42,080::task::974::TaskManager.Task::(_decref) Task=`82df10d9-748b-45ec-bf85-f37a04095639`::ref 0 aborting False >Thread-55171::DEBUG::2014-05-16 18:01:42,081::task::974::TaskManager.Task::(_decref) Task=`75fff7fc-02a9-4088-a103-cc9801b041d7`::ref 0 aborting False >Thread-55172::DEBUG::2014-05-16 18:01:42,097::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55172::DEBUG::2014-05-16 18:01:42,097::task::579::TaskManager.Task::(_updateState) Task=`623fa1c3-4cae-4fc1-ab67-7c55fd56db78`::moving from state init -> state preparing >Thread-55172::INFO::2014-05-16 18:01:42,098::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55172::DEBUG::2014-05-16 18:01:42,098::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a5b14cba-aca7-4261-a69c-2a59ea6b7c4e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55172::DEBUG::2014-05-16 18:01:42,098::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55172::DEBUG::2014-05-16 18:01:42,098::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55172::DEBUG::2014-05-16 18:01:42,099::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a5b14cba-aca7-4261-a69c-2a59ea6b7c4e`::Granted request >Thread-55172::DEBUG::2014-05-16 18:01:42,099::task::811::TaskManager.Task::(resourceAcquired) Task=`623fa1c3-4cae-4fc1-ab67-7c55fd56db78`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55172::DEBUG::2014-05-16 18:01:42,099::task::974::TaskManager.Task::(_decref) Task=`623fa1c3-4cae-4fc1-ab67-7c55fd56db78`::ref 1 aborting False >Thread-55172::INFO::2014-05-16 18:01:42,100::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55172::DEBUG::2014-05-16 18:01:42,100::task::1168::TaskManager.Task::(prepare) Task=`623fa1c3-4cae-4fc1-ab67-7c55fd56db78`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55172::DEBUG::2014-05-16 18:01:42,100::task::579::TaskManager.Task::(_updateState) Task=`623fa1c3-4cae-4fc1-ab67-7c55fd56db78`::moving from state preparing -> state finished >Thread-55172::DEBUG::2014-05-16 18:01:42,100::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55172::DEBUG::2014-05-16 18:01:42,101::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55172::DEBUG::2014-05-16 18:01:42,101::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55172::DEBUG::2014-05-16 18:01:42,101::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55172::DEBUG::2014-05-16 18:01:42,101::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55172::DEBUG::2014-05-16 18:01:42,101::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55172::DEBUG::2014-05-16 18:01:42,101::task::974::TaskManager.Task::(_decref) Task=`623fa1c3-4cae-4fc1-ab67-7c55fd56db78`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:01:42,599::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:42,666::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311404 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:44,678::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:44,749::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351071 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:01:45,873::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:01:45,883::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595155 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:46,761::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:46,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354289 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:48,846::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:48,913::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312096 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:50,925::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:50,997::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348173 s, 29.4 MB/s\n'; <rc> = 0 >Thread-55177::DEBUG::2014-05-16 18:01:52,220::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55177::DEBUG::2014-05-16 18:01:52,221::task::579::TaskManager.Task::(_updateState) Task=`517bea8d-f885-4f5f-82ca-f8fa72ad24f5`::moving from state init -> state preparing >Thread-55177::INFO::2014-05-16 18:01:52,221::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55177::INFO::2014-05-16 18:01:52,222::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55177::DEBUG::2014-05-16 18:01:52,222::task::1168::TaskManager.Task::(prepare) Task=`517bea8d-f885-4f5f-82ca-f8fa72ad24f5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55177::DEBUG::2014-05-16 18:01:52,222::task::579::TaskManager.Task::(_updateState) Task=`517bea8d-f885-4f5f-82ca-f8fa72ad24f5`::moving from state preparing -> state finished >Thread-55177::DEBUG::2014-05-16 18:01:52,222::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55177::DEBUG::2014-05-16 18:01:52,222::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55177::DEBUG::2014-05-16 18:01:52,222::task::974::TaskManager.Task::(_decref) Task=`517bea8d-f885-4f5f-82ca-f8fa72ad24f5`::ref 0 aborting False >Thread-55178::DEBUG::2014-05-16 18:01:52,231::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55178::DEBUG::2014-05-16 18:01:52,231::task::579::TaskManager.Task::(_updateState) Task=`233cb830-219b-4d33-937a-aace561b7f90`::moving from state init -> state preparing >Thread-55178::INFO::2014-05-16 18:01:52,231::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55178::DEBUG::2014-05-16 18:01:52,232::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c1bec59f-8dec-4b61-a038-eff08f8414b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55178::DEBUG::2014-05-16 18:01:52,232::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55178::DEBUG::2014-05-16 18:01:52,232::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55178::DEBUG::2014-05-16 18:01:52,232::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c1bec59f-8dec-4b61-a038-eff08f8414b6`::Granted request >Thread-55178::DEBUG::2014-05-16 18:01:52,233::task::811::TaskManager.Task::(resourceAcquired) Task=`233cb830-219b-4d33-937a-aace561b7f90`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55178::DEBUG::2014-05-16 18:01:52,233::task::974::TaskManager.Task::(_decref) Task=`233cb830-219b-4d33-937a-aace561b7f90`::ref 1 aborting False >Thread-55178::INFO::2014-05-16 18:01:52,233::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55178::DEBUG::2014-05-16 18:01:52,234::task::1168::TaskManager.Task::(prepare) Task=`233cb830-219b-4d33-937a-aace561b7f90`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55178::DEBUG::2014-05-16 18:01:52,234::task::579::TaskManager.Task::(_updateState) Task=`233cb830-219b-4d33-937a-aace561b7f90`::moving from state preparing -> state finished >Thread-55178::DEBUG::2014-05-16 18:01:52,234::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55178::DEBUG::2014-05-16 18:01:52,234::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55178::DEBUG::2014-05-16 18:01:52,234::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55178::DEBUG::2014-05-16 18:01:52,235::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55178::DEBUG::2014-05-16 18:01:52,235::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55178::DEBUG::2014-05-16 18:01:52,235::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55178::DEBUG::2014-05-16 18:01:52,235::task::974::TaskManager.Task::(_decref) Task=`233cb830-219b-4d33-937a-aace561b7f90`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:01:53,009::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:53,082::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369836 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:55,094::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:55,165::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332425 s, 30.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:01:55,921::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:01:55,932::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708246 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:01:57,177::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:57,244::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311229 s, 32.9 MB/s\n'; <rc> = 0 >Thread-55180::DEBUG::2014-05-16 18:01:57,802::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413132.000000 / 8.010651 / 262500000.000000 = 0.257425 >Thread-55180::DEBUG::2014-05-16 18:01:57,803::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065682075420073604, 'statsAge': 0.66720390319824219, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25742545706711306, 'rxDropped': 0} >Thread-55180::DEBUG::2014-05-16 18:01:57,803::task::579::TaskManager.Task::(_updateState) Task=`3ca71a06-dcce-4e4a-83e3-ec365e0bb1cc`::moving from state init -> state preparing >Thread-55180::INFO::2014-05-16 18:01:57,803::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55180::INFO::2014-05-16 18:01:57,804::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708246', 'lastCheck': '1.9', 'valid': True}} >Thread-55180::DEBUG::2014-05-16 18:01:57,804::task::1168::TaskManager.Task::(prepare) Task=`3ca71a06-dcce-4e4a-83e3-ec365e0bb1cc`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708246', 'lastCheck': '1.9', 'valid': True}} >Thread-55180::DEBUG::2014-05-16 18:01:57,804::task::579::TaskManager.Task::(_updateState) Task=`3ca71a06-dcce-4e4a-83e3-ec365e0bb1cc`::moving from state preparing -> state finished >Thread-55180::DEBUG::2014-05-16 18:01:57,804::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55180::DEBUG::2014-05-16 18:01:57,804::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55180::DEBUG::2014-05-16 18:01:57,804::task::974::TaskManager.Task::(_decref) Task=`3ca71a06-dcce-4e4a-83e3-ec365e0bb1cc`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:01:59,256::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:01:59,333::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349292 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:01,349::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:01,415::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305497 s, 33.5 MB/s\n'; <rc> = 0 >Thread-55183::DEBUG::2014-05-16 18:02:02,313::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55183::DEBUG::2014-05-16 18:02:02,314::task::579::TaskManager.Task::(_updateState) Task=`47c7fc0a-1e00-4860-9434-19a6efe5b642`::moving from state init -> state preparing >Thread-55183::INFO::2014-05-16 18:02:02,314::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55183::INFO::2014-05-16 18:02:02,315::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55183::DEBUG::2014-05-16 18:02:02,315::task::1168::TaskManager.Task::(prepare) Task=`47c7fc0a-1e00-4860-9434-19a6efe5b642`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55183::DEBUG::2014-05-16 18:02:02,315::task::579::TaskManager.Task::(_updateState) Task=`47c7fc0a-1e00-4860-9434-19a6efe5b642`::moving from state preparing -> state finished >Thread-55183::DEBUG::2014-05-16 18:02:02,315::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55183::DEBUG::2014-05-16 18:02:02,315::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55183::DEBUG::2014-05-16 18:02:02,315::task::974::TaskManager.Task::(_decref) Task=`47c7fc0a-1e00-4860-9434-19a6efe5b642`::ref 0 aborting False >Thread-55184::DEBUG::2014-05-16 18:02:02,402::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55184::DEBUG::2014-05-16 18:02:02,403::task::579::TaskManager.Task::(_updateState) Task=`e8ac5c59-b77c-4f4f-8e22-17c0283dc7a2`::moving from state init -> state preparing >Thread-55184::INFO::2014-05-16 18:02:02,403::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55184::DEBUG::2014-05-16 18:02:02,403::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2df174e5-7a04-4415-b4fa-5a4b479b4f69`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55184::DEBUG::2014-05-16 18:02:02,403::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55184::DEBUG::2014-05-16 18:02:02,404::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55184::DEBUG::2014-05-16 18:02:02,404::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2df174e5-7a04-4415-b4fa-5a4b479b4f69`::Granted request >Thread-55184::DEBUG::2014-05-16 18:02:02,404::task::811::TaskManager.Task::(resourceAcquired) Task=`e8ac5c59-b77c-4f4f-8e22-17c0283dc7a2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55184::DEBUG::2014-05-16 18:02:02,404::task::974::TaskManager.Task::(_decref) Task=`e8ac5c59-b77c-4f4f-8e22-17c0283dc7a2`::ref 1 aborting False >Thread-55184::INFO::2014-05-16 18:02:02,405::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55184::DEBUG::2014-05-16 18:02:02,405::task::1168::TaskManager.Task::(prepare) Task=`e8ac5c59-b77c-4f4f-8e22-17c0283dc7a2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55184::DEBUG::2014-05-16 18:02:02,405::task::579::TaskManager.Task::(_updateState) Task=`e8ac5c59-b77c-4f4f-8e22-17c0283dc7a2`::moving from state preparing -> state finished >Thread-55184::DEBUG::2014-05-16 18:02:02,405::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55184::DEBUG::2014-05-16 18:02:02,406::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55184::DEBUG::2014-05-16 18:02:02,406::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55184::DEBUG::2014-05-16 18:02:02,406::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55184::DEBUG::2014-05-16 18:02:02,406::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55184::DEBUG::2014-05-16 18:02:02,406::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55184::DEBUG::2014-05-16 18:02:02,407::task::974::TaskManager.Task::(_decref) Task=`e8ac5c59-b77c-4f4f-8e22-17c0283dc7a2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:02:03,427::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:03,494::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314334 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:05,506::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:05,577::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346006 s, 29.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:02:05,971::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:02:05,981::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621523 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:07,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:07,659::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351439 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:09,671::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:09,739::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311378 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:11,750::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:11,822::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354618 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55188::DEBUG::2014-05-16 18:02:12,456::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55188::DEBUG::2014-05-16 18:02:12,457::task::579::TaskManager.Task::(_updateState) Task=`b6dcc710-4ff7-4c38-861d-54d4d4a0cb32`::moving from state init -> state preparing >Thread-55188::INFO::2014-05-16 18:02:12,457::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55188::INFO::2014-05-16 18:02:12,457::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55188::DEBUG::2014-05-16 18:02:12,457::task::1168::TaskManager.Task::(prepare) Task=`b6dcc710-4ff7-4c38-861d-54d4d4a0cb32`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55188::DEBUG::2014-05-16 18:02:12,458::task::579::TaskManager.Task::(_updateState) Task=`b6dcc710-4ff7-4c38-861d-54d4d4a0cb32`::moving from state preparing -> state finished >Thread-55188::DEBUG::2014-05-16 18:02:12,458::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55188::DEBUG::2014-05-16 18:02:12,458::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55188::DEBUG::2014-05-16 18:02:12,458::task::974::TaskManager.Task::(_decref) Task=`b6dcc710-4ff7-4c38-861d-54d4d4a0cb32`::ref 0 aborting False >Thread-55189::DEBUG::2014-05-16 18:02:12,467::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55189::DEBUG::2014-05-16 18:02:12,467::task::579::TaskManager.Task::(_updateState) Task=`5b13d0db-5eb9-4c65-909c-73587df4a7e9`::moving from state init -> state preparing >Thread-55189::INFO::2014-05-16 18:02:12,467::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55189::DEBUG::2014-05-16 18:02:12,468::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`15349cd9-6261-46e4-8569-bade65aa2f8c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55189::DEBUG::2014-05-16 18:02:12,468::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55189::DEBUG::2014-05-16 18:02:12,468::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55189::DEBUG::2014-05-16 18:02:12,468::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`15349cd9-6261-46e4-8569-bade65aa2f8c`::Granted request >Thread-55189::DEBUG::2014-05-16 18:02:12,469::task::811::TaskManager.Task::(resourceAcquired) Task=`5b13d0db-5eb9-4c65-909c-73587df4a7e9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55189::DEBUG::2014-05-16 18:02:12,469::task::974::TaskManager.Task::(_decref) Task=`5b13d0db-5eb9-4c65-909c-73587df4a7e9`::ref 1 aborting False >Thread-55189::INFO::2014-05-16 18:02:12,470::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55189::DEBUG::2014-05-16 18:02:12,470::task::1168::TaskManager.Task::(prepare) Task=`5b13d0db-5eb9-4c65-909c-73587df4a7e9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55189::DEBUG::2014-05-16 18:02:12,470::task::579::TaskManager.Task::(_updateState) Task=`5b13d0db-5eb9-4c65-909c-73587df4a7e9`::moving from state preparing -> state finished >Thread-55189::DEBUG::2014-05-16 18:02:12,470::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55189::DEBUG::2014-05-16 18:02:12,470::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55189::DEBUG::2014-05-16 18:02:12,470::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55189::DEBUG::2014-05-16 18:02:12,471::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55189::DEBUG::2014-05-16 18:02:12,471::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55189::DEBUG::2014-05-16 18:02:12,471::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55189::DEBUG::2014-05-16 18:02:12,471::task::974::TaskManager.Task::(_decref) Task=`5b13d0db-5eb9-4c65-909c-73587df4a7e9`::ref 0 aborting False >Thread-55190::DEBUG::2014-05-16 18:02:13,138::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317230.000000 / 8.008381 / 262500000.000000 = 0.205367 >Thread-55190::DEBUG::2014-05-16 18:02:13,138::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051260584549917953, 'statsAge': 1.9879851341247559, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20536723592839856, 'rxDropped': 0} >Thread-55190::DEBUG::2014-05-16 18:02:13,138::task::579::TaskManager.Task::(_updateState) Task=`1d4b548c-3aca-431e-8fc1-d21e31f432a0`::moving from state init -> state preparing >Thread-55190::INFO::2014-05-16 18:02:13,138::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55190::INFO::2014-05-16 18:02:13,139::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621523', 'lastCheck': '7.1', 'valid': True}} >Thread-55190::DEBUG::2014-05-16 18:02:13,139::task::1168::TaskManager.Task::(prepare) Task=`1d4b548c-3aca-431e-8fc1-d21e31f432a0`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621523', 'lastCheck': '7.1', 'valid': True}} >Thread-55190::DEBUG::2014-05-16 18:02:13,139::task::579::TaskManager.Task::(_updateState) Task=`1d4b548c-3aca-431e-8fc1-d21e31f432a0`::moving from state preparing -> state finished >Thread-55190::DEBUG::2014-05-16 18:02:13,139::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55190::DEBUG::2014-05-16 18:02:13,139::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55190::DEBUG::2014-05-16 18:02:13,139::task::974::TaskManager.Task::(_decref) Task=`1d4b548c-3aca-431e-8fc1-d21e31f432a0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:02:13,834::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:13,906::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356935 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:15,918::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:15,984::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305914 s, 33.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:02:16,019::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:02:16,029::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678535 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:17,996::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:18,067::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356169 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:20,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:20,147::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314003 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:22,158::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:22,225::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311783 s, 32.8 MB/s\n'; <rc> = 0 >Thread-55195::DEBUG::2014-05-16 18:02:22,547::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55195::DEBUG::2014-05-16 18:02:22,548::task::579::TaskManager.Task::(_updateState) Task=`e050ca93-d237-49bb-a3e9-73cf741bae49`::moving from state init -> state preparing >Thread-55195::INFO::2014-05-16 18:02:22,548::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55195::INFO::2014-05-16 18:02:22,549::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55195::DEBUG::2014-05-16 18:02:22,549::task::1168::TaskManager.Task::(prepare) Task=`e050ca93-d237-49bb-a3e9-73cf741bae49`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55195::DEBUG::2014-05-16 18:02:22,549::task::579::TaskManager.Task::(_updateState) Task=`e050ca93-d237-49bb-a3e9-73cf741bae49`::moving from state preparing -> state finished >Thread-55195::DEBUG::2014-05-16 18:02:22,549::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55195::DEBUG::2014-05-16 18:02:22,549::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55195::DEBUG::2014-05-16 18:02:22,549::task::974::TaskManager.Task::(_decref) Task=`e050ca93-d237-49bb-a3e9-73cf741bae49`::ref 0 aborting False >Thread-55196::DEBUG::2014-05-16 18:02:22,560::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55196::DEBUG::2014-05-16 18:02:22,561::task::579::TaskManager.Task::(_updateState) Task=`019e0b9b-3b06-438d-9038-48ccbef8a2d7`::moving from state init -> state preparing >Thread-55196::INFO::2014-05-16 18:02:22,561::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55196::DEBUG::2014-05-16 18:02:22,561::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9f529193-1102-4c2a-85da-fed74ada415e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55196::DEBUG::2014-05-16 18:02:22,561::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55196::DEBUG::2014-05-16 18:02:22,562::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55196::DEBUG::2014-05-16 18:02:22,562::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9f529193-1102-4c2a-85da-fed74ada415e`::Granted request >Thread-55196::DEBUG::2014-05-16 18:02:22,562::task::811::TaskManager.Task::(resourceAcquired) Task=`019e0b9b-3b06-438d-9038-48ccbef8a2d7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55196::DEBUG::2014-05-16 18:02:22,562::task::974::TaskManager.Task::(_decref) Task=`019e0b9b-3b06-438d-9038-48ccbef8a2d7`::ref 1 aborting False >Thread-55196::INFO::2014-05-16 18:02:22,563::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55196::DEBUG::2014-05-16 18:02:22,563::task::1168::TaskManager.Task::(prepare) Task=`019e0b9b-3b06-438d-9038-48ccbef8a2d7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55196::DEBUG::2014-05-16 18:02:22,564::task::579::TaskManager.Task::(_updateState) Task=`019e0b9b-3b06-438d-9038-48ccbef8a2d7`::moving from state preparing -> state finished >Thread-55196::DEBUG::2014-05-16 18:02:22,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55196::DEBUG::2014-05-16 18:02:22,564::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55196::DEBUG::2014-05-16 18:02:22,564::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55196::DEBUG::2014-05-16 18:02:22,564::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55196::DEBUG::2014-05-16 18:02:22,564::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55196::DEBUG::2014-05-16 18:02:22,565::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55196::DEBUG::2014-05-16 18:02:22,565::task::974::TaskManager.Task::(_decref) Task=`019e0b9b-3b06-438d-9038-48ccbef8a2d7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:02:24,237::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:24,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031089 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:02:26,067::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:02:26,078::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000890653 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:26,317::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:26,388::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348165 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:28,401::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55198::DEBUG::2014-05-16 18:02:28,402::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318709.000000 / 8.008488 / 262500000.000000 = 0.205435 >Thread-55198::DEBUG::2014-05-16 18:02:28,411::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054024583475081019, 'statsAge': 1.234576940536499, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20543483858264686, 'rxDropped': 0} >Thread-55198::DEBUG::2014-05-16 18:02:28,412::task::579::TaskManager.Task::(_updateState) Task=`bbd2c0ee-e71e-48ea-850a-02c0d412c37a`::moving from state init -> state preparing >Thread-55198::INFO::2014-05-16 18:02:28,412::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55198::INFO::2014-05-16 18:02:28,412::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000890653', 'lastCheck': '2.3', 'valid': True}} >Thread-55198::DEBUG::2014-05-16 18:02:28,412::task::1168::TaskManager.Task::(prepare) Task=`bbd2c0ee-e71e-48ea-850a-02c0d412c37a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000890653', 'lastCheck': '2.3', 'valid': True}} >Thread-55198::DEBUG::2014-05-16 18:02:28,412::task::579::TaskManager.Task::(_updateState) Task=`bbd2c0ee-e71e-48ea-850a-02c0d412c37a`::moving from state preparing -> state finished >Thread-55198::DEBUG::2014-05-16 18:02:28,413::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55198::DEBUG::2014-05-16 18:02:28,413::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55198::DEBUG::2014-05-16 18:02:28,413::task::974::TaskManager.Task::(_decref) Task=`bbd2c0ee-e71e-48ea-850a-02c0d412c37a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:02:28,474::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034278 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:30,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:30,553::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312306 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:32,565::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55201::DEBUG::2014-05-16 18:02:32,629::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55201::DEBUG::2014-05-16 18:02:32,631::task::579::TaskManager.Task::(_updateState) Task=`c0078d71-0725-452d-9f0c-44530e477da3`::moving from state init -> state preparing >Thread-55201::INFO::2014-05-16 18:02:32,632::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55201::INFO::2014-05-16 18:02:32,633::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55201::DEBUG::2014-05-16 18:02:32,634::task::1168::TaskManager.Task::(prepare) Task=`c0078d71-0725-452d-9f0c-44530e477da3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55201::DEBUG::2014-05-16 18:02:32,635::task::579::TaskManager.Task::(_updateState) Task=`c0078d71-0725-452d-9f0c-44530e477da3`::moving from state preparing -> state finished >Thread-55201::DEBUG::2014-05-16 18:02:32,636::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55201::DEBUG::2014-05-16 18:02:32,637::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55201::DEBUG::2014-05-16 18:02:32,638::task::974::TaskManager.Task::(_decref) Task=`c0078d71-0725-452d-9f0c-44530e477da3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:02:32,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356445 s, 28.7 MB/s\n'; <rc> = 0 >Thread-55202::DEBUG::2014-05-16 18:02:32,660::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55202::DEBUG::2014-05-16 18:02:32,662::task::579::TaskManager.Task::(_updateState) Task=`35093b46-219b-4ce7-b18c-89d1ff0aa93d`::moving from state init -> state preparing >Thread-55202::INFO::2014-05-16 18:02:32,663::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55202::DEBUG::2014-05-16 18:02:32,665::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3428d00c-eadb-410b-9cad-6a31326ed1a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55202::DEBUG::2014-05-16 18:02:32,665::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55202::DEBUG::2014-05-16 18:02:32,666::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55202::DEBUG::2014-05-16 18:02:32,667::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3428d00c-eadb-410b-9cad-6a31326ed1a2`::Granted request >Thread-55202::DEBUG::2014-05-16 18:02:32,669::task::811::TaskManager.Task::(resourceAcquired) Task=`35093b46-219b-4ce7-b18c-89d1ff0aa93d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55202::DEBUG::2014-05-16 18:02:32,669::task::974::TaskManager.Task::(_decref) Task=`35093b46-219b-4ce7-b18c-89d1ff0aa93d`::ref 1 aborting False >Thread-55202::INFO::2014-05-16 18:02:32,672::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55202::DEBUG::2014-05-16 18:02:32,673::task::1168::TaskManager.Task::(prepare) Task=`35093b46-219b-4ce7-b18c-89d1ff0aa93d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55202::DEBUG::2014-05-16 18:02:32,674::task::579::TaskManager.Task::(_updateState) Task=`35093b46-219b-4ce7-b18c-89d1ff0aa93d`::moving from state preparing -> state finished >Thread-55202::DEBUG::2014-05-16 18:02:32,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55202::DEBUG::2014-05-16 18:02:32,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55202::DEBUG::2014-05-16 18:02:32,676::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55202::DEBUG::2014-05-16 18:02:32,677::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55202::DEBUG::2014-05-16 18:02:32,678::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55202::DEBUG::2014-05-16 18:02:32,678::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55202::DEBUG::2014-05-16 18:02:32,679::task::974::TaskManager.Task::(_decref) Task=`35093b46-219b-4ce7-b18c-89d1ff0aa93d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:02:34,686::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:34,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306604 s, 33.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:02:36,116::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:02:36,127::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000918815 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:36,764::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:36,832::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030795 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:38,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:38,916::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348879 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:40,927::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:40,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306797 s, 33.4 MB/s\n'; <rc> = 0 >Thread-55206::DEBUG::2014-05-16 18:02:42,829::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55206::DEBUG::2014-05-16 18:02:42,830::task::579::TaskManager.Task::(_updateState) Task=`df038e21-e191-4533-ba6d-8af7b4b1acc1`::moving from state init -> state preparing >Thread-55206::INFO::2014-05-16 18:02:42,830::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55206::INFO::2014-05-16 18:02:42,830::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55206::DEBUG::2014-05-16 18:02:42,830::task::1168::TaskManager.Task::(prepare) Task=`df038e21-e191-4533-ba6d-8af7b4b1acc1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55206::DEBUG::2014-05-16 18:02:42,830::task::579::TaskManager.Task::(_updateState) Task=`df038e21-e191-4533-ba6d-8af7b4b1acc1`::moving from state preparing -> state finished >Thread-55206::DEBUG::2014-05-16 18:02:42,831::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55206::DEBUG::2014-05-16 18:02:42,831::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55206::DEBUG::2014-05-16 18:02:42,831::task::974::TaskManager.Task::(_decref) Task=`df038e21-e191-4533-ba6d-8af7b4b1acc1`::ref 0 aborting False >Thread-55207::DEBUG::2014-05-16 18:02:42,840::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55207::DEBUG::2014-05-16 18:02:42,840::task::579::TaskManager.Task::(_updateState) Task=`18eee18b-9689-4239-b5be-f027e6bf6830`::moving from state init -> state preparing >Thread-55207::INFO::2014-05-16 18:02:42,840::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55207::DEBUG::2014-05-16 18:02:42,841::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f68d1dd6-4e11-4612-bc8e-95ecdd50fecb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55207::DEBUG::2014-05-16 18:02:42,841::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55207::DEBUG::2014-05-16 18:02:42,841::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55207::DEBUG::2014-05-16 18:02:42,841::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f68d1dd6-4e11-4612-bc8e-95ecdd50fecb`::Granted request >Thread-55207::DEBUG::2014-05-16 18:02:42,841::task::811::TaskManager.Task::(resourceAcquired) Task=`18eee18b-9689-4239-b5be-f027e6bf6830`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55207::DEBUG::2014-05-16 18:02:42,842::task::974::TaskManager.Task::(_decref) Task=`18eee18b-9689-4239-b5be-f027e6bf6830`::ref 1 aborting False >Thread-55207::INFO::2014-05-16 18:02:42,842::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55207::DEBUG::2014-05-16 18:02:42,842::task::1168::TaskManager.Task::(prepare) Task=`18eee18b-9689-4239-b5be-f027e6bf6830`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55207::DEBUG::2014-05-16 18:02:42,843::task::579::TaskManager.Task::(_updateState) Task=`18eee18b-9689-4239-b5be-f027e6bf6830`::moving from state preparing -> state finished >Thread-55207::DEBUG::2014-05-16 18:02:42,843::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55207::DEBUG::2014-05-16 18:02:42,843::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55207::DEBUG::2014-05-16 18:02:42,843::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55207::DEBUG::2014-05-16 18:02:42,843::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55207::DEBUG::2014-05-16 18:02:42,844::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55207::DEBUG::2014-05-16 18:02:42,844::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55207::DEBUG::2014-05-16 18:02:42,844::task::974::TaskManager.Task::(_decref) Task=`18eee18b-9689-4239-b5be-f027e6bf6830`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:02:43,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:43,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360557 s, 28.4 MB/s\n'; <rc> = 0 >Thread-55208::DEBUG::2014-05-16 18:02:44,322::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3241438.000000 / 8.008453 / 262500000.000000 = 0.154191 >Thread-55208::DEBUG::2014-05-16 18:02:44,322::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0039246151111535128, 'statsAge': 1.1385960578918457, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15419127020104745, 'rxDropped': 0} >Thread-55208::DEBUG::2014-05-16 18:02:44,323::task::579::TaskManager.Task::(_updateState) Task=`872339fc-54c4-47d6-bd9c-37bc651d9a62`::moving from state init -> state preparing >Thread-55208::INFO::2014-05-16 18:02:44,323::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55208::INFO::2014-05-16 18:02:44,323::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000918815', 'lastCheck': '8.2', 'valid': True}} >Thread-55208::DEBUG::2014-05-16 18:02:44,323::task::1168::TaskManager.Task::(prepare) Task=`872339fc-54c4-47d6-bd9c-37bc651d9a62`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000918815', 'lastCheck': '8.2', 'valid': True}} >Thread-55208::DEBUG::2014-05-16 18:02:44,323::task::579::TaskManager.Task::(_updateState) Task=`872339fc-54c4-47d6-bd9c-37bc651d9a62`::moving from state preparing -> state finished >Thread-55208::DEBUG::2014-05-16 18:02:44,324::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55208::DEBUG::2014-05-16 18:02:44,324::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55208::DEBUG::2014-05-16 18:02:44,324::task::974::TaskManager.Task::(_decref) Task=`872339fc-54c4-47d6-bd9c-37bc651d9a62`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:02:45,091::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:45,162::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350529 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:02:46,161::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:02:46,171::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000817895 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:47,174::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:47,246::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354796 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:49,258::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:49,324::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307435 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:51,336::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:51,402::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030469 s, 33.6 MB/s\n'; <rc> = 0 >Thread-55212::DEBUG::2014-05-16 18:02:53,004::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55212::DEBUG::2014-05-16 18:02:53,004::task::579::TaskManager.Task::(_updateState) Task=`a1a8225f-3a31-44ee-b000-ddc8ca767334`::moving from state init -> state preparing >Thread-55212::INFO::2014-05-16 18:02:53,004::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55212::INFO::2014-05-16 18:02:53,005::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55212::DEBUG::2014-05-16 18:02:53,005::task::1168::TaskManager.Task::(prepare) Task=`a1a8225f-3a31-44ee-b000-ddc8ca767334`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55212::DEBUG::2014-05-16 18:02:53,005::task::579::TaskManager.Task::(_updateState) Task=`a1a8225f-3a31-44ee-b000-ddc8ca767334`::moving from state preparing -> state finished >Thread-55212::DEBUG::2014-05-16 18:02:53,005::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55212::DEBUG::2014-05-16 18:02:53,005::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55212::DEBUG::2014-05-16 18:02:53,005::task::974::TaskManager.Task::(_decref) Task=`a1a8225f-3a31-44ee-b000-ddc8ca767334`::ref 0 aborting False >Thread-55213::DEBUG::2014-05-16 18:02:53,014::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55213::DEBUG::2014-05-16 18:02:53,015::task::579::TaskManager.Task::(_updateState) Task=`ccba55a3-2aee-4402-ba05-7f0cee3aae02`::moving from state init -> state preparing >Thread-55213::INFO::2014-05-16 18:02:53,015::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55213::DEBUG::2014-05-16 18:02:53,015::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2c7345d5-446d-4ede-9ec0-d5fcd2b19d0c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55213::DEBUG::2014-05-16 18:02:53,015::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55213::DEBUG::2014-05-16 18:02:53,016::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55213::DEBUG::2014-05-16 18:02:53,016::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2c7345d5-446d-4ede-9ec0-d5fcd2b19d0c`::Granted request >Thread-55213::DEBUG::2014-05-16 18:02:53,016::task::811::TaskManager.Task::(resourceAcquired) Task=`ccba55a3-2aee-4402-ba05-7f0cee3aae02`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55213::DEBUG::2014-05-16 18:02:53,016::task::974::TaskManager.Task::(_decref) Task=`ccba55a3-2aee-4402-ba05-7f0cee3aae02`::ref 1 aborting False >Thread-55213::INFO::2014-05-16 18:02:53,017::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55213::DEBUG::2014-05-16 18:02:53,017::task::1168::TaskManager.Task::(prepare) Task=`ccba55a3-2aee-4402-ba05-7f0cee3aae02`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55213::DEBUG::2014-05-16 18:02:53,017::task::579::TaskManager.Task::(_updateState) Task=`ccba55a3-2aee-4402-ba05-7f0cee3aae02`::moving from state preparing -> state finished >Thread-55213::DEBUG::2014-05-16 18:02:53,017::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55213::DEBUG::2014-05-16 18:02:53,018::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55213::DEBUG::2014-05-16 18:02:53,018::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55213::DEBUG::2014-05-16 18:02:53,018::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55213::DEBUG::2014-05-16 18:02:53,018::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55213::DEBUG::2014-05-16 18:02:53,018::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55213::DEBUG::2014-05-16 18:02:53,019::task::974::TaskManager.Task::(_decref) Task=`ccba55a3-2aee-4402-ba05-7f0cee3aae02`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:02:53,414::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:53,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367774 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:55,499::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:55,565::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295469 s, 34.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:02:56,207::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:02:56,218::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731079 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:57,577::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:57,649::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358348 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:02:59,661::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:02:59,733::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350572 s, 29.2 MB/s\n'; <rc> = 0 >Thread-55216::DEBUG::2014-05-16 18:03:01,013::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5415856.000000 / 8.008288 / 262500000.000000 = 0.257631 >Thread-55216::DEBUG::2014-05-16 18:03:01,013::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066786048528299788, 'statsAge': 1.8119349479675293, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25763100205011796, 'rxDropped': 0} >Thread-55216::DEBUG::2014-05-16 18:03:01,014::task::579::TaskManager.Task::(_updateState) Task=`4ce224a7-0e9a-4bcf-b074-7489eccc906e`::moving from state init -> state preparing >Thread-55216::INFO::2014-05-16 18:03:01,014::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55216::INFO::2014-05-16 18:03:01,014::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731079', 'lastCheck': '4.8', 'valid': True}} >Thread-55216::DEBUG::2014-05-16 18:03:01,014::task::1168::TaskManager.Task::(prepare) Task=`4ce224a7-0e9a-4bcf-b074-7489eccc906e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731079', 'lastCheck': '4.8', 'valid': True}} >Thread-55216::DEBUG::2014-05-16 18:03:01,014::task::579::TaskManager.Task::(_updateState) Task=`4ce224a7-0e9a-4bcf-b074-7489eccc906e`::moving from state preparing -> state finished >Thread-55216::DEBUG::2014-05-16 18:03:01,014::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55216::DEBUG::2014-05-16 18:03:01,014::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55216::DEBUG::2014-05-16 18:03:01,015::task::974::TaskManager.Task::(_decref) Task=`4ce224a7-0e9a-4bcf-b074-7489eccc906e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:03:01,745::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:01,812::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312982 s, 32.7 MB/s\n'; <rc> = 0 >Thread-55218::DEBUG::2014-05-16 18:03:03,185::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55218::DEBUG::2014-05-16 18:03:03,186::task::579::TaskManager.Task::(_updateState) Task=`8c69ded0-f58a-419e-a0c3-92edc171c0a3`::moving from state init -> state preparing >Thread-55218::INFO::2014-05-16 18:03:03,186::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55218::INFO::2014-05-16 18:03:03,186::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55218::DEBUG::2014-05-16 18:03:03,186::task::1168::TaskManager.Task::(prepare) Task=`8c69ded0-f58a-419e-a0c3-92edc171c0a3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55218::DEBUG::2014-05-16 18:03:03,187::task::579::TaskManager.Task::(_updateState) Task=`8c69ded0-f58a-419e-a0c3-92edc171c0a3`::moving from state preparing -> state finished >Thread-55218::DEBUG::2014-05-16 18:03:03,187::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55218::DEBUG::2014-05-16 18:03:03,187::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55218::DEBUG::2014-05-16 18:03:03,187::task::974::TaskManager.Task::(_decref) Task=`8c69ded0-f58a-419e-a0c3-92edc171c0a3`::ref 0 aborting False >Thread-55219::DEBUG::2014-05-16 18:03:03,196::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55219::DEBUG::2014-05-16 18:03:03,196::task::579::TaskManager.Task::(_updateState) Task=`4683e782-869c-4d58-9179-00c21445096d`::moving from state init -> state preparing >Thread-55219::INFO::2014-05-16 18:03:03,196::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55219::DEBUG::2014-05-16 18:03:03,197::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9499b5c1-7b00-48c1-bcc2-b9b80fbcb1c1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55219::DEBUG::2014-05-16 18:03:03,197::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55219::DEBUG::2014-05-16 18:03:03,197::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55219::DEBUG::2014-05-16 18:03:03,197::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9499b5c1-7b00-48c1-bcc2-b9b80fbcb1c1`::Granted request >Thread-55219::DEBUG::2014-05-16 18:03:03,198::task::811::TaskManager.Task::(resourceAcquired) Task=`4683e782-869c-4d58-9179-00c21445096d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55219::DEBUG::2014-05-16 18:03:03,198::task::974::TaskManager.Task::(_decref) Task=`4683e782-869c-4d58-9179-00c21445096d`::ref 1 aborting False >Thread-55219::INFO::2014-05-16 18:03:03,198::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55219::DEBUG::2014-05-16 18:03:03,199::task::1168::TaskManager.Task::(prepare) Task=`4683e782-869c-4d58-9179-00c21445096d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55219::DEBUG::2014-05-16 18:03:03,199::task::579::TaskManager.Task::(_updateState) Task=`4683e782-869c-4d58-9179-00c21445096d`::moving from state preparing -> state finished >Thread-55219::DEBUG::2014-05-16 18:03:03,199::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55219::DEBUG::2014-05-16 18:03:03,199::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55219::DEBUG::2014-05-16 18:03:03,199::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55219::DEBUG::2014-05-16 18:03:03,200::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55219::DEBUG::2014-05-16 18:03:03,200::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55219::DEBUG::2014-05-16 18:03:03,200::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55219::DEBUG::2014-05-16 18:03:03,200::task::974::TaskManager.Task::(_decref) Task=`4683e782-869c-4d58-9179-00c21445096d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:03:03,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:03,890::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305968 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:05,902::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:05,973::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356151 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:03:06,251::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:03:06,262::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000802162 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:07,985::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:08,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352023 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:10,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:10,135::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306336 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:12,147::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:12,218::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351693 s, 29.1 MB/s\n'; <rc> = 0 >Thread-55223::DEBUG::2014-05-16 18:03:13,282::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55223::DEBUG::2014-05-16 18:03:13,283::task::579::TaskManager.Task::(_updateState) Task=`d9a84e7a-11dc-4a1c-b875-68c1d360a78e`::moving from state init -> state preparing >Thread-55223::INFO::2014-05-16 18:03:13,283::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55223::INFO::2014-05-16 18:03:13,283::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55223::DEBUG::2014-05-16 18:03:13,283::task::1168::TaskManager.Task::(prepare) Task=`d9a84e7a-11dc-4a1c-b875-68c1d360a78e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55223::DEBUG::2014-05-16 18:03:13,284::task::579::TaskManager.Task::(_updateState) Task=`d9a84e7a-11dc-4a1c-b875-68c1d360a78e`::moving from state preparing -> state finished >Thread-55223::DEBUG::2014-05-16 18:03:13,284::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55223::DEBUG::2014-05-16 18:03:13,284::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55223::DEBUG::2014-05-16 18:03:13,284::task::974::TaskManager.Task::(_decref) Task=`d9a84e7a-11dc-4a1c-b875-68c1d360a78e`::ref 0 aborting False >Thread-55224::DEBUG::2014-05-16 18:03:13,300::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55224::DEBUG::2014-05-16 18:03:13,300::task::579::TaskManager.Task::(_updateState) Task=`872aa807-5730-4dc6-b02b-19f17fdc3766`::moving from state init -> state preparing >Thread-55224::INFO::2014-05-16 18:03:13,300::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55224::DEBUG::2014-05-16 18:03:13,301::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f484dcc4-2efc-4c19-aaf1-3dc7cd181a49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55224::DEBUG::2014-05-16 18:03:13,301::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55224::DEBUG::2014-05-16 18:03:13,301::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55224::DEBUG::2014-05-16 18:03:13,301::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f484dcc4-2efc-4c19-aaf1-3dc7cd181a49`::Granted request >Thread-55224::DEBUG::2014-05-16 18:03:13,302::task::811::TaskManager.Task::(resourceAcquired) Task=`872aa807-5730-4dc6-b02b-19f17fdc3766`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55224::DEBUG::2014-05-16 18:03:13,302::task::974::TaskManager.Task::(_decref) Task=`872aa807-5730-4dc6-b02b-19f17fdc3766`::ref 1 aborting False >Thread-55224::INFO::2014-05-16 18:03:13,302::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55224::DEBUG::2014-05-16 18:03:13,303::task::1168::TaskManager.Task::(prepare) Task=`872aa807-5730-4dc6-b02b-19f17fdc3766`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55224::DEBUG::2014-05-16 18:03:13,303::task::579::TaskManager.Task::(_updateState) Task=`872aa807-5730-4dc6-b02b-19f17fdc3766`::moving from state preparing -> state finished >Thread-55224::DEBUG::2014-05-16 18:03:13,303::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55224::DEBUG::2014-05-16 18:03:13,303::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55224::DEBUG::2014-05-16 18:03:13,303::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55224::DEBUG::2014-05-16 18:03:13,303::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55224::DEBUG::2014-05-16 18:03:13,304::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55224::DEBUG::2014-05-16 18:03:13,304::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55224::DEBUG::2014-05-16 18:03:13,304::task::974::TaskManager.Task::(_decref) Task=`872aa807-5730-4dc6-b02b-19f17fdc3766`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:03:14,230::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:14,302::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360834 s, 28.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:03:16,296::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:03:16,306::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604464 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:16,315::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:16,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0840918 s, 12.2 MB/s\n'; <rc> = 0 >Thread-55226::DEBUG::2014-05-16 18:03:16,802::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319632.000000 / 8.008518 / 262500000.000000 = 0.205478 >Thread-55226::DEBUG::2014-05-16 18:03:16,802::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053493517503368617, 'statsAge': 1.5838558673858643, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20547797360755424, 'rxDropped': 0} >Thread-55226::DEBUG::2014-05-16 18:03:16,803::task::579::TaskManager.Task::(_updateState) Task=`1df8a3fc-1af3-4aac-89bc-7479ed3f7beb`::moving from state init -> state preparing >Thread-55226::INFO::2014-05-16 18:03:16,803::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55226::INFO::2014-05-16 18:03:16,803::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604464', 'lastCheck': '0.4', 'valid': True}} >Thread-55226::DEBUG::2014-05-16 18:03:16,803::task::1168::TaskManager.Task::(prepare) Task=`1df8a3fc-1af3-4aac-89bc-7479ed3f7beb`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604464', 'lastCheck': '0.4', 'valid': True}} >Thread-55226::DEBUG::2014-05-16 18:03:16,804::task::579::TaskManager.Task::(_updateState) Task=`1df8a3fc-1af3-4aac-89bc-7479ed3f7beb`::moving from state preparing -> state finished >Thread-55226::DEBUG::2014-05-16 18:03:16,804::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55226::DEBUG::2014-05-16 18:03:16,804::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55226::DEBUG::2014-05-16 18:03:16,804::task::974::TaskManager.Task::(_decref) Task=`1df8a3fc-1af3-4aac-89bc-7479ed3f7beb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:03:18,448::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:18,516::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320242 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:20,528::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:20,599::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345403 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:22,611::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:22,682::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354624 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55230::DEBUG::2014-05-16 18:03:23,426::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55230::DEBUG::2014-05-16 18:03:23,426::task::579::TaskManager.Task::(_updateState) Task=`5889444c-f91c-414c-a98a-9804c645bf02`::moving from state init -> state preparing >Thread-55230::INFO::2014-05-16 18:03:23,426::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55230::INFO::2014-05-16 18:03:23,427::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55230::DEBUG::2014-05-16 18:03:23,427::task::1168::TaskManager.Task::(prepare) Task=`5889444c-f91c-414c-a98a-9804c645bf02`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55230::DEBUG::2014-05-16 18:03:23,427::task::579::TaskManager.Task::(_updateState) Task=`5889444c-f91c-414c-a98a-9804c645bf02`::moving from state preparing -> state finished >Thread-55230::DEBUG::2014-05-16 18:03:23,427::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55230::DEBUG::2014-05-16 18:03:23,427::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55230::DEBUG::2014-05-16 18:03:23,428::task::974::TaskManager.Task::(_decref) Task=`5889444c-f91c-414c-a98a-9804c645bf02`::ref 0 aborting False >Thread-55231::DEBUG::2014-05-16 18:03:23,459::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55231::DEBUG::2014-05-16 18:03:23,459::task::579::TaskManager.Task::(_updateState) Task=`26e265fc-ceb2-4b9e-a798-22cb83658194`::moving from state init -> state preparing >Thread-55231::INFO::2014-05-16 18:03:23,459::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55231::DEBUG::2014-05-16 18:03:23,460::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e1861b42-8557-4b79-be78-54f22f4cbb10`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55231::DEBUG::2014-05-16 18:03:23,460::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55231::DEBUG::2014-05-16 18:03:23,460::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55231::DEBUG::2014-05-16 18:03:23,460::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e1861b42-8557-4b79-be78-54f22f4cbb10`::Granted request >Thread-55231::DEBUG::2014-05-16 18:03:23,461::task::811::TaskManager.Task::(resourceAcquired) Task=`26e265fc-ceb2-4b9e-a798-22cb83658194`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55231::DEBUG::2014-05-16 18:03:23,461::task::974::TaskManager.Task::(_decref) Task=`26e265fc-ceb2-4b9e-a798-22cb83658194`::ref 1 aborting False >Thread-55231::INFO::2014-05-16 18:03:23,461::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55231::DEBUG::2014-05-16 18:03:23,462::task::1168::TaskManager.Task::(prepare) Task=`26e265fc-ceb2-4b9e-a798-22cb83658194`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55231::DEBUG::2014-05-16 18:03:23,462::task::579::TaskManager.Task::(_updateState) Task=`26e265fc-ceb2-4b9e-a798-22cb83658194`::moving from state preparing -> state finished >Thread-55231::DEBUG::2014-05-16 18:03:23,462::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55231::DEBUG::2014-05-16 18:03:23,462::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55231::DEBUG::2014-05-16 18:03:23,462::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55231::DEBUG::2014-05-16 18:03:23,463::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55231::DEBUG::2014-05-16 18:03:23,463::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55231::DEBUG::2014-05-16 18:03:23,463::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55231::DEBUG::2014-05-16 18:03:23,463::task::974::TaskManager.Task::(_decref) Task=`26e265fc-ceb2-4b9e-a798-22cb83658194`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:03:24,693::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:24,762::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309775 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:03:26,406::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:03:26,417::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104982 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:26,774::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:26,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350767 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:28,857::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:28,928::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352249 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:30,940::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:31,008::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317747 s, 32.2 MB/s\n'; <rc> = 0 >Thread-55234::DEBUG::2014-05-16 18:03:32,900::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3244122.000000 / 8.008712 / 262500000.000000 = 0.154314 >Thread-55234::DEBUG::2014-05-16 18:03:32,900::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041519548077665743, 'statsAge': 1.6645920276641846, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15431395567308978, 'rxDropped': 0} >Thread-55234::DEBUG::2014-05-16 18:03:32,901::task::579::TaskManager.Task::(_updateState) Task=`b6e882a8-f3bb-4a55-8ef0-0e4b11b66f2a`::moving from state init -> state preparing >Thread-55234::INFO::2014-05-16 18:03:32,901::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55234::INFO::2014-05-16 18:03:32,901::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104982', 'lastCheck': '6.5', 'valid': True}} >Thread-55234::DEBUG::2014-05-16 18:03:32,902::task::1168::TaskManager.Task::(prepare) Task=`b6e882a8-f3bb-4a55-8ef0-0e4b11b66f2a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104982', 'lastCheck': '6.5', 'valid': True}} >Thread-55234::DEBUG::2014-05-16 18:03:32,902::task::579::TaskManager.Task::(_updateState) Task=`b6e882a8-f3bb-4a55-8ef0-0e4b11b66f2a`::moving from state preparing -> state finished >Thread-55234::DEBUG::2014-05-16 18:03:32,902::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55234::DEBUG::2014-05-16 18:03:32,902::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55234::DEBUG::2014-05-16 18:03:32,902::task::974::TaskManager.Task::(_decref) Task=`b6e882a8-f3bb-4a55-8ef0-0e4b11b66f2a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:03:33,020::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:33,092::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363101 s, 28.2 MB/s\n'; <rc> = 0 >Thread-55236::DEBUG::2014-05-16 18:03:33,494::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55236::DEBUG::2014-05-16 18:03:33,494::task::579::TaskManager.Task::(_updateState) Task=`65925e3f-d1fc-46c4-b345-6ed6323c3671`::moving from state init -> state preparing >Thread-55236::INFO::2014-05-16 18:03:33,494::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55236::INFO::2014-05-16 18:03:33,495::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55236::DEBUG::2014-05-16 18:03:33,495::task::1168::TaskManager.Task::(prepare) Task=`65925e3f-d1fc-46c4-b345-6ed6323c3671`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55236::DEBUG::2014-05-16 18:03:33,495::task::579::TaskManager.Task::(_updateState) Task=`65925e3f-d1fc-46c4-b345-6ed6323c3671`::moving from state preparing -> state finished >Thread-55236::DEBUG::2014-05-16 18:03:33,495::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55236::DEBUG::2014-05-16 18:03:33,495::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55236::DEBUG::2014-05-16 18:03:33,495::task::974::TaskManager.Task::(_decref) Task=`65925e3f-d1fc-46c4-b345-6ed6323c3671`::ref 0 aborting False >Thread-55237::DEBUG::2014-05-16 18:03:33,504::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55237::DEBUG::2014-05-16 18:03:33,504::task::579::TaskManager.Task::(_updateState) Task=`ae057484-138d-4381-a5c0-426ce4776342`::moving from state init -> state preparing >Thread-55237::INFO::2014-05-16 18:03:33,504::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55237::DEBUG::2014-05-16 18:03:33,504::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`35458b3b-f816-470a-a671-6ea670d3df12`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55237::DEBUG::2014-05-16 18:03:33,504::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55237::DEBUG::2014-05-16 18:03:33,505::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55237::DEBUG::2014-05-16 18:03:33,505::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`35458b3b-f816-470a-a671-6ea670d3df12`::Granted request >Thread-55237::DEBUG::2014-05-16 18:03:33,505::task::811::TaskManager.Task::(resourceAcquired) Task=`ae057484-138d-4381-a5c0-426ce4776342`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55237::DEBUG::2014-05-16 18:03:33,505::task::974::TaskManager.Task::(_decref) Task=`ae057484-138d-4381-a5c0-426ce4776342`::ref 1 aborting False >Thread-55237::INFO::2014-05-16 18:03:33,506::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55237::DEBUG::2014-05-16 18:03:33,506::task::1168::TaskManager.Task::(prepare) Task=`ae057484-138d-4381-a5c0-426ce4776342`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55237::DEBUG::2014-05-16 18:03:33,506::task::579::TaskManager.Task::(_updateState) Task=`ae057484-138d-4381-a5c0-426ce4776342`::moving from state preparing -> state finished >Thread-55237::DEBUG::2014-05-16 18:03:33,506::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55237::DEBUG::2014-05-16 18:03:33,506::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55237::DEBUG::2014-05-16 18:03:33,507::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55237::DEBUG::2014-05-16 18:03:33,507::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55237::DEBUG::2014-05-16 18:03:33,507::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55237::DEBUG::2014-05-16 18:03:33,507::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55237::DEBUG::2014-05-16 18:03:33,507::task::974::TaskManager.Task::(_decref) Task=`ae057484-138d-4381-a5c0-426ce4776342`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:03:35,104::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:35,171::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313744 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:03:36,449::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:03:36,459::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598609 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:37,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:37,258::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341103 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:39,270::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:39,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320274 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:41,350::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:41,422::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354271 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:43,434::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:43,506::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355195 s, 28.8 MB/s\n'; <rc> = 0 >Thread-55241::DEBUG::2014-05-16 18:03:43,643::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55241::DEBUG::2014-05-16 18:03:43,645::task::579::TaskManager.Task::(_updateState) Task=`f13860d3-37e2-48b1-aab8-6e6ebc7121c6`::moving from state init -> state preparing >Thread-55241::INFO::2014-05-16 18:03:43,645::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55241::INFO::2014-05-16 18:03:43,645::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55241::DEBUG::2014-05-16 18:03:43,646::task::1168::TaskManager.Task::(prepare) Task=`f13860d3-37e2-48b1-aab8-6e6ebc7121c6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55241::DEBUG::2014-05-16 18:03:43,646::task::579::TaskManager.Task::(_updateState) Task=`f13860d3-37e2-48b1-aab8-6e6ebc7121c6`::moving from state preparing -> state finished >Thread-55241::DEBUG::2014-05-16 18:03:43,646::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55241::DEBUG::2014-05-16 18:03:43,646::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55241::DEBUG::2014-05-16 18:03:43,646::task::974::TaskManager.Task::(_decref) Task=`f13860d3-37e2-48b1-aab8-6e6ebc7121c6`::ref 0 aborting False >Thread-55242::DEBUG::2014-05-16 18:03:43,673::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55242::DEBUG::2014-05-16 18:03:43,674::task::579::TaskManager.Task::(_updateState) Task=`cf9ffca8-f956-4699-a45d-03b52e1478c6`::moving from state init -> state preparing >Thread-55242::INFO::2014-05-16 18:03:43,674::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55242::DEBUG::2014-05-16 18:03:43,674::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`54896c85-861e-4c9f-922e-7ebb8d7cc146`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55242::DEBUG::2014-05-16 18:03:43,674::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55242::DEBUG::2014-05-16 18:03:43,675::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55242::DEBUG::2014-05-16 18:03:43,675::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`54896c85-861e-4c9f-922e-7ebb8d7cc146`::Granted request >Thread-55242::DEBUG::2014-05-16 18:03:43,675::task::811::TaskManager.Task::(resourceAcquired) Task=`cf9ffca8-f956-4699-a45d-03b52e1478c6`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55242::DEBUG::2014-05-16 18:03:43,675::task::974::TaskManager.Task::(_decref) Task=`cf9ffca8-f956-4699-a45d-03b52e1478c6`::ref 1 aborting False >Thread-55242::INFO::2014-05-16 18:03:43,676::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55242::DEBUG::2014-05-16 18:03:43,676::task::1168::TaskManager.Task::(prepare) Task=`cf9ffca8-f956-4699-a45d-03b52e1478c6`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55242::DEBUG::2014-05-16 18:03:43,676::task::579::TaskManager.Task::(_updateState) Task=`cf9ffca8-f956-4699-a45d-03b52e1478c6`::moving from state preparing -> state finished >Thread-55242::DEBUG::2014-05-16 18:03:43,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55242::DEBUG::2014-05-16 18:03:43,677::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55242::DEBUG::2014-05-16 18:03:43,677::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55242::DEBUG::2014-05-16 18:03:43,677::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55242::DEBUG::2014-05-16 18:03:43,677::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55242::DEBUG::2014-05-16 18:03:43,677::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55242::DEBUG::2014-05-16 18:03:43,677::task::974::TaskManager.Task::(_decref) Task=`cf9ffca8-f956-4699-a45d-03b52e1478c6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:03:45,517::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:45,584::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307802 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:03:46,497::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:03:46,507::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752579 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:47,595::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:47,670::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385545 s, 26.6 MB/s\n'; <rc> = 0 >Thread-55244::DEBUG::2014-05-16 18:03:48,333::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316692.000000 / 8.008612 / 262500000.000000 = 0.205336 >Thread-55244::DEBUG::2014-05-16 18:03:48,333::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053538556771970409, 'statsAge': 1.0776360034942627, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20533572011968734, 'rxDropped': 0} >Thread-55244::DEBUG::2014-05-16 18:03:48,334::task::579::TaskManager.Task::(_updateState) Task=`e8bc6e41-c09c-4607-a02a-7b4bdd45c3eb`::moving from state init -> state preparing >Thread-55244::INFO::2014-05-16 18:03:48,334::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55244::INFO::2014-05-16 18:03:48,334::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752579', 'lastCheck': '1.8', 'valid': True}} >Thread-55244::DEBUG::2014-05-16 18:03:48,334::task::1168::TaskManager.Task::(prepare) Task=`e8bc6e41-c09c-4607-a02a-7b4bdd45c3eb`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752579', 'lastCheck': '1.8', 'valid': True}} >Thread-55244::DEBUG::2014-05-16 18:03:48,334::task::579::TaskManager.Task::(_updateState) Task=`e8bc6e41-c09c-4607-a02a-7b4bdd45c3eb`::moving from state preparing -> state finished >Thread-55244::DEBUG::2014-05-16 18:03:48,334::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55244::DEBUG::2014-05-16 18:03:48,334::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55244::DEBUG::2014-05-16 18:03:48,335::task::974::TaskManager.Task::(_decref) Task=`e8bc6e41-c09c-4607-a02a-7b4bdd45c3eb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:03:49,682::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:49,750::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031384 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:51,761::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:51,828::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311663 s, 32.9 MB/s\n'; <rc> = 0 >Thread-55247::DEBUG::2014-05-16 18:03:53,817::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55247::DEBUG::2014-05-16 18:03:53,818::task::579::TaskManager.Task::(_updateState) Task=`34ad0391-5a02-4fbf-b8bc-f884e8473a5b`::moving from state init -> state preparing >Thread-55247::INFO::2014-05-16 18:03:53,818::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55247::INFO::2014-05-16 18:03:53,818::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55247::DEBUG::2014-05-16 18:03:53,818::task::1168::TaskManager.Task::(prepare) Task=`34ad0391-5a02-4fbf-b8bc-f884e8473a5b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55247::DEBUG::2014-05-16 18:03:53,819::task::579::TaskManager.Task::(_updateState) Task=`34ad0391-5a02-4fbf-b8bc-f884e8473a5b`::moving from state preparing -> state finished >Thread-55247::DEBUG::2014-05-16 18:03:53,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55247::DEBUG::2014-05-16 18:03:53,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55247::DEBUG::2014-05-16 18:03:53,819::task::974::TaskManager.Task::(_decref) Task=`34ad0391-5a02-4fbf-b8bc-f884e8473a5b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:03:53,840::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55248::DEBUG::2014-05-16 18:03:53,861::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55248::DEBUG::2014-05-16 18:03:53,862::task::579::TaskManager.Task::(_updateState) Task=`cd26986b-02ad-43f7-9d4d-0c7d921b7c58`::moving from state init -> state preparing >Thread-55248::INFO::2014-05-16 18:03:53,864::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55248::DEBUG::2014-05-16 18:03:53,866::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c7a50878-2f09-4417-a715-e67f29a3a919`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55248::DEBUG::2014-05-16 18:03:53,866::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55248::DEBUG::2014-05-16 18:03:53,867::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55248::DEBUG::2014-05-16 18:03:53,868::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c7a50878-2f09-4417-a715-e67f29a3a919`::Granted request >Thread-55248::DEBUG::2014-05-16 18:03:53,870::task::811::TaskManager.Task::(resourceAcquired) Task=`cd26986b-02ad-43f7-9d4d-0c7d921b7c58`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55248::DEBUG::2014-05-16 18:03:53,871::task::974::TaskManager.Task::(_decref) Task=`cd26986b-02ad-43f7-9d4d-0c7d921b7c58`::ref 1 aborting False >Thread-55248::INFO::2014-05-16 18:03:53,875::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55248::DEBUG::2014-05-16 18:03:53,876::task::1168::TaskManager.Task::(prepare) Task=`cd26986b-02ad-43f7-9d4d-0c7d921b7c58`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55248::DEBUG::2014-05-16 18:03:53,877::task::579::TaskManager.Task::(_updateState) Task=`cd26986b-02ad-43f7-9d4d-0c7d921b7c58`::moving from state preparing -> state finished >Thread-55248::DEBUG::2014-05-16 18:03:53,877::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55248::DEBUG::2014-05-16 18:03:53,878::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55248::DEBUG::2014-05-16 18:03:53,879::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55248::DEBUG::2014-05-16 18:03:53,881::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55248::DEBUG::2014-05-16 18:03:53,881::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55248::DEBUG::2014-05-16 18:03:53,882::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55248::DEBUG::2014-05-16 18:03:53,883::task::974::TaskManager.Task::(_decref) Task=`cd26986b-02ad-43f7-9d4d-0c7d921b7c58`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:03:53,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0601923 s, 17.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:55,950::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:56,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0916208 s, 11.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:03:56,545::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:03:56,555::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000832352 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:03:58,090::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:03:58,161::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351664 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:00,173::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:00,244::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348117 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:02,256::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:02,325::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314226 s, 32.6 MB/s\n'; <rc> = 0 >Thread-55252::DEBUG::2014-05-16 18:04:03,667::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5409933.000000 / 8.008302 / 262500000.000000 = 0.257349 >Thread-55252::DEBUG::2014-05-16 18:04:03,667::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0062915661862498248, 'statsAge': 0.39498805999755859, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25734879428910534, 'rxDropped': 0} >Thread-55252::DEBUG::2014-05-16 18:04:03,669::task::579::TaskManager.Task::(_updateState) Task=`3792adb8-de99-484b-9b78-fe0f414f42a7`::moving from state init -> state preparing >Thread-55252::INFO::2014-05-16 18:04:03,669::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55252::INFO::2014-05-16 18:04:03,669::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000832352', 'lastCheck': '7.1', 'valid': True}} >Thread-55252::DEBUG::2014-05-16 18:04:03,669::task::1168::TaskManager.Task::(prepare) Task=`3792adb8-de99-484b-9b78-fe0f414f42a7`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000832352', 'lastCheck': '7.1', 'valid': True}} >Thread-55252::DEBUG::2014-05-16 18:04:03,669::task::579::TaskManager.Task::(_updateState) Task=`3792adb8-de99-484b-9b78-fe0f414f42a7`::moving from state preparing -> state finished >Thread-55252::DEBUG::2014-05-16 18:04:03,670::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55252::DEBUG::2014-05-16 18:04:03,670::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55252::DEBUG::2014-05-16 18:04:03,670::task::974::TaskManager.Task::(_decref) Task=`3792adb8-de99-484b-9b78-fe0f414f42a7`::ref 0 aborting False >Thread-55254::DEBUG::2014-05-16 18:04:03,927::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55254::DEBUG::2014-05-16 18:04:03,927::task::579::TaskManager.Task::(_updateState) Task=`5f8b547b-41c1-4d99-82fd-e2a40efa8839`::moving from state init -> state preparing >Thread-55254::INFO::2014-05-16 18:04:03,927::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55254::INFO::2014-05-16 18:04:03,927::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55254::DEBUG::2014-05-16 18:04:03,927::task::1168::TaskManager.Task::(prepare) Task=`5f8b547b-41c1-4d99-82fd-e2a40efa8839`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55254::DEBUG::2014-05-16 18:04:03,928::task::579::TaskManager.Task::(_updateState) Task=`5f8b547b-41c1-4d99-82fd-e2a40efa8839`::moving from state preparing -> state finished >Thread-55254::DEBUG::2014-05-16 18:04:03,928::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55254::DEBUG::2014-05-16 18:04:03,928::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55254::DEBUG::2014-05-16 18:04:03,928::task::974::TaskManager.Task::(_decref) Task=`5f8b547b-41c1-4d99-82fd-e2a40efa8839`::ref 0 aborting False >Thread-55255::DEBUG::2014-05-16 18:04:03,951::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55255::DEBUG::2014-05-16 18:04:03,951::task::579::TaskManager.Task::(_updateState) Task=`50fb3c15-74fd-4b22-a5d0-68f901d8ea80`::moving from state init -> state preparing >Thread-55255::INFO::2014-05-16 18:04:03,951::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55255::DEBUG::2014-05-16 18:04:03,951::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`26fa7085-70c5-4a29-bfcf-9d8e70731129`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55255::DEBUG::2014-05-16 18:04:03,952::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55255::DEBUG::2014-05-16 18:04:03,952::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55255::DEBUG::2014-05-16 18:04:03,952::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`26fa7085-70c5-4a29-bfcf-9d8e70731129`::Granted request >Thread-55255::DEBUG::2014-05-16 18:04:03,952::task::811::TaskManager.Task::(resourceAcquired) Task=`50fb3c15-74fd-4b22-a5d0-68f901d8ea80`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55255::DEBUG::2014-05-16 18:04:03,952::task::974::TaskManager.Task::(_decref) Task=`50fb3c15-74fd-4b22-a5d0-68f901d8ea80`::ref 1 aborting False >Thread-55255::INFO::2014-05-16 18:04:03,953::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55255::DEBUG::2014-05-16 18:04:03,953::task::1168::TaskManager.Task::(prepare) Task=`50fb3c15-74fd-4b22-a5d0-68f901d8ea80`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55255::DEBUG::2014-05-16 18:04:03,953::task::579::TaskManager.Task::(_updateState) Task=`50fb3c15-74fd-4b22-a5d0-68f901d8ea80`::moving from state preparing -> state finished >Thread-55255::DEBUG::2014-05-16 18:04:03,953::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55255::DEBUG::2014-05-16 18:04:03,953::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55255::DEBUG::2014-05-16 18:04:03,954::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55255::DEBUG::2014-05-16 18:04:03,954::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55255::DEBUG::2014-05-16 18:04:03,954::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55255::DEBUG::2014-05-16 18:04:03,954::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55255::DEBUG::2014-05-16 18:04:03,954::task::974::TaskManager.Task::(_decref) Task=`50fb3c15-74fd-4b22-a5d0-68f901d8ea80`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:04:04,336::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:04,403::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309126 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:06,415::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:06,481::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302933 s, 33.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:04:06,596::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:04:06,606::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760111 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:08,493::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:08,564::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348778 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:10,576::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:10,642::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304988 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:12,654::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:12,721::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308859 s, 33.2 MB/s\n'; <rc> = 0 >Thread-55259::DEBUG::2014-05-16 18:04:14,177::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55259::DEBUG::2014-05-16 18:04:14,178::task::579::TaskManager.Task::(_updateState) Task=`50907ad7-af34-4677-a2e9-07d365393f27`::moving from state init -> state preparing >Thread-55259::INFO::2014-05-16 18:04:14,178::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55259::INFO::2014-05-16 18:04:14,178::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55259::DEBUG::2014-05-16 18:04:14,178::task::1168::TaskManager.Task::(prepare) Task=`50907ad7-af34-4677-a2e9-07d365393f27`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55259::DEBUG::2014-05-16 18:04:14,179::task::579::TaskManager.Task::(_updateState) Task=`50907ad7-af34-4677-a2e9-07d365393f27`::moving from state preparing -> state finished >Thread-55259::DEBUG::2014-05-16 18:04:14,179::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55259::DEBUG::2014-05-16 18:04:14,179::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55259::DEBUG::2014-05-16 18:04:14,179::task::974::TaskManager.Task::(_decref) Task=`50907ad7-af34-4677-a2e9-07d365393f27`::ref 0 aborting False >Thread-55260::DEBUG::2014-05-16 18:04:14,187::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55260::DEBUG::2014-05-16 18:04:14,187::task::579::TaskManager.Task::(_updateState) Task=`cffcec2e-5c96-44ed-91d5-7271592688cd`::moving from state init -> state preparing >Thread-55260::INFO::2014-05-16 18:04:14,188::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55260::DEBUG::2014-05-16 18:04:14,188::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c347fe2f-05e0-4a71-8790-355e59e98cc0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55260::DEBUG::2014-05-16 18:04:14,188::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55260::DEBUG::2014-05-16 18:04:14,188::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55260::DEBUG::2014-05-16 18:04:14,189::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c347fe2f-05e0-4a71-8790-355e59e98cc0`::Granted request >Thread-55260::DEBUG::2014-05-16 18:04:14,189::task::811::TaskManager.Task::(resourceAcquired) Task=`cffcec2e-5c96-44ed-91d5-7271592688cd`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55260::DEBUG::2014-05-16 18:04:14,189::task::974::TaskManager.Task::(_decref) Task=`cffcec2e-5c96-44ed-91d5-7271592688cd`::ref 1 aborting False >Thread-55260::INFO::2014-05-16 18:04:14,190::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55260::DEBUG::2014-05-16 18:04:14,190::task::1168::TaskManager.Task::(prepare) Task=`cffcec2e-5c96-44ed-91d5-7271592688cd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55260::DEBUG::2014-05-16 18:04:14,190::task::579::TaskManager.Task::(_updateState) Task=`cffcec2e-5c96-44ed-91d5-7271592688cd`::moving from state preparing -> state finished >Thread-55260::DEBUG::2014-05-16 18:04:14,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55260::DEBUG::2014-05-16 18:04:14,190::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55260::DEBUG::2014-05-16 18:04:14,191::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55260::DEBUG::2014-05-16 18:04:14,191::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55260::DEBUG::2014-05-16 18:04:14,191::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55260::DEBUG::2014-05-16 18:04:14,191::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55260::DEBUG::2014-05-16 18:04:14,191::task::974::TaskManager.Task::(_decref) Task=`cffcec2e-5c96-44ed-91d5-7271592688cd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:04:14,739::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:14,811::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352031 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:04:16,641::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:04:16,651::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110484 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:16,822::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:16,893::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347523 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:18,904::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:18,970::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307382 s, 33.3 MB/s\n'; <rc> = 0 >Thread-55262::DEBUG::2014-05-16 18:04:19,261::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3247891.000000 / 8.008648 / 262500000.000000 = 0.154494 >Thread-55262::DEBUG::2014-05-16 18:04:19,261::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041519879337138148, 'statsAge': 1.973459005355835, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15449446923925594, 'rxDropped': 0} >Thread-55262::DEBUG::2014-05-16 18:04:19,262::task::579::TaskManager.Task::(_updateState) Task=`73ffee22-2def-4121-a26a-c81e84d4b864`::moving from state init -> state preparing >Thread-55262::INFO::2014-05-16 18:04:19,262::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55262::INFO::2014-05-16 18:04:19,262::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110484', 'lastCheck': '2.6', 'valid': True}} >Thread-55262::DEBUG::2014-05-16 18:04:19,262::task::1168::TaskManager.Task::(prepare) Task=`73ffee22-2def-4121-a26a-c81e84d4b864`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110484', 'lastCheck': '2.6', 'valid': True}} >Thread-55262::DEBUG::2014-05-16 18:04:19,262::task::579::TaskManager.Task::(_updateState) Task=`73ffee22-2def-4121-a26a-c81e84d4b864`::moving from state preparing -> state finished >Thread-55262::DEBUG::2014-05-16 18:04:19,262::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55262::DEBUG::2014-05-16 18:04:19,263::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55262::DEBUG::2014-05-16 18:04:19,263::task::974::TaskManager.Task::(_decref) Task=`73ffee22-2def-4121-a26a-c81e84d4b864`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:04:20,982::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:21,055::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350593 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:23,067::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:23,139::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036094 s, 28.4 MB/s\n'; <rc> = 0 >Thread-55265::DEBUG::2014-05-16 18:04:24,228::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55265::DEBUG::2014-05-16 18:04:24,228::task::579::TaskManager.Task::(_updateState) Task=`156fc10b-409c-4a93-bd8f-2c46adbc9c23`::moving from state init -> state preparing >Thread-55265::INFO::2014-05-16 18:04:24,229::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55265::INFO::2014-05-16 18:04:24,229::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55265::DEBUG::2014-05-16 18:04:24,229::task::1168::TaskManager.Task::(prepare) Task=`156fc10b-409c-4a93-bd8f-2c46adbc9c23`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55265::DEBUG::2014-05-16 18:04:24,229::task::579::TaskManager.Task::(_updateState) Task=`156fc10b-409c-4a93-bd8f-2c46adbc9c23`::moving from state preparing -> state finished >Thread-55265::DEBUG::2014-05-16 18:04:24,229::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55265::DEBUG::2014-05-16 18:04:24,230::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55265::DEBUG::2014-05-16 18:04:24,230::task::974::TaskManager.Task::(_decref) Task=`156fc10b-409c-4a93-bd8f-2c46adbc9c23`::ref 0 aborting False >Thread-55266::DEBUG::2014-05-16 18:04:24,250::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55266::DEBUG::2014-05-16 18:04:24,250::task::579::TaskManager.Task::(_updateState) Task=`a58d68fd-1e42-45b4-9f5b-b6666e6163c7`::moving from state init -> state preparing >Thread-55266::INFO::2014-05-16 18:04:24,250::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55266::DEBUG::2014-05-16 18:04:24,250::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`91b72daa-371d-40f6-9eaf-4803e3c0f60e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55266::DEBUG::2014-05-16 18:04:24,251::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55266::DEBUG::2014-05-16 18:04:24,251::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55266::DEBUG::2014-05-16 18:04:24,251::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`91b72daa-371d-40f6-9eaf-4803e3c0f60e`::Granted request >Thread-55266::DEBUG::2014-05-16 18:04:24,251::task::811::TaskManager.Task::(resourceAcquired) Task=`a58d68fd-1e42-45b4-9f5b-b6666e6163c7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55266::DEBUG::2014-05-16 18:04:24,251::task::974::TaskManager.Task::(_decref) Task=`a58d68fd-1e42-45b4-9f5b-b6666e6163c7`::ref 1 aborting False >Thread-55266::INFO::2014-05-16 18:04:24,252::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55266::DEBUG::2014-05-16 18:04:24,252::task::1168::TaskManager.Task::(prepare) Task=`a58d68fd-1e42-45b4-9f5b-b6666e6163c7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55266::DEBUG::2014-05-16 18:04:24,252::task::579::TaskManager.Task::(_updateState) Task=`a58d68fd-1e42-45b4-9f5b-b6666e6163c7`::moving from state preparing -> state finished >Thread-55266::DEBUG::2014-05-16 18:04:24,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55266::DEBUG::2014-05-16 18:04:24,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55266::DEBUG::2014-05-16 18:04:24,253::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55266::DEBUG::2014-05-16 18:04:24,253::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55266::DEBUG::2014-05-16 18:04:24,253::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55266::DEBUG::2014-05-16 18:04:24,253::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55266::DEBUG::2014-05-16 18:04:24,254::task::974::TaskManager.Task::(_decref) Task=`a58d68fd-1e42-45b4-9f5b-b6666e6163c7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:04:25,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:25,217::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306121 s, 33.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:04:26,689::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:04:26,699::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110385 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:27,229::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:27,306::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355359 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:29,317::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:29,387::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346382 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:31,399::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:31,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304671 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:33,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:33,546::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315262 s, 32.5 MB/s\n'; <rc> = 0 >Thread-55270::DEBUG::2014-05-16 18:04:34,328::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55270::DEBUG::2014-05-16 18:04:34,329::task::579::TaskManager.Task::(_updateState) Task=`317c9196-1361-4271-9cf9-6a06fe3313e5`::moving from state init -> state preparing >Thread-55270::INFO::2014-05-16 18:04:34,330::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55270::INFO::2014-05-16 18:04:34,330::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55270::DEBUG::2014-05-16 18:04:34,330::task::1168::TaskManager.Task::(prepare) Task=`317c9196-1361-4271-9cf9-6a06fe3313e5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55270::DEBUG::2014-05-16 18:04:34,330::task::579::TaskManager.Task::(_updateState) Task=`317c9196-1361-4271-9cf9-6a06fe3313e5`::moving from state preparing -> state finished >Thread-55270::DEBUG::2014-05-16 18:04:34,330::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55270::DEBUG::2014-05-16 18:04:34,331::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55270::DEBUG::2014-05-16 18:04:34,331::task::974::TaskManager.Task::(_decref) Task=`317c9196-1361-4271-9cf9-6a06fe3313e5`::ref 0 aborting False >Thread-55271::DEBUG::2014-05-16 18:04:34,349::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55271::DEBUG::2014-05-16 18:04:34,350::task::579::TaskManager.Task::(_updateState) Task=`96c087fc-ec4a-46ec-a452-27664c0b9988`::moving from state init -> state preparing >Thread-55271::INFO::2014-05-16 18:04:34,350::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55271::DEBUG::2014-05-16 18:04:34,350::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0f3a07d7-8102-464b-b38a-fec086adf61e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55271::DEBUG::2014-05-16 18:04:34,351::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55271::DEBUG::2014-05-16 18:04:34,351::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55271::DEBUG::2014-05-16 18:04:34,351::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0f3a07d7-8102-464b-b38a-fec086adf61e`::Granted request >Thread-55271::DEBUG::2014-05-16 18:04:34,351::task::811::TaskManager.Task::(resourceAcquired) Task=`96c087fc-ec4a-46ec-a452-27664c0b9988`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55271::DEBUG::2014-05-16 18:04:34,351::task::974::TaskManager.Task::(_decref) Task=`96c087fc-ec4a-46ec-a452-27664c0b9988`::ref 1 aborting False >Thread-55271::INFO::2014-05-16 18:04:34,352::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55271::DEBUG::2014-05-16 18:04:34,352::task::1168::TaskManager.Task::(prepare) Task=`96c087fc-ec4a-46ec-a452-27664c0b9988`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55271::DEBUG::2014-05-16 18:04:34,352::task::579::TaskManager.Task::(_updateState) Task=`96c087fc-ec4a-46ec-a452-27664c0b9988`::moving from state preparing -> state finished >Thread-55271::DEBUG::2014-05-16 18:04:34,353::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55271::DEBUG::2014-05-16 18:04:34,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55271::DEBUG::2014-05-16 18:04:34,353::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55271::DEBUG::2014-05-16 18:04:34,353::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55271::DEBUG::2014-05-16 18:04:34,353::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55271::DEBUG::2014-05-16 18:04:34,353::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55271::DEBUG::2014-05-16 18:04:34,354::task::974::TaskManager.Task::(_decref) Task=`96c087fc-ec4a-46ec-a452-27664c0b9988`::ref 0 aborting False >Thread-55272::DEBUG::2014-05-16 18:04:34,582::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4310862.000000 / 8.011257 / 262500000.000000 = 0.204991 >Thread-55272::DEBUG::2014-05-16 18:04:34,583::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051501816650492502, 'statsAge': 1.275393009185791, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20499069703393663, 'rxDropped': 0} >Thread-55272::DEBUG::2014-05-16 18:04:34,583::task::579::TaskManager.Task::(_updateState) Task=`42036596-2a7c-4568-9cec-76838d05de02`::moving from state init -> state preparing >Thread-55272::INFO::2014-05-16 18:04:34,583::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55272::INFO::2014-05-16 18:04:34,583::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110385', 'lastCheck': '7.9', 'valid': True}} >Thread-55272::DEBUG::2014-05-16 18:04:34,583::task::1168::TaskManager.Task::(prepare) Task=`42036596-2a7c-4568-9cec-76838d05de02`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110385', 'lastCheck': '7.9', 'valid': True}} >Thread-55272::DEBUG::2014-05-16 18:04:34,584::task::579::TaskManager.Task::(_updateState) Task=`42036596-2a7c-4568-9cec-76838d05de02`::moving from state preparing -> state finished >Thread-55272::DEBUG::2014-05-16 18:04:34,584::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55272::DEBUG::2014-05-16 18:04:34,584::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55272::DEBUG::2014-05-16 18:04:34,584::task::974::TaskManager.Task::(_decref) Task=`42036596-2a7c-4568-9cec-76838d05de02`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:04:35,558::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:35,628::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347877 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:04:36,732::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:04:36,743::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000807189 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:37,640::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:37,711::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034434 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:39,722::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:39,790::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311787 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:41,802::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:41,873::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355777 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:43,885::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:43,958::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354175 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55277::DEBUG::2014-05-16 18:04:44,419::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55277::DEBUG::2014-05-16 18:04:44,419::task::579::TaskManager.Task::(_updateState) Task=`59572485-e852-48cb-81ec-853f9a081dbf`::moving from state init -> state preparing >Thread-55277::INFO::2014-05-16 18:04:44,420::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55277::INFO::2014-05-16 18:04:44,420::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55277::DEBUG::2014-05-16 18:04:44,420::task::1168::TaskManager.Task::(prepare) Task=`59572485-e852-48cb-81ec-853f9a081dbf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55277::DEBUG::2014-05-16 18:04:44,420::task::579::TaskManager.Task::(_updateState) Task=`59572485-e852-48cb-81ec-853f9a081dbf`::moving from state preparing -> state finished >Thread-55277::DEBUG::2014-05-16 18:04:44,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55277::DEBUG::2014-05-16 18:04:44,421::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55277::DEBUG::2014-05-16 18:04:44,421::task::974::TaskManager.Task::(_decref) Task=`59572485-e852-48cb-81ec-853f9a081dbf`::ref 0 aborting False >Thread-55278::DEBUG::2014-05-16 18:04:44,438::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55278::DEBUG::2014-05-16 18:04:44,439::task::579::TaskManager.Task::(_updateState) Task=`211f4b77-e7c7-49ad-89e1-cb5d0dcb67cd`::moving from state init -> state preparing >Thread-55278::INFO::2014-05-16 18:04:44,439::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55278::DEBUG::2014-05-16 18:04:44,439::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cb891803-46bb-4f73-8b9c-8d769e8b87d5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55278::DEBUG::2014-05-16 18:04:44,439::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55278::DEBUG::2014-05-16 18:04:44,440::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55278::DEBUG::2014-05-16 18:04:44,440::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cb891803-46bb-4f73-8b9c-8d769e8b87d5`::Granted request >Thread-55278::DEBUG::2014-05-16 18:04:44,440::task::811::TaskManager.Task::(resourceAcquired) Task=`211f4b77-e7c7-49ad-89e1-cb5d0dcb67cd`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55278::DEBUG::2014-05-16 18:04:44,440::task::974::TaskManager.Task::(_decref) Task=`211f4b77-e7c7-49ad-89e1-cb5d0dcb67cd`::ref 1 aborting False >Thread-55278::INFO::2014-05-16 18:04:44,441::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55278::DEBUG::2014-05-16 18:04:44,441::task::1168::TaskManager.Task::(prepare) Task=`211f4b77-e7c7-49ad-89e1-cb5d0dcb67cd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55278::DEBUG::2014-05-16 18:04:44,441::task::579::TaskManager.Task::(_updateState) Task=`211f4b77-e7c7-49ad-89e1-cb5d0dcb67cd`::moving from state preparing -> state finished >Thread-55278::DEBUG::2014-05-16 18:04:44,441::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55278::DEBUG::2014-05-16 18:04:44,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55278::DEBUG::2014-05-16 18:04:44,442::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55278::DEBUG::2014-05-16 18:04:44,442::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55278::DEBUG::2014-05-16 18:04:44,442::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55278::DEBUG::2014-05-16 18:04:44,442::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55278::DEBUG::2014-05-16 18:04:44,442::task::974::TaskManager.Task::(_decref) Task=`211f4b77-e7c7-49ad-89e1-cb5d0dcb67cd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:04:45,969::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:46,036::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303869 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:04:46,780::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:04:46,790::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000797581 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:48,048::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:48,119::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351737 s, 29.1 MB/s\n'; <rc> = 0 >Thread-55280::DEBUG::2014-05-16 18:04:50,012::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316028.000000 / 8.008441 / 262500000.000000 = 0.205309 >Thread-55280::DEBUG::2014-05-16 18:04:50,012::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005368335594126283, 'statsAge': 0.68775081634521484, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20530851133008729, 'rxDropped': 0} >Thread-55280::DEBUG::2014-05-16 18:04:50,012::task::579::TaskManager.Task::(_updateState) Task=`39f52cb6-6d9d-4f52-b95e-b8c6b9479caf`::moving from state init -> state preparing >Thread-55280::INFO::2014-05-16 18:04:50,013::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55280::INFO::2014-05-16 18:04:50,013::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797581', 'lastCheck': '3.2', 'valid': True}} >Thread-55280::DEBUG::2014-05-16 18:04:50,013::task::1168::TaskManager.Task::(prepare) Task=`39f52cb6-6d9d-4f52-b95e-b8c6b9479caf`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797581', 'lastCheck': '3.2', 'valid': True}} >Thread-55280::DEBUG::2014-05-16 18:04:50,013::task::579::TaskManager.Task::(_updateState) Task=`39f52cb6-6d9d-4f52-b95e-b8c6b9479caf`::moving from state preparing -> state finished >Thread-55280::DEBUG::2014-05-16 18:04:50,013::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55280::DEBUG::2014-05-16 18:04:50,013::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55280::DEBUG::2014-05-16 18:04:50,013::task::974::TaskManager.Task::(_decref) Task=`39f52cb6-6d9d-4f52-b95e-b8c6b9479caf`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:04:50,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:50,198::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307453 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:52,209::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:52,277::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313631 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:54,288::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:54,356::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034751 s, 29.5 MB/s\n'; <rc> = 0 >Thread-55283::DEBUG::2014-05-16 18:04:54,558::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55283::DEBUG::2014-05-16 18:04:54,558::task::579::TaskManager.Task::(_updateState) Task=`a8a18d20-9eeb-4284-bb1b-68d8311afe16`::moving from state init -> state preparing >Thread-55283::INFO::2014-05-16 18:04:54,559::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55283::INFO::2014-05-16 18:04:54,559::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55283::DEBUG::2014-05-16 18:04:54,559::task::1168::TaskManager.Task::(prepare) Task=`a8a18d20-9eeb-4284-bb1b-68d8311afe16`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55283::DEBUG::2014-05-16 18:04:54,559::task::579::TaskManager.Task::(_updateState) Task=`a8a18d20-9eeb-4284-bb1b-68d8311afe16`::moving from state preparing -> state finished >Thread-55283::DEBUG::2014-05-16 18:04:54,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55283::DEBUG::2014-05-16 18:04:54,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55283::DEBUG::2014-05-16 18:04:54,559::task::974::TaskManager.Task::(_decref) Task=`a8a18d20-9eeb-4284-bb1b-68d8311afe16`::ref 0 aborting False >Thread-55284::DEBUG::2014-05-16 18:04:54,581::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55284::DEBUG::2014-05-16 18:04:54,582::task::579::TaskManager.Task::(_updateState) Task=`e1e7854d-3df8-4bc9-a158-c222f9d101e4`::moving from state init -> state preparing >Thread-55284::INFO::2014-05-16 18:04:54,582::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55284::DEBUG::2014-05-16 18:04:54,582::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5d772a6a-c87f-4a60-80f8-bca0062e495e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55284::DEBUG::2014-05-16 18:04:54,582::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55284::DEBUG::2014-05-16 18:04:54,582::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55284::DEBUG::2014-05-16 18:04:54,583::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5d772a6a-c87f-4a60-80f8-bca0062e495e`::Granted request >Thread-55284::DEBUG::2014-05-16 18:04:54,583::task::811::TaskManager.Task::(resourceAcquired) Task=`e1e7854d-3df8-4bc9-a158-c222f9d101e4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55284::DEBUG::2014-05-16 18:04:54,583::task::974::TaskManager.Task::(_decref) Task=`e1e7854d-3df8-4bc9-a158-c222f9d101e4`::ref 1 aborting False >Thread-55284::INFO::2014-05-16 18:04:54,584::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55284::DEBUG::2014-05-16 18:04:54,584::task::1168::TaskManager.Task::(prepare) Task=`e1e7854d-3df8-4bc9-a158-c222f9d101e4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55284::DEBUG::2014-05-16 18:04:54,584::task::579::TaskManager.Task::(_updateState) Task=`e1e7854d-3df8-4bc9-a158-c222f9d101e4`::moving from state preparing -> state finished >Thread-55284::DEBUG::2014-05-16 18:04:54,584::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55284::DEBUG::2014-05-16 18:04:54,584::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55284::DEBUG::2014-05-16 18:04:54,584::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55284::DEBUG::2014-05-16 18:04:54,584::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55284::DEBUG::2014-05-16 18:04:54,585::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55284::DEBUG::2014-05-16 18:04:54,585::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55284::DEBUG::2014-05-16 18:04:54,585::task::974::TaskManager.Task::(_decref) Task=`e1e7854d-3df8-4bc9-a158-c222f9d101e4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:04:56,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:56,431::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306529 s, 33.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:04:56,827::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:04:56,837::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725679 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:04:58,443::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:04:58,513::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338791 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:00,525::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:00,592::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306149 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:02,603::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:02,675::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350899 s, 29.2 MB/s\n'; <rc> = 0 >Thread-55288::DEBUG::2014-05-16 18:05:04,626::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55288::DEBUG::2014-05-16 18:05:04,627::task::579::TaskManager.Task::(_updateState) Task=`ac3298fd-dca1-4bac-add8-9d7c11b3081b`::moving from state init -> state preparing >Thread-55288::INFO::2014-05-16 18:05:04,627::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55288::INFO::2014-05-16 18:05:04,627::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55288::DEBUG::2014-05-16 18:05:04,627::task::1168::TaskManager.Task::(prepare) Task=`ac3298fd-dca1-4bac-add8-9d7c11b3081b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55288::DEBUG::2014-05-16 18:05:04,627::task::579::TaskManager.Task::(_updateState) Task=`ac3298fd-dca1-4bac-add8-9d7c11b3081b`::moving from state preparing -> state finished >Thread-55288::DEBUG::2014-05-16 18:05:04,627::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55288::DEBUG::2014-05-16 18:05:04,628::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55288::DEBUG::2014-05-16 18:05:04,628::task::974::TaskManager.Task::(_decref) Task=`ac3298fd-dca1-4bac-add8-9d7c11b3081b`::ref 0 aborting False >Thread-55289::DEBUG::2014-05-16 18:05:04,664::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55289::DEBUG::2014-05-16 18:05:04,664::task::579::TaskManager.Task::(_updateState) Task=`2ffec964-be01-4927-94fe-a9eaf5350b86`::moving from state init -> state preparing >Thread-55289::INFO::2014-05-16 18:05:04,664::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55289::DEBUG::2014-05-16 18:05:04,664::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8a19a0aa-0c93-4ab6-8b98-f97f8d138287`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55289::DEBUG::2014-05-16 18:05:04,665::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55289::DEBUG::2014-05-16 18:05:04,665::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55289::DEBUG::2014-05-16 18:05:04,665::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8a19a0aa-0c93-4ab6-8b98-f97f8d138287`::Granted request >Thread-55289::DEBUG::2014-05-16 18:05:04,665::task::811::TaskManager.Task::(resourceAcquired) Task=`2ffec964-be01-4927-94fe-a9eaf5350b86`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55289::DEBUG::2014-05-16 18:05:04,665::task::974::TaskManager.Task::(_decref) Task=`2ffec964-be01-4927-94fe-a9eaf5350b86`::ref 1 aborting False >Thread-55289::INFO::2014-05-16 18:05:04,666::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55289::DEBUG::2014-05-16 18:05:04,666::task::1168::TaskManager.Task::(prepare) Task=`2ffec964-be01-4927-94fe-a9eaf5350b86`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55289::DEBUG::2014-05-16 18:05:04,666::task::579::TaskManager.Task::(_updateState) Task=`2ffec964-be01-4927-94fe-a9eaf5350b86`::moving from state preparing -> state finished >Thread-55289::DEBUG::2014-05-16 18:05:04,666::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55289::DEBUG::2014-05-16 18:05:04,666::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55289::DEBUG::2014-05-16 18:05:04,667::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55289::DEBUG::2014-05-16 18:05:04,667::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55289::DEBUG::2014-05-16 18:05:04,667::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55289::DEBUG::2014-05-16 18:05:04,667::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55289::DEBUG::2014-05-16 18:05:04,667::task::974::TaskManager.Task::(_decref) Task=`2ffec964-be01-4927-94fe-a9eaf5350b86`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:05:04,686::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:04,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306461 s, 33.4 MB/s\n'; <rc> = 0 >Thread-55290::DEBUG::2014-05-16 18:05:05,429::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5418467.000000 / 8.008473 / 262500000.000000 = 0.257749 >Thread-55290::DEBUG::2014-05-16 18:05:05,429::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0067690211031257198, 'statsAge': 0.08772587776184082, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25774924434005841, 'rxDropped': 0} >Thread-55290::DEBUG::2014-05-16 18:05:05,429::task::579::TaskManager.Task::(_updateState) Task=`ef98b488-e183-4e50-8fbc-732387f80ebb`::moving from state init -> state preparing >Thread-55290::INFO::2014-05-16 18:05:05,430::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55290::INFO::2014-05-16 18:05:05,430::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725679', 'lastCheck': '8.6', 'valid': True}} >Thread-55290::DEBUG::2014-05-16 18:05:05,430::task::1168::TaskManager.Task::(prepare) Task=`ef98b488-e183-4e50-8fbc-732387f80ebb`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725679', 'lastCheck': '8.6', 'valid': True}} >Thread-55290::DEBUG::2014-05-16 18:05:05,430::task::579::TaskManager.Task::(_updateState) Task=`ef98b488-e183-4e50-8fbc-732387f80ebb`::moving from state preparing -> state finished >Thread-55290::DEBUG::2014-05-16 18:05:05,430::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55290::DEBUG::2014-05-16 18:05:05,430::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55290::DEBUG::2014-05-16 18:05:05,431::task::974::TaskManager.Task::(_decref) Task=`ef98b488-e183-4e50-8fbc-732387f80ebb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:05:06,764::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:06,831::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303775 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:05:06,874::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:05:06,884::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000747913 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:08,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:08,915::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352402 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:10,927::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:10,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308167 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:13,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:13,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035297 s, 29.0 MB/s\n'; <rc> = 0 >Thread-55294::DEBUG::2014-05-16 18:05:14,740::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55294::DEBUG::2014-05-16 18:05:14,740::task::579::TaskManager.Task::(_updateState) Task=`828ba1f1-bf12-4ea4-b669-d1d74e183ad4`::moving from state init -> state preparing >Thread-55294::INFO::2014-05-16 18:05:14,740::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55294::INFO::2014-05-16 18:05:14,741::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55294::DEBUG::2014-05-16 18:05:14,741::task::1168::TaskManager.Task::(prepare) Task=`828ba1f1-bf12-4ea4-b669-d1d74e183ad4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55294::DEBUG::2014-05-16 18:05:14,741::task::579::TaskManager.Task::(_updateState) Task=`828ba1f1-bf12-4ea4-b669-d1d74e183ad4`::moving from state preparing -> state finished >Thread-55294::DEBUG::2014-05-16 18:05:14,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55294::DEBUG::2014-05-16 18:05:14,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55294::DEBUG::2014-05-16 18:05:14,742::task::974::TaskManager.Task::(_decref) Task=`828ba1f1-bf12-4ea4-b669-d1d74e183ad4`::ref 0 aborting False >Thread-55295::DEBUG::2014-05-16 18:05:14,767::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55295::DEBUG::2014-05-16 18:05:14,768::task::579::TaskManager.Task::(_updateState) Task=`18af3aa3-f228-479b-ba1f-4b074287312e`::moving from state init -> state preparing >Thread-55295::INFO::2014-05-16 18:05:14,768::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55295::DEBUG::2014-05-16 18:05:14,768::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8d9595d2-8744-4c56-a3af-2ac8f17dac56`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55295::DEBUG::2014-05-16 18:05:14,769::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55295::DEBUG::2014-05-16 18:05:14,769::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55295::DEBUG::2014-05-16 18:05:14,769::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8d9595d2-8744-4c56-a3af-2ac8f17dac56`::Granted request >Thread-55295::DEBUG::2014-05-16 18:05:14,769::task::811::TaskManager.Task::(resourceAcquired) Task=`18af3aa3-f228-479b-ba1f-4b074287312e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55295::DEBUG::2014-05-16 18:05:14,769::task::974::TaskManager.Task::(_decref) Task=`18af3aa3-f228-479b-ba1f-4b074287312e`::ref 1 aborting False >Thread-55295::INFO::2014-05-16 18:05:14,770::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55295::DEBUG::2014-05-16 18:05:14,770::task::1168::TaskManager.Task::(prepare) Task=`18af3aa3-f228-479b-ba1f-4b074287312e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55295::DEBUG::2014-05-16 18:05:14,770::task::579::TaskManager.Task::(_updateState) Task=`18af3aa3-f228-479b-ba1f-4b074287312e`::moving from state preparing -> state finished >Thread-55295::DEBUG::2014-05-16 18:05:14,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55295::DEBUG::2014-05-16 18:05:14,771::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55295::DEBUG::2014-05-16 18:05:14,771::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55295::DEBUG::2014-05-16 18:05:14,771::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55295::DEBUG::2014-05-16 18:05:14,771::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55295::DEBUG::2014-05-16 18:05:14,771::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55295::DEBUG::2014-05-16 18:05:14,772::task::974::TaskManager.Task::(_decref) Task=`18af3aa3-f228-479b-ba1f-4b074287312e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:05:15,090::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:15,163::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358605 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:05:16,979::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:05:17,004::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727241 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:17,175::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:17,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351392 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:19,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:19,327::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300136 s, 34.1 MB/s\n'; <rc> = 0 >Thread-55298::DEBUG::2014-05-16 18:05:20,897::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5420673.000000 / 8.009205 / 262500000.000000 = 0.257831 >Thread-55298::DEBUG::2014-05-16 18:05:20,897::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.006626565698782106, 'statsAge': 1.5401849746704102, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25783061604469126, 'rxDropped': 0} >Thread-55298::DEBUG::2014-05-16 18:05:20,898::task::579::TaskManager.Task::(_updateState) Task=`24acab24-49bc-4763-bcd6-c434f58c4ca8`::moving from state init -> state preparing >Thread-55298::INFO::2014-05-16 18:05:20,899::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55298::INFO::2014-05-16 18:05:20,899::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727241', 'lastCheck': '3.8', 'valid': True}} >Thread-55298::DEBUG::2014-05-16 18:05:20,899::task::1168::TaskManager.Task::(prepare) Task=`24acab24-49bc-4763-bcd6-c434f58c4ca8`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727241', 'lastCheck': '3.8', 'valid': True}} >Thread-55298::DEBUG::2014-05-16 18:05:20,899::task::579::TaskManager.Task::(_updateState) Task=`24acab24-49bc-4763-bcd6-c434f58c4ca8`::moving from state preparing -> state finished >Thread-55298::DEBUG::2014-05-16 18:05:20,899::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55298::DEBUG::2014-05-16 18:05:20,899::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55298::DEBUG::2014-05-16 18:05:20,900::task::974::TaskManager.Task::(_decref) Task=`24acab24-49bc-4763-bcd6-c434f58c4ca8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:05:21,339::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:21,413::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364792 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:23,425::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:23,496::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358569 s, 28.6 MB/s\n'; <rc> = 0 >Thread-55301::DEBUG::2014-05-16 18:05:24,868::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55301::DEBUG::2014-05-16 18:05:24,869::task::579::TaskManager.Task::(_updateState) Task=`92f31f53-8973-468b-979f-ad712e8630dd`::moving from state init -> state preparing >Thread-55301::INFO::2014-05-16 18:05:24,869::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55301::INFO::2014-05-16 18:05:24,869::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55301::DEBUG::2014-05-16 18:05:24,869::task::1168::TaskManager.Task::(prepare) Task=`92f31f53-8973-468b-979f-ad712e8630dd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55301::DEBUG::2014-05-16 18:05:24,870::task::579::TaskManager.Task::(_updateState) Task=`92f31f53-8973-468b-979f-ad712e8630dd`::moving from state preparing -> state finished >Thread-55301::DEBUG::2014-05-16 18:05:24,870::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55301::DEBUG::2014-05-16 18:05:24,870::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55301::DEBUG::2014-05-16 18:05:24,870::task::974::TaskManager.Task::(_decref) Task=`92f31f53-8973-468b-979f-ad712e8630dd`::ref 0 aborting False >Thread-55302::DEBUG::2014-05-16 18:05:24,878::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55302::DEBUG::2014-05-16 18:05:24,879::task::579::TaskManager.Task::(_updateState) Task=`95a55c7d-93da-4f5f-bf4f-5ab3818399d2`::moving from state init -> state preparing >Thread-55302::INFO::2014-05-16 18:05:24,879::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55302::DEBUG::2014-05-16 18:05:24,879::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`65e74b39-bff7-41bc-8bb9-c686fe50f04e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55302::DEBUG::2014-05-16 18:05:24,879::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55302::DEBUG::2014-05-16 18:05:24,879::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55302::DEBUG::2014-05-16 18:05:24,880::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`65e74b39-bff7-41bc-8bb9-c686fe50f04e`::Granted request >Thread-55302::DEBUG::2014-05-16 18:05:24,880::task::811::TaskManager.Task::(resourceAcquired) Task=`95a55c7d-93da-4f5f-bf4f-5ab3818399d2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55302::DEBUG::2014-05-16 18:05:24,880::task::974::TaskManager.Task::(_decref) Task=`95a55c7d-93da-4f5f-bf4f-5ab3818399d2`::ref 1 aborting False >Thread-55302::INFO::2014-05-16 18:05:24,880::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55302::DEBUG::2014-05-16 18:05:24,881::task::1168::TaskManager.Task::(prepare) Task=`95a55c7d-93da-4f5f-bf4f-5ab3818399d2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55302::DEBUG::2014-05-16 18:05:24,881::task::579::TaskManager.Task::(_updateState) Task=`95a55c7d-93da-4f5f-bf4f-5ab3818399d2`::moving from state preparing -> state finished >Thread-55302::DEBUG::2014-05-16 18:05:24,881::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55302::DEBUG::2014-05-16 18:05:24,881::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55302::DEBUG::2014-05-16 18:05:24,881::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55302::DEBUG::2014-05-16 18:05:24,881::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55302::DEBUG::2014-05-16 18:05:24,881::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55302::DEBUG::2014-05-16 18:05:24,882::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55302::DEBUG::2014-05-16 18:05:24,882::task::974::TaskManager.Task::(_decref) Task=`95a55c7d-93da-4f5f-bf4f-5ab3818399d2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:05:25,508::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:25,575::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311444 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:05:27,134::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:05:27,161::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709146 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:27,587::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:27,657::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333712 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:29,669::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:29,741::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354203 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:31,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:31,819::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308245 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:33,831::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:33,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311748 s, 32.8 MB/s\n'; <rc> = 0 >Thread-55306::DEBUG::2014-05-16 18:05:34,964::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55306::DEBUG::2014-05-16 18:05:34,964::task::579::TaskManager.Task::(_updateState) Task=`5312bb68-6282-4216-90ec-3e0ffe577fcd`::moving from state init -> state preparing >Thread-55306::INFO::2014-05-16 18:05:34,965::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55306::INFO::2014-05-16 18:05:34,965::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55306::DEBUG::2014-05-16 18:05:34,965::task::1168::TaskManager.Task::(prepare) Task=`5312bb68-6282-4216-90ec-3e0ffe577fcd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55306::DEBUG::2014-05-16 18:05:34,965::task::579::TaskManager.Task::(_updateState) Task=`5312bb68-6282-4216-90ec-3e0ffe577fcd`::moving from state preparing -> state finished >Thread-55306::DEBUG::2014-05-16 18:05:34,965::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55306::DEBUG::2014-05-16 18:05:34,965::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55306::DEBUG::2014-05-16 18:05:34,966::task::974::TaskManager.Task::(_decref) Task=`5312bb68-6282-4216-90ec-3e0ffe577fcd`::ref 0 aborting False >Thread-55307::DEBUG::2014-05-16 18:05:34,996::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55307::DEBUG::2014-05-16 18:05:34,996::task::579::TaskManager.Task::(_updateState) Task=`846769dd-0db7-4ad8-bb9e-d3974713b102`::moving from state init -> state preparing >Thread-55307::INFO::2014-05-16 18:05:34,996::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55307::DEBUG::2014-05-16 18:05:34,997::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`289161fa-6e6e-4265-8251-1719d9558588`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55307::DEBUG::2014-05-16 18:05:34,997::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55307::DEBUG::2014-05-16 18:05:34,997::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55307::DEBUG::2014-05-16 18:05:34,997::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`289161fa-6e6e-4265-8251-1719d9558588`::Granted request >Thread-55307::DEBUG::2014-05-16 18:05:34,998::task::811::TaskManager.Task::(resourceAcquired) Task=`846769dd-0db7-4ad8-bb9e-d3974713b102`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55307::DEBUG::2014-05-16 18:05:34,998::task::974::TaskManager.Task::(_decref) Task=`846769dd-0db7-4ad8-bb9e-d3974713b102`::ref 1 aborting False >Thread-55307::INFO::2014-05-16 18:05:34,999::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55307::DEBUG::2014-05-16 18:05:34,999::task::1168::TaskManager.Task::(prepare) Task=`846769dd-0db7-4ad8-bb9e-d3974713b102`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55307::DEBUG::2014-05-16 18:05:34,999::task::579::TaskManager.Task::(_updateState) Task=`846769dd-0db7-4ad8-bb9e-d3974713b102`::moving from state preparing -> state finished >Thread-55307::DEBUG::2014-05-16 18:05:34,999::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55307::DEBUG::2014-05-16 18:05:34,999::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55307::DEBUG::2014-05-16 18:05:34,999::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55307::DEBUG::2014-05-16 18:05:35,000::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55307::DEBUG::2014-05-16 18:05:35,000::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55307::DEBUG::2014-05-16 18:05:35,000::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55307::DEBUG::2014-05-16 18:05:35,000::task::974::TaskManager.Task::(_decref) Task=`846769dd-0db7-4ad8-bb9e-d3974713b102`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:05:35,909::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:35,980::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346104 s, 29.6 MB/s\n'; <rc> = 0 >Thread-55308::DEBUG::2014-05-16 18:05:36,635::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318089.000000 / 8.008445 / 262500000.000000 = 0.205406 >Thread-55308::DEBUG::2014-05-16 18:05:36,635::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051057530809166009, 'statsAge': 1.2587959766387939, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20540645289863493, 'rxDropped': 0} >Thread-55308::DEBUG::2014-05-16 18:05:36,636::task::579::TaskManager.Task::(_updateState) Task=`4e35a8ca-267a-45d7-b2c7-b89cb6ccb29c`::moving from state init -> state preparing >Thread-55308::INFO::2014-05-16 18:05:36,636::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55308::INFO::2014-05-16 18:05:36,636::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709146', 'lastCheck': '9.4', 'valid': True}} >Thread-55308::DEBUG::2014-05-16 18:05:36,636::task::1168::TaskManager.Task::(prepare) Task=`4e35a8ca-267a-45d7-b2c7-b89cb6ccb29c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709146', 'lastCheck': '9.4', 'valid': True}} >Thread-55308::DEBUG::2014-05-16 18:05:36,636::task::579::TaskManager.Task::(_updateState) Task=`4e35a8ca-267a-45d7-b2c7-b89cb6ccb29c`::moving from state preparing -> state finished >Thread-55308::DEBUG::2014-05-16 18:05:36,637::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55308::DEBUG::2014-05-16 18:05:36,637::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55308::DEBUG::2014-05-16 18:05:36,637::task::974::TaskManager.Task::(_decref) Task=`4e35a8ca-267a-45d7-b2c7-b89cb6ccb29c`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:05:37,278::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:05:37,303::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010297 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:37,991::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:38,064::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035633 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:40,075::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:40,143::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030522 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:42,156::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:42,226::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351516 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:44,238::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:44,312::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358196 s, 28.6 MB/s\n'; <rc> = 0 >Thread-55312::DEBUG::2014-05-16 18:05:45,095::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55312::DEBUG::2014-05-16 18:05:45,096::task::579::TaskManager.Task::(_updateState) Task=`70a55132-8b39-4ead-bd4b-e4da7877c152`::moving from state init -> state preparing >Thread-55312::INFO::2014-05-16 18:05:45,096::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55312::INFO::2014-05-16 18:05:45,097::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55312::DEBUG::2014-05-16 18:05:45,097::task::1168::TaskManager.Task::(prepare) Task=`70a55132-8b39-4ead-bd4b-e4da7877c152`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55312::DEBUG::2014-05-16 18:05:45,097::task::579::TaskManager.Task::(_updateState) Task=`70a55132-8b39-4ead-bd4b-e4da7877c152`::moving from state preparing -> state finished >Thread-55312::DEBUG::2014-05-16 18:05:45,097::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55312::DEBUG::2014-05-16 18:05:45,097::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55312::DEBUG::2014-05-16 18:05:45,097::task::974::TaskManager.Task::(_decref) Task=`70a55132-8b39-4ead-bd4b-e4da7877c152`::ref 0 aborting False >Thread-55313::DEBUG::2014-05-16 18:05:45,124::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55313::DEBUG::2014-05-16 18:05:45,124::task::579::TaskManager.Task::(_updateState) Task=`5b14a001-a038-4dab-a089-d6bc41d44979`::moving from state init -> state preparing >Thread-55313::INFO::2014-05-16 18:05:45,124::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55313::DEBUG::2014-05-16 18:05:45,125::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d8185b6f-d37a-49a2-839d-26ead40568d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55313::DEBUG::2014-05-16 18:05:45,125::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55313::DEBUG::2014-05-16 18:05:45,125::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55313::DEBUG::2014-05-16 18:05:45,125::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d8185b6f-d37a-49a2-839d-26ead40568d4`::Granted request >Thread-55313::DEBUG::2014-05-16 18:05:45,126::task::811::TaskManager.Task::(resourceAcquired) Task=`5b14a001-a038-4dab-a089-d6bc41d44979`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55313::DEBUG::2014-05-16 18:05:45,126::task::974::TaskManager.Task::(_decref) Task=`5b14a001-a038-4dab-a089-d6bc41d44979`::ref 1 aborting False >Thread-55313::INFO::2014-05-16 18:05:45,127::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55313::DEBUG::2014-05-16 18:05:45,127::task::1168::TaskManager.Task::(prepare) Task=`5b14a001-a038-4dab-a089-d6bc41d44979`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55313::DEBUG::2014-05-16 18:05:45,127::task::579::TaskManager.Task::(_updateState) Task=`5b14a001-a038-4dab-a089-d6bc41d44979`::moving from state preparing -> state finished >Thread-55313::DEBUG::2014-05-16 18:05:45,127::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55313::DEBUG::2014-05-16 18:05:45,127::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55313::DEBUG::2014-05-16 18:05:45,127::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55313::DEBUG::2014-05-16 18:05:45,128::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55313::DEBUG::2014-05-16 18:05:45,128::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55313::DEBUG::2014-05-16 18:05:45,128::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55313::DEBUG::2014-05-16 18:05:45,128::task::974::TaskManager.Task::(_decref) Task=`5b14a001-a038-4dab-a089-d6bc41d44979`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:05:46,324::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:46,390::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302639 s, 33.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:05:47,424::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:05:47,449::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746433 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:48,401::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:48,468::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309505 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:50,480::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:50,552::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352352 s, 29.1 MB/s\n'; <rc> = 0 >Thread-55316::DEBUG::2014-05-16 18:05:51,981::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318475.000000 / 8.008510 / 262500000.000000 = 0.205423 >Thread-55316::DEBUG::2014-05-16 18:05:51,981::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053677185851240079, 'statsAge': 0.58281493186950684, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20542314490077629, 'rxDropped': 0} >Thread-55316::DEBUG::2014-05-16 18:05:51,982::task::579::TaskManager.Task::(_updateState) Task=`c920f75c-f884-47dd-9df8-ea71bb695ce0`::moving from state init -> state preparing >Thread-55316::INFO::2014-05-16 18:05:51,982::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55316::INFO::2014-05-16 18:05:51,982::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746433', 'lastCheck': '4.4', 'valid': True}} >Thread-55316::DEBUG::2014-05-16 18:05:51,982::task::1168::TaskManager.Task::(prepare) Task=`c920f75c-f884-47dd-9df8-ea71bb695ce0`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746433', 'lastCheck': '4.4', 'valid': True}} >Thread-55316::DEBUG::2014-05-16 18:05:51,982::task::579::TaskManager.Task::(_updateState) Task=`c920f75c-f884-47dd-9df8-ea71bb695ce0`::moving from state preparing -> state finished >Thread-55316::DEBUG::2014-05-16 18:05:51,982::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55316::DEBUG::2014-05-16 18:05:51,983::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55316::DEBUG::2014-05-16 18:05:51,983::task::974::TaskManager.Task::(_decref) Task=`c920f75c-f884-47dd-9df8-ea71bb695ce0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:05:52,563::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:52,630::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312963 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:54,642::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:54,709::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309602 s, 33.1 MB/s\n'; <rc> = 0 >Thread-55319::DEBUG::2014-05-16 18:05:55,226::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55319::DEBUG::2014-05-16 18:05:55,227::task::579::TaskManager.Task::(_updateState) Task=`08ebcfcc-4ef4-4994-966a-29bc681027ed`::moving from state init -> state preparing >Thread-55319::INFO::2014-05-16 18:05:55,227::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55319::INFO::2014-05-16 18:05:55,227::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55319::DEBUG::2014-05-16 18:05:55,228::task::1168::TaskManager.Task::(prepare) Task=`08ebcfcc-4ef4-4994-966a-29bc681027ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55319::DEBUG::2014-05-16 18:05:55,228::task::579::TaskManager.Task::(_updateState) Task=`08ebcfcc-4ef4-4994-966a-29bc681027ed`::moving from state preparing -> state finished >Thread-55319::DEBUG::2014-05-16 18:05:55,228::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55319::DEBUG::2014-05-16 18:05:55,228::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55319::DEBUG::2014-05-16 18:05:55,228::task::974::TaskManager.Task::(_decref) Task=`08ebcfcc-4ef4-4994-966a-29bc681027ed`::ref 0 aborting False >Thread-55320::DEBUG::2014-05-16 18:05:55,244::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55320::DEBUG::2014-05-16 18:05:55,244::task::579::TaskManager.Task::(_updateState) Task=`ae86a0d9-5b5d-4170-b3cb-fdcfe637acbe`::moving from state init -> state preparing >Thread-55320::INFO::2014-05-16 18:05:55,245::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55320::DEBUG::2014-05-16 18:05:55,245::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`957ac48d-603e-4d7f-b0ac-63e2a8a3181f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55320::DEBUG::2014-05-16 18:05:55,245::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55320::DEBUG::2014-05-16 18:05:55,245::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55320::DEBUG::2014-05-16 18:05:55,246::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`957ac48d-603e-4d7f-b0ac-63e2a8a3181f`::Granted request >Thread-55320::DEBUG::2014-05-16 18:05:55,246::task::811::TaskManager.Task::(resourceAcquired) Task=`ae86a0d9-5b5d-4170-b3cb-fdcfe637acbe`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55320::DEBUG::2014-05-16 18:05:55,246::task::974::TaskManager.Task::(_decref) Task=`ae86a0d9-5b5d-4170-b3cb-fdcfe637acbe`::ref 1 aborting False >Thread-55320::INFO::2014-05-16 18:05:55,247::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55320::DEBUG::2014-05-16 18:05:55,247::task::1168::TaskManager.Task::(prepare) Task=`ae86a0d9-5b5d-4170-b3cb-fdcfe637acbe`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55320::DEBUG::2014-05-16 18:05:55,247::task::579::TaskManager.Task::(_updateState) Task=`ae86a0d9-5b5d-4170-b3cb-fdcfe637acbe`::moving from state preparing -> state finished >Thread-55320::DEBUG::2014-05-16 18:05:55,247::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55320::DEBUG::2014-05-16 18:05:55,247::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55320::DEBUG::2014-05-16 18:05:55,248::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55320::DEBUG::2014-05-16 18:05:55,248::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55320::DEBUG::2014-05-16 18:05:55,248::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55320::DEBUG::2014-05-16 18:05:55,248::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55320::DEBUG::2014-05-16 18:05:55,248::task::974::TaskManager.Task::(_decref) Task=`ae86a0d9-5b5d-4170-b3cb-fdcfe637acbe`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:05:56,721::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:56,792::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348257 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:05:57,562::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:05:57,587::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725242 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:05:58,804::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:05:58,875::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350893 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:00,887::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:00,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303939 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:02,966::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:03,038::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355129 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:05,050::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:05,117::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304079 s, 33.7 MB/s\n'; <rc> = 0 >Thread-55324::DEBUG::2014-05-16 18:06:05,324::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55324::DEBUG::2014-05-16 18:06:05,325::task::579::TaskManager.Task::(_updateState) Task=`0680a455-4779-4bba-a5c7-ae7cfb2f8b18`::moving from state init -> state preparing >Thread-55324::INFO::2014-05-16 18:06:05,325::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55324::INFO::2014-05-16 18:06:05,325::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55324::DEBUG::2014-05-16 18:06:05,325::task::1168::TaskManager.Task::(prepare) Task=`0680a455-4779-4bba-a5c7-ae7cfb2f8b18`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55324::DEBUG::2014-05-16 18:06:05,326::task::579::TaskManager.Task::(_updateState) Task=`0680a455-4779-4bba-a5c7-ae7cfb2f8b18`::moving from state preparing -> state finished >Thread-55324::DEBUG::2014-05-16 18:06:05,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55324::DEBUG::2014-05-16 18:06:05,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55324::DEBUG::2014-05-16 18:06:05,326::task::974::TaskManager.Task::(_decref) Task=`0680a455-4779-4bba-a5c7-ae7cfb2f8b18`::ref 0 aborting False >Thread-55325::DEBUG::2014-05-16 18:06:05,335::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55325::DEBUG::2014-05-16 18:06:05,335::task::579::TaskManager.Task::(_updateState) Task=`a416b2c7-ad3f-4d73-a411-f320baaca02e`::moving from state init -> state preparing >Thread-55325::INFO::2014-05-16 18:06:05,335::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55325::DEBUG::2014-05-16 18:06:05,336::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d5db9724-c940-4251-95b2-94b61f039150`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55325::DEBUG::2014-05-16 18:06:05,336::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55325::DEBUG::2014-05-16 18:06:05,336::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55325::DEBUG::2014-05-16 18:06:05,336::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d5db9724-c940-4251-95b2-94b61f039150`::Granted request >Thread-55325::DEBUG::2014-05-16 18:06:05,337::task::811::TaskManager.Task::(resourceAcquired) Task=`a416b2c7-ad3f-4d73-a411-f320baaca02e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55325::DEBUG::2014-05-16 18:06:05,337::task::974::TaskManager.Task::(_decref) Task=`a416b2c7-ad3f-4d73-a411-f320baaca02e`::ref 1 aborting False >Thread-55325::INFO::2014-05-16 18:06:05,337::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55325::DEBUG::2014-05-16 18:06:05,338::task::1168::TaskManager.Task::(prepare) Task=`a416b2c7-ad3f-4d73-a411-f320baaca02e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55325::DEBUG::2014-05-16 18:06:05,338::task::579::TaskManager.Task::(_updateState) Task=`a416b2c7-ad3f-4d73-a411-f320baaca02e`::moving from state preparing -> state finished >Thread-55325::DEBUG::2014-05-16 18:06:05,338::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55325::DEBUG::2014-05-16 18:06:05,338::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55325::DEBUG::2014-05-16 18:06:05,338::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55325::DEBUG::2014-05-16 18:06:05,338::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55325::DEBUG::2014-05-16 18:06:05,339::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55325::DEBUG::2014-05-16 18:06:05,339::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55325::DEBUG::2014-05-16 18:06:05,339::task::974::TaskManager.Task::(_decref) Task=`a416b2c7-ad3f-4d73-a411-f320baaca02e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:06:07,129::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:07,197::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314653 s, 32.5 MB/s\n'; <rc> = 0 >Thread-55326::DEBUG::2014-05-16 18:06:07,264::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4341698.000000 / 8.008734 / 262500000.000000 = 0.206522 >Thread-55326::DEBUG::2014-05-16 18:06:07,264::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051712114806039726, 'statsAge': 1.8507139682769775, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20652205367216095, 'rxDropped': 0} >Thread-55326::DEBUG::2014-05-16 18:06:07,265::task::579::TaskManager.Task::(_updateState) Task=`45a7a1bf-b761-4a61-9969-c0852f6882d5`::moving from state init -> state preparing >Thread-55326::INFO::2014-05-16 18:06:07,265::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55326::INFO::2014-05-16 18:06:07,265::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725242', 'lastCheck': '9.6', 'valid': True}} >Thread-55326::DEBUG::2014-05-16 18:06:07,265::task::1168::TaskManager.Task::(prepare) Task=`45a7a1bf-b761-4a61-9969-c0852f6882d5`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725242', 'lastCheck': '9.6', 'valid': True}} >Thread-55326::DEBUG::2014-05-16 18:06:07,265::task::579::TaskManager.Task::(_updateState) Task=`45a7a1bf-b761-4a61-9969-c0852f6882d5`::moving from state preparing -> state finished >Thread-55326::DEBUG::2014-05-16 18:06:07,266::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55326::DEBUG::2014-05-16 18:06:07,266::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55326::DEBUG::2014-05-16 18:06:07,266::task::974::TaskManager.Task::(_decref) Task=`45a7a1bf-b761-4a61-9969-c0852f6882d5`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:06:07,711::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:06:07,736::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000776468 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:09,209::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:09,280::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03482 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:11,291::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:11,359::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305814 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:13,370::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:13,453::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0416928 s, 24.6 MB/s\n'; <rc> = 0 >Thread-55330::DEBUG::2014-05-16 18:06:15,374::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55330::DEBUG::2014-05-16 18:06:15,375::task::579::TaskManager.Task::(_updateState) Task=`3f46991a-d7d5-4563-9516-6da7a95f4fbd`::moving from state init -> state preparing >Thread-55330::INFO::2014-05-16 18:06:15,375::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55330::INFO::2014-05-16 18:06:15,375::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55330::DEBUG::2014-05-16 18:06:15,375::task::1168::TaskManager.Task::(prepare) Task=`3f46991a-d7d5-4563-9516-6da7a95f4fbd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55330::DEBUG::2014-05-16 18:06:15,375::task::579::TaskManager.Task::(_updateState) Task=`3f46991a-d7d5-4563-9516-6da7a95f4fbd`::moving from state preparing -> state finished >Thread-55330::DEBUG::2014-05-16 18:06:15,376::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55330::DEBUG::2014-05-16 18:06:15,376::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55330::DEBUG::2014-05-16 18:06:15,376::task::974::TaskManager.Task::(_decref) Task=`3f46991a-d7d5-4563-9516-6da7a95f4fbd`::ref 0 aborting False >Thread-55331::DEBUG::2014-05-16 18:06:15,385::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55331::DEBUG::2014-05-16 18:06:15,385::task::579::TaskManager.Task::(_updateState) Task=`6622101c-6519-4a87-974f-df06e5198e51`::moving from state init -> state preparing >Thread-55331::INFO::2014-05-16 18:06:15,385::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55331::DEBUG::2014-05-16 18:06:15,386::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`50269885-bbd8-4b0a-b757-db36214f9a43`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55331::DEBUG::2014-05-16 18:06:15,386::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55331::DEBUG::2014-05-16 18:06:15,386::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55331::DEBUG::2014-05-16 18:06:15,386::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`50269885-bbd8-4b0a-b757-db36214f9a43`::Granted request >Thread-55331::DEBUG::2014-05-16 18:06:15,387::task::811::TaskManager.Task::(resourceAcquired) Task=`6622101c-6519-4a87-974f-df06e5198e51`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55331::DEBUG::2014-05-16 18:06:15,387::task::974::TaskManager.Task::(_decref) Task=`6622101c-6519-4a87-974f-df06e5198e51`::ref 1 aborting False >Thread-55331::INFO::2014-05-16 18:06:15,388::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55331::DEBUG::2014-05-16 18:06:15,388::task::1168::TaskManager.Task::(prepare) Task=`6622101c-6519-4a87-974f-df06e5198e51`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55331::DEBUG::2014-05-16 18:06:15,388::task::579::TaskManager.Task::(_updateState) Task=`6622101c-6519-4a87-974f-df06e5198e51`::moving from state preparing -> state finished >Thread-55331::DEBUG::2014-05-16 18:06:15,388::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55331::DEBUG::2014-05-16 18:06:15,388::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55331::DEBUG::2014-05-16 18:06:15,388::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55331::DEBUG::2014-05-16 18:06:15,389::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55331::DEBUG::2014-05-16 18:06:15,389::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55331::DEBUG::2014-05-16 18:06:15,389::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55331::DEBUG::2014-05-16 18:06:15,389::task::974::TaskManager.Task::(_decref) Task=`6622101c-6519-4a87-974f-df06e5198e51`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:06:15,465::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:15,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313378 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:17,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:17,617::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352613 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:06:17,862::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:06:17,887::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000732876 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:19,629::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:19,695::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303756 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:21,706::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:21,774::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309657 s, 33.1 MB/s\n'; <rc> = 0 >Thread-55334::DEBUG::2014-05-16 18:06:22,511::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5420545.000000 / 8.010957 / 262500000.000000 = 0.257768 >Thread-55334::DEBUG::2014-05-16 18:06:22,511::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066690563676623195, 'statsAge': 1.0781111717224121, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25776814469595516, 'rxDropped': 0} >Thread-55334::DEBUG::2014-05-16 18:06:22,512::task::579::TaskManager.Task::(_updateState) Task=`f6cf5dae-16b3-4625-92d0-328e1845ca56`::moving from state init -> state preparing >Thread-55334::INFO::2014-05-16 18:06:22,512::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55334::INFO::2014-05-16 18:06:22,512::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732876', 'lastCheck': '4.5', 'valid': True}} >Thread-55334::DEBUG::2014-05-16 18:06:22,512::task::1168::TaskManager.Task::(prepare) Task=`f6cf5dae-16b3-4625-92d0-328e1845ca56`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732876', 'lastCheck': '4.5', 'valid': True}} >Thread-55334::DEBUG::2014-05-16 18:06:22,512::task::579::TaskManager.Task::(_updateState) Task=`f6cf5dae-16b3-4625-92d0-328e1845ca56`::moving from state preparing -> state finished >Thread-55334::DEBUG::2014-05-16 18:06:22,512::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55334::DEBUG::2014-05-16 18:06:22,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55334::DEBUG::2014-05-16 18:06:22,513::task::974::TaskManager.Task::(_decref) Task=`f6cf5dae-16b3-4625-92d0-328e1845ca56`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:06:23,786::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:23,858::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355327 s, 28.8 MB/s\n'; <rc> = 0 >Thread-55336::DEBUG::2014-05-16 18:06:25,435::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55336::DEBUG::2014-05-16 18:06:25,435::task::579::TaskManager.Task::(_updateState) Task=`1db49abb-101a-411c-a031-47c439624164`::moving from state init -> state preparing >Thread-55336::INFO::2014-05-16 18:06:25,436::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55336::INFO::2014-05-16 18:06:25,436::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55336::DEBUG::2014-05-16 18:06:25,436::task::1168::TaskManager.Task::(prepare) Task=`1db49abb-101a-411c-a031-47c439624164`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55336::DEBUG::2014-05-16 18:06:25,436::task::579::TaskManager.Task::(_updateState) Task=`1db49abb-101a-411c-a031-47c439624164`::moving from state preparing -> state finished >Thread-55336::DEBUG::2014-05-16 18:06:25,436::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55336::DEBUG::2014-05-16 18:06:25,436::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55336::DEBUG::2014-05-16 18:06:25,437::task::974::TaskManager.Task::(_decref) Task=`1db49abb-101a-411c-a031-47c439624164`::ref 0 aborting False >Thread-55337::DEBUG::2014-05-16 18:06:25,477::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55337::DEBUG::2014-05-16 18:06:25,477::task::579::TaskManager.Task::(_updateState) Task=`ff6f5e43-abab-4cfa-a838-42d2c0f71ee4`::moving from state init -> state preparing >Thread-55337::INFO::2014-05-16 18:06:25,478::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55337::DEBUG::2014-05-16 18:06:25,478::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e995cbb7-2647-44f7-8e11-8db56981a734`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55337::DEBUG::2014-05-16 18:06:25,478::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55337::DEBUG::2014-05-16 18:06:25,478::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55337::DEBUG::2014-05-16 18:06:25,478::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e995cbb7-2647-44f7-8e11-8db56981a734`::Granted request >Thread-55337::DEBUG::2014-05-16 18:06:25,479::task::811::TaskManager.Task::(resourceAcquired) Task=`ff6f5e43-abab-4cfa-a838-42d2c0f71ee4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55337::DEBUG::2014-05-16 18:06:25,479::task::974::TaskManager.Task::(_decref) Task=`ff6f5e43-abab-4cfa-a838-42d2c0f71ee4`::ref 1 aborting False >Thread-55337::INFO::2014-05-16 18:06:25,479::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55337::DEBUG::2014-05-16 18:06:25,480::task::1168::TaskManager.Task::(prepare) Task=`ff6f5e43-abab-4cfa-a838-42d2c0f71ee4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55337::DEBUG::2014-05-16 18:06:25,480::task::579::TaskManager.Task::(_updateState) Task=`ff6f5e43-abab-4cfa-a838-42d2c0f71ee4`::moving from state preparing -> state finished >Thread-55337::DEBUG::2014-05-16 18:06:25,480::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55337::DEBUG::2014-05-16 18:06:25,480::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55337::DEBUG::2014-05-16 18:06:25,480::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55337::DEBUG::2014-05-16 18:06:25,480::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55337::DEBUG::2014-05-16 18:06:25,480::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55337::DEBUG::2014-05-16 18:06:25,481::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55337::DEBUG::2014-05-16 18:06:25,481::task::974::TaskManager.Task::(_decref) Task=`ff6f5e43-abab-4cfa-a838-42d2c0f71ee4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:06:25,869::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:25,937::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308548 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:27,949::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 18:06:28,025::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:06:28,057::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679303 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:28,189::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.117507 s, 8.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:30,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:30,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349247 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:32,285::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:32,353::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317677 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:34,365::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:34,432::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308597 s, 33.2 MB/s\n'; <rc> = 0 >Thread-55342::DEBUG::2014-05-16 18:06:35,541::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55342::DEBUG::2014-05-16 18:06:35,541::task::579::TaskManager.Task::(_updateState) Task=`deb1fc2c-e60d-409c-9319-c74c0962fd2b`::moving from state init -> state preparing >Thread-55342::INFO::2014-05-16 18:06:35,541::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55342::INFO::2014-05-16 18:06:35,542::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55342::DEBUG::2014-05-16 18:06:35,542::task::1168::TaskManager.Task::(prepare) Task=`deb1fc2c-e60d-409c-9319-c74c0962fd2b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55342::DEBUG::2014-05-16 18:06:35,542::task::579::TaskManager.Task::(_updateState) Task=`deb1fc2c-e60d-409c-9319-c74c0962fd2b`::moving from state preparing -> state finished >Thread-55342::DEBUG::2014-05-16 18:06:35,542::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55342::DEBUG::2014-05-16 18:06:35,542::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55342::DEBUG::2014-05-16 18:06:35,542::task::974::TaskManager.Task::(_decref) Task=`deb1fc2c-e60d-409c-9319-c74c0962fd2b`::ref 0 aborting False >Thread-55343::DEBUG::2014-05-16 18:06:35,572::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55343::DEBUG::2014-05-16 18:06:35,572::task::579::TaskManager.Task::(_updateState) Task=`56867628-244f-4b85-96d2-b04d6d8d8c6f`::moving from state init -> state preparing >Thread-55343::INFO::2014-05-16 18:06:35,572::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55343::DEBUG::2014-05-16 18:06:35,573::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e2bdf79d-6036-44fe-b50d-d83e7d67012c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55343::DEBUG::2014-05-16 18:06:35,573::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55343::DEBUG::2014-05-16 18:06:35,573::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55343::DEBUG::2014-05-16 18:06:35,573::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e2bdf79d-6036-44fe-b50d-d83e7d67012c`::Granted request >Thread-55343::DEBUG::2014-05-16 18:06:35,574::task::811::TaskManager.Task::(resourceAcquired) Task=`56867628-244f-4b85-96d2-b04d6d8d8c6f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55343::DEBUG::2014-05-16 18:06:35,574::task::974::TaskManager.Task::(_decref) Task=`56867628-244f-4b85-96d2-b04d6d8d8c6f`::ref 1 aborting False >Thread-55343::INFO::2014-05-16 18:06:35,574::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55343::DEBUG::2014-05-16 18:06:35,575::task::1168::TaskManager.Task::(prepare) Task=`56867628-244f-4b85-96d2-b04d6d8d8c6f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55343::DEBUG::2014-05-16 18:06:35,575::task::579::TaskManager.Task::(_updateState) Task=`56867628-244f-4b85-96d2-b04d6d8d8c6f`::moving from state preparing -> state finished >Thread-55343::DEBUG::2014-05-16 18:06:35,575::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55343::DEBUG::2014-05-16 18:06:35,575::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55343::DEBUG::2014-05-16 18:06:35,575::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55343::DEBUG::2014-05-16 18:06:35,575::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55343::DEBUG::2014-05-16 18:06:35,576::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55343::DEBUG::2014-05-16 18:06:35,576::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55343::DEBUG::2014-05-16 18:06:35,576::task::974::TaskManager.Task::(_decref) Task=`56867628-244f-4b85-96d2-b04d6d8d8c6f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:06:36,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:36,511::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307309 s, 33.3 MB/s\n'; <rc> = 0 >Thread-55344::DEBUG::2014-05-16 18:06:37,848::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4310527.000000 / 8.008466 / 262500000.000000 = 0.205046 >Thread-55344::DEBUG::2014-05-16 18:06:37,848::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052701371595570397, 'statsAge': 0.39822006225585938, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20504620019833858, 'rxDropped': 0} >Thread-55344::DEBUG::2014-05-16 18:06:37,849::task::579::TaskManager.Task::(_updateState) Task=`cf7c6721-c9a3-4d80-a876-b37e43bc51f8`::moving from state init -> state preparing >Thread-55344::INFO::2014-05-16 18:06:37,849::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55344::INFO::2014-05-16 18:06:37,849::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679303', 'lastCheck': '9.7', 'valid': True}} >Thread-55344::DEBUG::2014-05-16 18:06:37,849::task::1168::TaskManager.Task::(prepare) Task=`cf7c6721-c9a3-4d80-a876-b37e43bc51f8`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679303', 'lastCheck': '9.7', 'valid': True}} >Thread-55344::DEBUG::2014-05-16 18:06:37,849::task::579::TaskManager.Task::(_updateState) Task=`cf7c6721-c9a3-4d80-a876-b37e43bc51f8`::moving from state preparing -> state finished >Thread-55344::DEBUG::2014-05-16 18:06:37,850::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55344::DEBUG::2014-05-16 18:06:37,850::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55344::DEBUG::2014-05-16 18:06:37,850::task::974::TaskManager.Task::(_decref) Task=`cf7c6721-c9a3-4d80-a876-b37e43bc51f8`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:06:38,167::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 18:06:38,167::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:06:38,185::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:06:38,194::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000819424 s, 2.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:06:38,194::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000819424 s, 2.5 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 18:06:38,194::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 18:06:38,195::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 18:06:38,195::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:06:38,195::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:06:38,195::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:06:38,196::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:06:38,196::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:06:38,196::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:06:38,197::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:06:38,358::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:06:38,359::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:06:38,360::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 18:06:38,361::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 18:06:38,361::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 18:06:38,361::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 18:06:38,361::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:06:38,509::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:38,525::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 18:06:38,546::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:06:38,581::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00069838 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:38,769::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.205552 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:40,781::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:40,846::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299319 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:42,858::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:42,925::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309906 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:44,937::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:45,008::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034745 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:47,019::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:47,086::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310116 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:06:48,744::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:06:48,754::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112139 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:49,098::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:49,171::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364273 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:51,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:51,254::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035445 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55348::DEBUG::2014-05-16 18:06:53,044::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55348::DEBUG::2014-05-16 18:06:53,045::task::579::TaskManager.Task::(_updateState) Task=`7260e8e4-fa97-4ac9-860c-b9710c44997e`::moving from state init -> state preparing >Thread-55348::INFO::2014-05-16 18:06:53,045::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55348::INFO::2014-05-16 18:06:53,045::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55348::DEBUG::2014-05-16 18:06:53,046::task::1168::TaskManager.Task::(prepare) Task=`7260e8e4-fa97-4ac9-860c-b9710c44997e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55348::DEBUG::2014-05-16 18:06:53,046::task::579::TaskManager.Task::(_updateState) Task=`7260e8e4-fa97-4ac9-860c-b9710c44997e`::moving from state preparing -> state finished >Thread-55348::DEBUG::2014-05-16 18:06:53,046::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55348::DEBUG::2014-05-16 18:06:53,046::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55348::DEBUG::2014-05-16 18:06:53,046::task::974::TaskManager.Task::(_decref) Task=`7260e8e4-fa97-4ac9-860c-b9710c44997e`::ref 0 aborting False >Thread-55349::DEBUG::2014-05-16 18:06:53,065::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55349::DEBUG::2014-05-16 18:06:53,065::task::579::TaskManager.Task::(_updateState) Task=`15a3c632-ec65-4927-b8e7-5dc681ef503b`::moving from state init -> state preparing >Thread-55349::INFO::2014-05-16 18:06:53,065::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55349::DEBUG::2014-05-16 18:06:53,066::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`971716e5-27bd-4026-a332-95eba7555dca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55349::DEBUG::2014-05-16 18:06:53,066::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55349::DEBUG::2014-05-16 18:06:53,066::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55349::DEBUG::2014-05-16 18:06:53,066::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`971716e5-27bd-4026-a332-95eba7555dca`::Granted request >Thread-55349::DEBUG::2014-05-16 18:06:53,066::task::811::TaskManager.Task::(resourceAcquired) Task=`15a3c632-ec65-4927-b8e7-5dc681ef503b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55349::DEBUG::2014-05-16 18:06:53,066::task::974::TaskManager.Task::(_decref) Task=`15a3c632-ec65-4927-b8e7-5dc681ef503b`::ref 1 aborting False >Thread-55349::INFO::2014-05-16 18:06:53,067::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55349::DEBUG::2014-05-16 18:06:53,067::task::1168::TaskManager.Task::(prepare) Task=`15a3c632-ec65-4927-b8e7-5dc681ef503b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55349::DEBUG::2014-05-16 18:06:53,067::task::579::TaskManager.Task::(_updateState) Task=`15a3c632-ec65-4927-b8e7-5dc681ef503b`::moving from state preparing -> state finished >Thread-55349::DEBUG::2014-05-16 18:06:53,067::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55349::DEBUG::2014-05-16 18:06:53,067::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55349::DEBUG::2014-05-16 18:06:53,068::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55349::DEBUG::2014-05-16 18:06:53,068::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55349::DEBUG::2014-05-16 18:06:53,068::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55349::DEBUG::2014-05-16 18:06:53,068::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55349::DEBUG::2014-05-16 18:06:53,068::task::974::TaskManager.Task::(_decref) Task=`15a3c632-ec65-4927-b8e7-5dc681ef503b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:06:53,266::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:53,335::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319758 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:55,347::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:55,414::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309729 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:57,426::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:57,498::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035266 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:06:58,791::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:06:58,802::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010824 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:06:59,505::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:06:59,575::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347363 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:01,587::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:01,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0290692 s, 35.2 MB/s\n'; <rc> = 0 >Thread-55352::DEBUG::2014-05-16 18:07:02,269::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318004.000000 / 8.017376 / 262500000.000000 = 0.205174 >Thread-55352::DEBUG::2014-05-16 18:07:02,270::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053701456037764496, 'statsAge': 0.7850341796875, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20517360241456339, 'rxDropped': 0} >Thread-55352::DEBUG::2014-05-16 18:07:02,270::task::579::TaskManager.Task::(_updateState) Task=`a693c493-c1b0-41f9-81fd-026152e61b0b`::moving from state init -> state preparing >Thread-55352::INFO::2014-05-16 18:07:02,270::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55352::INFO::2014-05-16 18:07:02,271::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010824', 'lastCheck': '3.4', 'valid': True}} >Thread-55352::DEBUG::2014-05-16 18:07:02,271::task::1168::TaskManager.Task::(prepare) Task=`a693c493-c1b0-41f9-81fd-026152e61b0b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010824', 'lastCheck': '3.4', 'valid': True}} >Thread-55352::DEBUG::2014-05-16 18:07:02,271::task::579::TaskManager.Task::(_updateState) Task=`a693c493-c1b0-41f9-81fd-026152e61b0b`::moving from state preparing -> state finished >Thread-55352::DEBUG::2014-05-16 18:07:02,271::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55352::DEBUG::2014-05-16 18:07:02,271::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55352::DEBUG::2014-05-16 18:07:02,271::task::974::TaskManager.Task::(_decref) Task=`a693c493-c1b0-41f9-81fd-026152e61b0b`::ref 0 aborting False >Thread-55354::DEBUG::2014-05-16 18:07:03,361::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55354::DEBUG::2014-05-16 18:07:03,361::task::579::TaskManager.Task::(_updateState) Task=`aa307a96-c1f0-456d-af65-62b7db3b63ec`::moving from state init -> state preparing >Thread-55354::INFO::2014-05-16 18:07:03,361::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55354::INFO::2014-05-16 18:07:03,362::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55354::DEBUG::2014-05-16 18:07:03,362::task::1168::TaskManager.Task::(prepare) Task=`aa307a96-c1f0-456d-af65-62b7db3b63ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55354::DEBUG::2014-05-16 18:07:03,362::task::579::TaskManager.Task::(_updateState) Task=`aa307a96-c1f0-456d-af65-62b7db3b63ec`::moving from state preparing -> state finished >Thread-55354::DEBUG::2014-05-16 18:07:03,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55354::DEBUG::2014-05-16 18:07:03,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55354::DEBUG::2014-05-16 18:07:03,362::task::974::TaskManager.Task::(_decref) Task=`aa307a96-c1f0-456d-af65-62b7db3b63ec`::ref 0 aborting False >Thread-55355::DEBUG::2014-05-16 18:07:03,415::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55355::DEBUG::2014-05-16 18:07:03,415::task::579::TaskManager.Task::(_updateState) Task=`07ebb3e2-0aa0-4c98-812b-5c64e584a83e`::moving from state init -> state preparing >Thread-55355::INFO::2014-05-16 18:07:03,415::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55355::DEBUG::2014-05-16 18:07:03,415::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3ba30d50-da02-4040-a357-da111d214c70`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55355::DEBUG::2014-05-16 18:07:03,416::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55355::DEBUG::2014-05-16 18:07:03,416::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55355::DEBUG::2014-05-16 18:07:03,416::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3ba30d50-da02-4040-a357-da111d214c70`::Granted request >Thread-55355::DEBUG::2014-05-16 18:07:03,416::task::811::TaskManager.Task::(resourceAcquired) Task=`07ebb3e2-0aa0-4c98-812b-5c64e584a83e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55355::DEBUG::2014-05-16 18:07:03,416::task::974::TaskManager.Task::(_decref) Task=`07ebb3e2-0aa0-4c98-812b-5c64e584a83e`::ref 1 aborting False >Thread-55355::INFO::2014-05-16 18:07:03,417::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55355::DEBUG::2014-05-16 18:07:03,417::task::1168::TaskManager.Task::(prepare) Task=`07ebb3e2-0aa0-4c98-812b-5c64e584a83e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55355::DEBUG::2014-05-16 18:07:03,417::task::579::TaskManager.Task::(_updateState) Task=`07ebb3e2-0aa0-4c98-812b-5c64e584a83e`::moving from state preparing -> state finished >Thread-55355::DEBUG::2014-05-16 18:07:03,418::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55355::DEBUG::2014-05-16 18:07:03,418::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55355::DEBUG::2014-05-16 18:07:03,418::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55355::DEBUG::2014-05-16 18:07:03,418::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55355::DEBUG::2014-05-16 18:07:03,418::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55355::DEBUG::2014-05-16 18:07:03,418::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55355::DEBUG::2014-05-16 18:07:03,419::task::974::TaskManager.Task::(_decref) Task=`07ebb3e2-0aa0-4c98-812b-5c64e584a83e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:07:03,664::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:03,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316135 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:05,743::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:05,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353201 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:07,826::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:07,893::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314029 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:07:08,839::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:07:08,849::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000776344 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:09,905::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:09,971::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304809 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:11,982::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:12,056::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347802 s, 29.4 MB/s\n'; <rc> = 0 >Thread-55359::DEBUG::2014-05-16 18:07:13,623::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55359::DEBUG::2014-05-16 18:07:13,623::task::579::TaskManager.Task::(_updateState) Task=`ec02e31a-9ea4-4695-b7be-751c69b408e0`::moving from state init -> state preparing >Thread-55359::INFO::2014-05-16 18:07:13,623::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55359::INFO::2014-05-16 18:07:13,624::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55359::DEBUG::2014-05-16 18:07:13,624::task::1168::TaskManager.Task::(prepare) Task=`ec02e31a-9ea4-4695-b7be-751c69b408e0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55359::DEBUG::2014-05-16 18:07:13,624::task::579::TaskManager.Task::(_updateState) Task=`ec02e31a-9ea4-4695-b7be-751c69b408e0`::moving from state preparing -> state finished >Thread-55359::DEBUG::2014-05-16 18:07:13,624::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55359::DEBUG::2014-05-16 18:07:13,624::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55359::DEBUG::2014-05-16 18:07:13,624::task::974::TaskManager.Task::(_decref) Task=`ec02e31a-9ea4-4695-b7be-751c69b408e0`::ref 0 aborting False >Thread-55360::DEBUG::2014-05-16 18:07:13,633::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55360::DEBUG::2014-05-16 18:07:13,633::task::579::TaskManager.Task::(_updateState) Task=`aa6a8e9b-83cf-4845-b1c4-75f922a0a32a`::moving from state init -> state preparing >Thread-55360::INFO::2014-05-16 18:07:13,633::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55360::DEBUG::2014-05-16 18:07:13,634::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dd034c86-b535-41c4-9aa4-193f487f5b97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55360::DEBUG::2014-05-16 18:07:13,634::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55360::DEBUG::2014-05-16 18:07:13,634::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55360::DEBUG::2014-05-16 18:07:13,634::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dd034c86-b535-41c4-9aa4-193f487f5b97`::Granted request >Thread-55360::DEBUG::2014-05-16 18:07:13,635::task::811::TaskManager.Task::(resourceAcquired) Task=`aa6a8e9b-83cf-4845-b1c4-75f922a0a32a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55360::DEBUG::2014-05-16 18:07:13,635::task::974::TaskManager.Task::(_decref) Task=`aa6a8e9b-83cf-4845-b1c4-75f922a0a32a`::ref 1 aborting False >Thread-55360::INFO::2014-05-16 18:07:13,635::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55360::DEBUG::2014-05-16 18:07:13,636::task::1168::TaskManager.Task::(prepare) Task=`aa6a8e9b-83cf-4845-b1c4-75f922a0a32a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55360::DEBUG::2014-05-16 18:07:13,636::task::579::TaskManager.Task::(_updateState) Task=`aa6a8e9b-83cf-4845-b1c4-75f922a0a32a`::moving from state preparing -> state finished >Thread-55360::DEBUG::2014-05-16 18:07:13,636::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55360::DEBUG::2014-05-16 18:07:13,636::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55360::DEBUG::2014-05-16 18:07:13,636::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55360::DEBUG::2014-05-16 18:07:13,637::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55360::DEBUG::2014-05-16 18:07:13,637::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55360::DEBUG::2014-05-16 18:07:13,637::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55360::DEBUG::2014-05-16 18:07:13,637::task::974::TaskManager.Task::(_decref) Task=`aa6a8e9b-83cf-4845-b1c4-75f922a0a32a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:07:14,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:14,139::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359786 s, 28.5 MB/s\n'; <rc> = 0 >Thread-55362::DEBUG::2014-05-16 18:07:15,471::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [77321007] >Thread-55362::DEBUG::2014-05-16 18:07:15,471::task::579::TaskManager.Task::(_updateState) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::moving from state init -> state preparing >Thread-55362::INFO::2014-05-16 18:07:15,471::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='01628de4-d767-4b97-bdcf-c1e3459c1476', postZero='false', force='false') >Thread-55362::DEBUG::2014-05-16 18:07:15,472::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.01628de4-d767-4b97-bdcf-c1e3459c1476`ReqID=`c4d33687-7626-4be8-94ee-2c29ad31e60c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1526' at 'deleteImage' >Thread-55362::DEBUG::2014-05-16 18:07:15,472::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.01628de4-d767-4b97-bdcf-c1e3459c1476' for lock type 'exclusive' >Thread-55362::DEBUG::2014-05-16 18:07:15,472::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.01628de4-d767-4b97-bdcf-c1e3459c1476' is free. Now locking as 'exclusive' (1 active user) >Thread-55362::DEBUG::2014-05-16 18:07:15,472::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.01628de4-d767-4b97-bdcf-c1e3459c1476`ReqID=`c4d33687-7626-4be8-94ee-2c29ad31e60c`::Granted request >Thread-55362::DEBUG::2014-05-16 18:07:15,473::task::811::TaskManager.Task::(resourceAcquired) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::_resourcesAcquired: Storage.01628de4-d767-4b97-bdcf-c1e3459c1476 (exclusive) >Thread-55362::DEBUG::2014-05-16 18:07:15,473::task::974::TaskManager.Task::(_decref) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::ref 1 aborting False >Thread-55362::DEBUG::2014-05-16 18:07:15,473::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`093384cc-b070-48bf-b44e-320808e27400`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1527' at 'deleteImage' >Thread-55362::DEBUG::2014-05-16 18:07:15,474::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55362::DEBUG::2014-05-16 18:07:15,474::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55362::DEBUG::2014-05-16 18:07:15,474::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`093384cc-b070-48bf-b44e-320808e27400`::Granted request >Thread-55362::DEBUG::2014-05-16 18:07:15,474::task::811::TaskManager.Task::(resourceAcquired) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55362::DEBUG::2014-05-16 18:07:15,474::task::974::TaskManager.Task::(_decref) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::ref 1 aborting False >Thread-55362::DEBUG::2014-05-16 18:07:15,475::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55362::DEBUG::2014-05-16 18:07:15,475::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55362::DEBUG::2014-05-16 18:07:15,621::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55362::DEBUG::2014-05-16 18:07:15,636::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55362::DEBUG::2014-05-16 18:07:15,636::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55362::DEBUG::2014-05-16 18:07:15,638::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n -a y --deltag IU_01628de4-d767-4b97-bdcf-c1e3459c1476 --addtag IU__remove_me_01628de4-d767-4b97-bdcf-c1e3459c1476 f79908bf-a757-4a71-9ab5-3a12ede5f65c/458ec5f0-63fa-49a6-a086-e06ecc27582a' (cwd None) >Thread-55362::DEBUG::2014-05-16 18:07:15,920::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-55362::DEBUG::2014-05-16 18:07:15,921::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55362::DEBUG::2014-05-16 18:07:15,921::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55362::WARNING::2014-05-16 18:07:15,921::lvm::1108::Storage.LVM::(removeLVs) Removing active volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/458ec5f0-63fa-49a6-a086-e06ecc27582a >Thread-55362::DEBUG::2014-05-16 18:07:15,922::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n f79908bf-a757-4a71-9ab5-3a12ede5f65c/458ec5f0-63fa-49a6-a086-e06ecc27582a' (cwd None) >Thread-55362::DEBUG::2014-05-16 18:07:16,102::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-55362::DEBUG::2014-05-16 18:07:16,102::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55362::DEBUG::2014-05-16 18:07:16,103::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55362::DEBUG::2014-05-16 18:07:16,103::blockSD::935::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476/458ec5f0-63fa-49a6-a086-e06ecc27582a'] >Thread-55362::DEBUG::2014-05-16 18:07:16,103::blockSD::946::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/01628de4-d767-4b97-bdcf-c1e3459c1476 >Thread-55362::DEBUG::2014-05-16 18:07:16,104::task::736::TaskManager.Task::(_save) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92.temp >Thread-55362::DEBUG::2014-05-16 18:07:16,110::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_01628de4-d767-4b97-bdcf-c1e3459c1476 for task e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92 >Thread-55362::INFO::2014-05-16 18:07:16,110::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-55362::DEBUG::2014-05-16 18:07:16,110::task::1163::TaskManager.Task::(prepare) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::Prepare: 1 jobs exist, move to acquiring >Thread-55362::DEBUG::2014-05-16 18:07:16,110::task::579::TaskManager.Task::(_updateState) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::moving from state preparing -> state acquiring >Thread-55362::DEBUG::2014-05-16 18:07:16,111::task::736::TaskManager.Task::(_save) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92.temp >Thread-55362::DEBUG::2014-05-16 18:07:16,116::task::579::TaskManager.Task::(_updateState) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::moving from state acquiring -> state queued >Thread-55362::DEBUG::2014-05-16 18:07:16,117::task::736::TaskManager.Task::(_save) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92.temp >Thread-55362::DEBUG::2014-05-16 18:07:16,123::taskManager::50::TaskManager::(_queueTask) queuing task: e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92 >Thread-55362::DEBUG::2014-05-16 18:07:16,123::taskManager::56::TaskManager::(_queueTask) task queued: e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92 >0ed5d6c5-4689-4d69-9909-4a386461e36d::DEBUG::2014-05-16 18:07:16,123::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-55362::DEBUG::2014-05-16 18:07:16,124::task::1165::TaskManager.Task::(prepare) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::returning >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,125::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92 running: <bound method Task.commit of <storage.task.Task instance at 0x7ff55c0e7200>> with: None >Thread-55362::DEBUG::2014-05-16 18:07:16,126::task::974::TaskManager.Task::(_decref) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::ref 0 aborting False >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,126::task::1176::TaskManager.Task::(commit) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::committing task: e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92 >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,128::task::579::TaskManager.Task::(_updateState) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::moving from state queued -> state running >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,128::task::736::TaskManager.Task::(_save) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92.temp >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,134::task::889::TaskManager.Task::(_runJobs) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::Task.run: running job 0: deleteImage_01628de4-d767-4b97-bdcf-c1e3459c1476: <function <lambda> at 0x7ff53805f050> (args: () kwargs: {}) >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,134::task::315::TaskManager.Task::(run) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::Job.run: running deleteImage_01628de4-d767-4b97-bdcf-c1e3459c1476: <function <lambda> at 0x7ff53805f050> (args: () kwargs: {}) callback None >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,134::task::579::TaskManager.Task::(_updateState) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::moving from state running -> state finished >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,135::task::736::TaskManager.Task::(_save) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92.temp >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,141::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>, 'Storage.01628de4-d767-4b97-bdcf-c1e3459c1476': < ResourceRef 'Storage.01628de4-d767-4b97-bdcf-c1e3459c1476', isValid: 'True' obj: 'None'>} >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,141::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,141::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,142::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,142::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,142::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,142::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.01628de4-d767-4b97-bdcf-c1e3459c1476' >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,142::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.01628de4-d767-4b97-bdcf-c1e3459c1476' (0 active users) >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,142::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.01628de4-d767-4b97-bdcf-c1e3459c1476' is free, finding out if anyone is waiting for it. >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,143::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.01628de4-d767-4b97-bdcf-c1e3459c1476', Clearing records. >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,143::task::897::TaskManager.Task::(_runJobs) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::Task.run: exit - success: result True >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,143::task::974::TaskManager.Task::(_decref) Task=`e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92`::ref 0 aborting False >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:16,143::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-51::DEBUG::2014-05-16 18:07:16,151::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:16,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348829 s, 29.4 MB/s\n'; <rc> = 0 >Thread-55363::DEBUG::2014-05-16 18:07:17,842::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5078959.000000 / 8.008186 / 262500000.000000 = 0.241608 >Thread-55363::DEBUG::2014-05-16 18:07:17,842::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.024037308279991624, 'statsAge': 0.34147500991821289, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.24160796205113397, 'rxDropped': 0} >Thread-55363::DEBUG::2014-05-16 18:07:17,843::task::579::TaskManager.Task::(_updateState) Task=`20a6c97b-180b-452a-9130-38d64277b023`::moving from state init -> state preparing >Thread-55363::INFO::2014-05-16 18:07:17,843::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55363::INFO::2014-05-16 18:07:17,843::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000776344', 'lastCheck': '9.0', 'valid': True}} >Thread-55363::DEBUG::2014-05-16 18:07:17,844::task::1168::TaskManager.Task::(prepare) Task=`20a6c97b-180b-452a-9130-38d64277b023`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000776344', 'lastCheck': '9.0', 'valid': True}} >Thread-55363::DEBUG::2014-05-16 18:07:17,844::task::579::TaskManager.Task::(_updateState) Task=`20a6c97b-180b-452a-9130-38d64277b023`::moving from state preparing -> state finished >Thread-55363::DEBUG::2014-05-16 18:07:17,844::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55363::DEBUG::2014-05-16 18:07:17,844::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55363::DEBUG::2014-05-16 18:07:17,844::task::974::TaskManager.Task::(_decref) Task=`20a6c97b-180b-452a-9130-38d64277b023`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:07:18,233::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:18,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035878 s, 28.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:07:18,869::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:07:18,870::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:07:19,020::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:07:19,022::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:07:19,042::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:07:19,052::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000536505 s, 7.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:20,317::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:20,389::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362033 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:22,401::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:22,468::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302515 s, 33.8 MB/s\n'; <rc> = 0 >Thread-55366::DEBUG::2014-05-16 18:07:22,869::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55366::DEBUG::2014-05-16 18:07:22,870::task::579::TaskManager.Task::(_updateState) Task=`99ca925a-28ab-49f5-b1d9-df65292380de`::moving from state init -> state preparing >Thread-55366::INFO::2014-05-16 18:07:22,870::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-55366::DEBUG::2014-05-16 18:07:22,870::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-55366::DEBUG::2014-05-16 18:07:22,870::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92 >Thread-55366::DEBUG::2014-05-16 18:07:22,870::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92'} >Thread-55366::DEBUG::2014-05-16 18:07:22,871::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92'}} >Thread-55366::INFO::2014-05-16 18:07:22,871::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92'}}} >Thread-55366::DEBUG::2014-05-16 18:07:22,871::task::1168::TaskManager.Task::(prepare) Task=`99ca925a-28ab-49f5-b1d9-df65292380de`::finished: {'allTasksStatus': {'e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92'}}} >Thread-55366::DEBUG::2014-05-16 18:07:22,871::task::579::TaskManager.Task::(_updateState) Task=`99ca925a-28ab-49f5-b1d9-df65292380de`::moving from state preparing -> state finished >Thread-55366::DEBUG::2014-05-16 18:07:22,871::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55366::DEBUG::2014-05-16 18:07:22,871::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55366::DEBUG::2014-05-16 18:07:22,872::task::974::TaskManager.Task::(_decref) Task=`99ca925a-28ab-49f5-b1d9-df65292380de`::ref 0 aborting False >Thread-55367::DEBUG::2014-05-16 18:07:23,068::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55367::DEBUG::2014-05-16 18:07:23,068::task::579::TaskManager.Task::(_updateState) Task=`28f18b6c-e191-40fd-bf68-f61232061555`::moving from state init -> state preparing >Thread-55367::INFO::2014-05-16 18:07:23,068::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92', spUUID=None, options=None) >Thread-55367::DEBUG::2014-05-16 18:07:23,068::taskManager::161::TaskManager::(clearTask) Entry. taskID: e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92 >Thread-55367::DEBUG::2014-05-16 18:07:23,069::taskManager::166::TaskManager::(clearTask) Return. >Thread-55367::INFO::2014-05-16 18:07:23,069::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-55367::DEBUG::2014-05-16 18:07:23,069::task::1168::TaskManager.Task::(prepare) Task=`28f18b6c-e191-40fd-bf68-f61232061555`::finished: None >Thread-55367::DEBUG::2014-05-16 18:07:23,069::task::579::TaskManager.Task::(_updateState) Task=`28f18b6c-e191-40fd-bf68-f61232061555`::moving from state preparing -> state finished >Thread-55367::DEBUG::2014-05-16 18:07:23,069::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55367::DEBUG::2014-05-16 18:07:23,070::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55367::DEBUG::2014-05-16 18:07:23,070::task::974::TaskManager.Task::(_decref) Task=`28f18b6c-e191-40fd-bf68-f61232061555`::ref 0 aborting False >Thread-55368::DEBUG::2014-05-16 18:07:23,781::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55368::DEBUG::2014-05-16 18:07:23,781::task::579::TaskManager.Task::(_updateState) Task=`1799b98c-ebb1-4a73-9f5d-fc85254387cf`::moving from state init -> state preparing >Thread-55368::INFO::2014-05-16 18:07:23,782::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55368::INFO::2014-05-16 18:07:23,782::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55368::DEBUG::2014-05-16 18:07:23,782::task::1168::TaskManager.Task::(prepare) Task=`1799b98c-ebb1-4a73-9f5d-fc85254387cf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55368::DEBUG::2014-05-16 18:07:23,782::task::579::TaskManager.Task::(_updateState) Task=`1799b98c-ebb1-4a73-9f5d-fc85254387cf`::moving from state preparing -> state finished >Thread-55368::DEBUG::2014-05-16 18:07:23,782::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55368::DEBUG::2014-05-16 18:07:23,783::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55368::DEBUG::2014-05-16 18:07:23,783::task::974::TaskManager.Task::(_decref) Task=`1799b98c-ebb1-4a73-9f5d-fc85254387cf`::ref 0 aborting False >Thread-55369::DEBUG::2014-05-16 18:07:23,806::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55369::DEBUG::2014-05-16 18:07:23,806::task::579::TaskManager.Task::(_updateState) Task=`22a769c2-cb2c-4107-b93c-d080d682dd60`::moving from state init -> state preparing >Thread-55369::INFO::2014-05-16 18:07:23,807::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55369::DEBUG::2014-05-16 18:07:23,807::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`25c692c3-6d49-4717-b4b7-8e7f3a7afc18`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55369::DEBUG::2014-05-16 18:07:23,807::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55369::DEBUG::2014-05-16 18:07:23,807::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55369::DEBUG::2014-05-16 18:07:23,808::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`25c692c3-6d49-4717-b4b7-8e7f3a7afc18`::Granted request >Thread-55369::DEBUG::2014-05-16 18:07:23,808::task::811::TaskManager.Task::(resourceAcquired) Task=`22a769c2-cb2c-4107-b93c-d080d682dd60`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55369::DEBUG::2014-05-16 18:07:23,808::task::974::TaskManager.Task::(_decref) Task=`22a769c2-cb2c-4107-b93c-d080d682dd60`::ref 1 aborting False >Thread-55369::INFO::2014-05-16 18:07:23,809::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55369::DEBUG::2014-05-16 18:07:23,809::task::1168::TaskManager.Task::(prepare) Task=`22a769c2-cb2c-4107-b93c-d080d682dd60`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55369::DEBUG::2014-05-16 18:07:23,809::task::579::TaskManager.Task::(_updateState) Task=`22a769c2-cb2c-4107-b93c-d080d682dd60`::moving from state preparing -> state finished >Thread-55369::DEBUG::2014-05-16 18:07:23,809::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55369::DEBUG::2014-05-16 18:07:23,809::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55369::DEBUG::2014-05-16 18:07:23,810::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55369::DEBUG::2014-05-16 18:07:23,810::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55369::DEBUG::2014-05-16 18:07:23,810::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55369::DEBUG::2014-05-16 18:07:23,810::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55369::DEBUG::2014-05-16 18:07:23,810::task::974::TaskManager.Task::(_decref) Task=`22a769c2-cb2c-4107-b93c-d080d682dd60`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:07:24,479::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:24,547::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318556 s, 32.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:26,559::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:26,631::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354055 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:28,643::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:28,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357484 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:07:29,088::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:07:29,098::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000573461 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:30,728::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:30,795::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313446 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:32,806::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:32,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352732 s, 29.0 MB/s\n'; <rc> = 0 >Thread-55373::DEBUG::2014-05-16 18:07:33,370::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4324945.000000 / 8.008577 / 262500000.000000 = 0.205729 >Thread-55373::DEBUG::2014-05-16 18:07:33,370::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0074166197846052559, 'statsAge': 1.8539159297943115, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2057291917079041, 'rxDropped': 0} >Thread-55373::DEBUG::2014-05-16 18:07:33,370::task::579::TaskManager.Task::(_updateState) Task=`e10fff25-1db0-4226-9b75-489e8b7c8d31`::moving from state init -> state preparing >Thread-55373::INFO::2014-05-16 18:07:33,371::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55373::INFO::2014-05-16 18:07:33,371::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573461', 'lastCheck': '4.3', 'valid': True}} >Thread-55373::DEBUG::2014-05-16 18:07:33,371::task::1168::TaskManager.Task::(prepare) Task=`e10fff25-1db0-4226-9b75-489e8b7c8d31`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573461', 'lastCheck': '4.3', 'valid': True}} >Thread-55373::DEBUG::2014-05-16 18:07:33,371::task::579::TaskManager.Task::(_updateState) Task=`e10fff25-1db0-4226-9b75-489e8b7c8d31`::moving from state preparing -> state finished >Thread-55373::DEBUG::2014-05-16 18:07:33,371::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55373::DEBUG::2014-05-16 18:07:33,371::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55373::DEBUG::2014-05-16 18:07:33,372::task::974::TaskManager.Task::(_decref) Task=`e10fff25-1db0-4226-9b75-489e8b7c8d31`::ref 0 aborting False >Thread-55375::DEBUG::2014-05-16 18:07:33,870::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55375::DEBUG::2014-05-16 18:07:33,871::task::579::TaskManager.Task::(_updateState) Task=`151959ae-51e2-4924-b7ae-e2bdbe0aea80`::moving from state init -> state preparing >Thread-55375::INFO::2014-05-16 18:07:33,871::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55375::INFO::2014-05-16 18:07:33,871::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55375::DEBUG::2014-05-16 18:07:33,871::task::1168::TaskManager.Task::(prepare) Task=`151959ae-51e2-4924-b7ae-e2bdbe0aea80`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55375::DEBUG::2014-05-16 18:07:33,872::task::579::TaskManager.Task::(_updateState) Task=`151959ae-51e2-4924-b7ae-e2bdbe0aea80`::moving from state preparing -> state finished >Thread-55375::DEBUG::2014-05-16 18:07:33,872::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55375::DEBUG::2014-05-16 18:07:33,872::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55375::DEBUG::2014-05-16 18:07:33,872::task::974::TaskManager.Task::(_decref) Task=`151959ae-51e2-4924-b7ae-e2bdbe0aea80`::ref 0 aborting False >Thread-55376::DEBUG::2014-05-16 18:07:33,880::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55376::DEBUG::2014-05-16 18:07:33,880::task::579::TaskManager.Task::(_updateState) Task=`78eb7bfb-9b09-439f-b7d1-e7a3695aaca1`::moving from state init -> state preparing >Thread-55376::INFO::2014-05-16 18:07:33,880::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55376::DEBUG::2014-05-16 18:07:33,881::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2760c098-f299-48c6-867c-46c00004a0e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55376::DEBUG::2014-05-16 18:07:33,881::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55376::DEBUG::2014-05-16 18:07:33,881::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55376::DEBUG::2014-05-16 18:07:33,881::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2760c098-f299-48c6-867c-46c00004a0e7`::Granted request >Thread-55376::DEBUG::2014-05-16 18:07:33,882::task::811::TaskManager.Task::(resourceAcquired) Task=`78eb7bfb-9b09-439f-b7d1-e7a3695aaca1`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55376::DEBUG::2014-05-16 18:07:33,882::task::974::TaskManager.Task::(_decref) Task=`78eb7bfb-9b09-439f-b7d1-e7a3695aaca1`::ref 1 aborting False >Thread-55376::INFO::2014-05-16 18:07:33,883::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55376::DEBUG::2014-05-16 18:07:33,883::task::1168::TaskManager.Task::(prepare) Task=`78eb7bfb-9b09-439f-b7d1-e7a3695aaca1`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55376::DEBUG::2014-05-16 18:07:33,883::task::579::TaskManager.Task::(_updateState) Task=`78eb7bfb-9b09-439f-b7d1-e7a3695aaca1`::moving from state preparing -> state finished >Thread-55376::DEBUG::2014-05-16 18:07:33,883::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55376::DEBUG::2014-05-16 18:07:33,883::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55376::DEBUG::2014-05-16 18:07:33,883::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55376::DEBUG::2014-05-16 18:07:33,884::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55376::DEBUG::2014-05-16 18:07:33,884::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55376::DEBUG::2014-05-16 18:07:33,884::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55376::DEBUG::2014-05-16 18:07:33,884::task::974::TaskManager.Task::(_decref) Task=`78eb7bfb-9b09-439f-b7d1-e7a3695aaca1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:07:34,889::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:34,959::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343646 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:36,972::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:37,039::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307482 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:39,051::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:39,218::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357485 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:07:39,274::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:07:39,296::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000763671 s, 5.4 MB/s\n'; <rc> = 0 >Thread-55379::DEBUG::2014-05-16 18:07:39,933::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [3bfb8b9e] >Thread-55379::DEBUG::2014-05-16 18:07:39,933::task::579::TaskManager.Task::(_updateState) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::moving from state init -> state preparing >Thread-55379::INFO::2014-05-16 18:07:39,933::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='f6a961b4-d81e-4aea-97bf-5bf83cf62b26', size='34359738368', volFormat=4, preallocate=2, diskType=2, volUUID='330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', desc='', srcImgUUID='7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', srcVolUUID='77c78124-ee6c-46b1-9112-a738f448beca') >Thread-55379::DEBUG::2014-05-16 18:07:39,934::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`25b20da0-dc8b-4c90-b129-b8f5f1b30acf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1484' at 'createVolume' >Thread-55379::DEBUG::2014-05-16 18:07:39,934::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55379::DEBUG::2014-05-16 18:07:39,934::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55379::DEBUG::2014-05-16 18:07:39,934::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`25b20da0-dc8b-4c90-b129-b8f5f1b30acf`::Granted request >Thread-55379::DEBUG::2014-05-16 18:07:39,935::task::811::TaskManager.Task::(resourceAcquired) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55379::DEBUG::2014-05-16 18:07:39,936::task::974::TaskManager.Task::(_decref) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::ref 1 aborting False >Thread-55379::DEBUG::2014-05-16 18:07:39,936::task::736::TaskManager.Task::(_save) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3.temp >Thread-55379::DEBUG::2014-05-16 18:07:39,942::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 6ba4f964-f6b5-4919-ab9c-3d753570c2a3 >Thread-55379::INFO::2014-05-16 18:07:39,942::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-55379::DEBUG::2014-05-16 18:07:39,942::task::1163::TaskManager.Task::(prepare) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::Prepare: 1 jobs exist, move to acquiring >Thread-55379::DEBUG::2014-05-16 18:07:39,942::task::579::TaskManager.Task::(_updateState) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::moving from state preparing -> state acquiring >Thread-55379::DEBUG::2014-05-16 18:07:39,942::task::736::TaskManager.Task::(_save) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3.temp >Thread-55379::DEBUG::2014-05-16 18:07:39,947::task::579::TaskManager.Task::(_updateState) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::moving from state acquiring -> state queued >Thread-55379::DEBUG::2014-05-16 18:07:39,948::task::736::TaskManager.Task::(_save) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3.temp >Thread-55379::DEBUG::2014-05-16 18:07:39,953::taskManager::50::TaskManager::(_queueTask) queuing task: 6ba4f964-f6b5-4919-ab9c-3d753570c2a3 >Thread-55379::DEBUG::2014-05-16 18:07:39,953::taskManager::56::TaskManager::(_queueTask) task queued: 6ba4f964-f6b5-4919-ab9c-3d753570c2a3 >e0cb10f3-6bb9-4e8e-8fe8-dbdf73038f92::DEBUG::2014-05-16 18:07:39,953::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-55379::DEBUG::2014-05-16 18:07:39,953::task::1165::TaskManager.Task::(prepare) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::returning >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:39,953::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 6ba4f964-f6b5-4919-ab9c-3d753570c2a3 running: <bound method Task.commit of <storage.task.Task instance at 0x7ff538057cf8>> with: None >Thread-55379::DEBUG::2014-05-16 18:07:39,954::task::974::TaskManager.Task::(_decref) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::ref 0 aborting False >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:39,954::task::1176::TaskManager.Task::(commit) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::committing task: 6ba4f964-f6b5-4919-ab9c-3d753570c2a3 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:39,954::task::579::TaskManager.Task::(_updateState) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::moving from state queued -> state running >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:39,955::task::736::TaskManager.Task::(_save) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3.temp >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:39,960::task::889::TaskManager.Task::(_runJobs) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x2b04510>> (args: ('f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 67108864, 4, 2, 2, '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', '', '7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', '77c78124-ee6c-46b1-9112-a738f448beca') kwargs: {}) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:39,960::task::315::TaskManager.Task::(run) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x2b04510>> (args: ('f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 67108864, 4, 2, 2, '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', '', '7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', '77c78124-ee6c-46b1-9112-a738f448beca') kwargs: {}) callback None >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:39,960::resourceManager::197::ResourceManager.Request::(__init__) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f6a961b4-d81e-4aea-97bf-5bf83cf62b26`ReqID=`78ae68a5-d358-4427-989f-e36a8be14972`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1895' at 'createVolume' >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:39,960::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f6a961b4-d81e-4aea-97bf-5bf83cf62b26' for lock type 'exclusive' >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:39,961::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:39,961::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,109::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,124::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,124::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,124::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image f6a961b4-d81e-4aea-97bf-5bf83cf62b26 does not exist in domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,125::resourceManager::600::ResourceManager::(registerResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f6a961b4-d81e-4aea-97bf-5bf83cf62b26' is free. Now locking as 'exclusive' (1 active user) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,125::resourceManager::237::ResourceManager.Request::(grant) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f6a961b4-d81e-4aea-97bf-5bf83cf62b26`ReqID=`78ae68a5-d358-4427-989f-e36a8be14972`::Granted request >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::INFO::2014-05-16 18:07:40,126::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26 for image's volumes >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,126::task::736::TaskManager.Task::(_save) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3.temp >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,151::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,160::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000517631 s, 989 kB/s\n'; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,160::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000517631 s, 989 kB/s'], size: 512 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,160::volume::300::Storage.Volume::(share) Share volume 77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,181::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,189::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000526269 s, 973 kB/s\n'; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,189::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000526269 s, 973 kB/s'], size: 512 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,190::task::736::TaskManager.Task::(_save) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3.temp >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,197::blockVolume::380::Storage.Volume::(_share) Share volume 77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,215::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,223::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000510886 s, 1.0 MB/s\n'; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,224::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000510886 s, 1.0 MB/s'], size: 512 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::INFO::2014-05-16 18:07:40,224::volume::446::Storage.Volume::(create) Creating volume 330b9d95-7458-42ca-b1ae-4a6ac1e9c73c >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,225::task::736::TaskManager.Task::(_save) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3.temp >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,233::task::736::TaskManager.Task::(_save) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3.temp >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,241::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 330b9d95-7458-42ca-b1ae-4a6ac1e9c73c f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,429::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,431::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,436::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,436::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,436::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::WARNING::2014-05-16 18:07:40,437::utils::114::root::(rmFile) File: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c already removed >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::INFO::2014-05-16 18:07:40,438::blockVolume::196::Storage.Volume::(_create) Request to create snapshot f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c of volume 7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96/77c78124-ee6c-46b1-9112-a738f448beca >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,439::task::736::TaskManager.Task::(_save) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3.temp >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,471::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,480::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000504707 s, 1.0 MB/s\n'; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,480::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000504707 s, 1.0 MB/s'], size: 512 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::INFO::2014-05-16 18:07:40,480::volume::793::Storage.Volume::(prepare) Volume: preparing volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,501::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,509::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000497996 s, 1.0 MB/s\n'; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,509::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000497996 s, 1.0 MB/s'], size: 512 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,510::resourceManager::197::ResourceManager.Request::(__init__) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca`ReqID=`e5ceb65b-86c6-4f59-94f9-a83db0873895`::Request was made in '/usr/share/vdsm/storage/volume.py' line '810' at 'prepare' >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,510::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' for lock type 'shared' >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,511::resourceManager::600::ResourceManager::(registerResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' is free. Now locking as 'shared' (1 active user) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,512::resourceManager::237::ResourceManager.Request::(grant) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca`ReqID=`e5ceb65b-86c6-4f59-94f9-a83db0873895`::Granted request >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,530::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,538::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000536506 s, 954 kB/s\n'; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,539::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000536506 s, 954 kB/s'], size: 512 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,539::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,557::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,566::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000486448 s, 1.1 MB/s\n'; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,566::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000486448 s, 1.1 MB/s'], size: 512 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,584::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,593::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000523653 s, 978 kB/s\n'; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,593::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000523653 s, 978 kB/s'], size: 512 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,594::volume::1058::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../f6a961b4-d81e-4aea-97bf-5bf83cf62b26/77c78124-ee6c-46b1-9112-a738f448beca /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c' (cwd /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,635::volume::1058::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::INFO::2014-05-16 18:07:40,635::blockVolume::420::Storage.Volume::(teardown) Tearing down volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca justme False >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,635::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,636::resourceManager::634::ResourceManager::(releaseResource) Released resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' (0 active users) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,636::resourceManager::640::ResourceManager::(releaseResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' is free, finding out if anyone is waiting for it. >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,637::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,812::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,812::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,813::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,813::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca', Clearing records. >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,813::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,814::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,966::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,982::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,982::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,982::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:40,983::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,132::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,147::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,147::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::WARNING::2014-05-16 18:07:41,147::blockSD::743::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv f79908bf-a757-4a71-9ab5-3a12ede5f65c/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,147::blockSD::766::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 15 in VG f79908bf-a757-4a71-9ab5-3a12ede5f65c >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,148::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_15 --addtag IU_f6a961b4-d81e-4aea-97bf-5bf83cf62b26 --addtag PU_77c78124-ee6c-46b1-9112-a738f448beca f79908bf-a757-4a71-9ab5-3a12ede5f65c/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c' (cwd None) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,326::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,327::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,327::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,328::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:41,390::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:41,469::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400804 s, 25.5 MB/s\n'; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,501::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,502::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,502::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,503::task::736::TaskManager.Task::(_save) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3.temp >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,536::blockVolume::622::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=330b9d95-7458-42ca-b1ae-4a6ac1e9c73c sdUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c, metaId=('f79908bf-a757-4a71-9ab5-3a12ede5f65c', 15) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,552::task::736::TaskManager.Task::(_save) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3.temp >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,584::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f6a961b4-d81e-4aea-97bf-5bf83cf62b26' >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,585::resourceManager::634::ResourceManager::(releaseResource) Released resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f6a961b4-d81e-4aea-97bf-5bf83cf62b26' (0 active users) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,585::resourceManager::640::ResourceManager::(releaseResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f6a961b4-d81e-4aea-97bf-5bf83cf62b26' is free, finding out if anyone is waiting for it. >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,585::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f6a961b4-d81e-4aea-97bf-5bf83cf62b26', Clearing records. >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,585::task::579::TaskManager.Task::(_updateState) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::moving from state running -> state finished >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,586::task::736::TaskManager.Task::(_save) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6ba4f964-f6b5-4919-ab9c-3d753570c2a3.temp >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,596::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,596::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,596::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,597::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,597::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,597::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,597::task::897::TaskManager.Task::(_runJobs) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::Task.run: exit - success: result {'uuid': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c'} >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,597::task::974::TaskManager.Task::(_decref) Task=`6ba4f964-f6b5-4919-ab9c-3d753570c2a3`::ref 0 aborting False >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:07:41,598::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-55381::DEBUG::2014-05-16 18:07:42,938::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55381::DEBUG::2014-05-16 18:07:42,939::task::579::TaskManager.Task::(_updateState) Task=`572e2d4d-eb1a-497c-9da4-adc338bb5d3f`::moving from state init -> state preparing >Thread-55381::INFO::2014-05-16 18:07:42,939::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-55381::DEBUG::2014-05-16 18:07:42,939::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-55381::DEBUG::2014-05-16 18:07:42,939::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 6ba4f964-f6b5-4919-ab9c-3d753570c2a3 >Thread-55381::DEBUG::2014-05-16 18:07:42,939::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6ba4f964-f6b5-4919-ab9c-3d753570c2a3'} >Thread-55381::DEBUG::2014-05-16 18:07:42,939::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'6ba4f964-f6b5-4919-ab9c-3d753570c2a3': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6ba4f964-f6b5-4919-ab9c-3d753570c2a3'}} >Thread-55381::INFO::2014-05-16 18:07:42,939::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'6ba4f964-f6b5-4919-ab9c-3d753570c2a3': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6ba4f964-f6b5-4919-ab9c-3d753570c2a3'}}} >Thread-55381::DEBUG::2014-05-16 18:07:42,940::task::1168::TaskManager.Task::(prepare) Task=`572e2d4d-eb1a-497c-9da4-adc338bb5d3f`::finished: {'allTasksStatus': {'6ba4f964-f6b5-4919-ab9c-3d753570c2a3': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6ba4f964-f6b5-4919-ab9c-3d753570c2a3'}}} >Thread-55381::DEBUG::2014-05-16 18:07:42,940::task::579::TaskManager.Task::(_updateState) Task=`572e2d4d-eb1a-497c-9da4-adc338bb5d3f`::moving from state preparing -> state finished >Thread-55381::DEBUG::2014-05-16 18:07:42,940::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55381::DEBUG::2014-05-16 18:07:42,940::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55381::DEBUG::2014-05-16 18:07:42,940::task::974::TaskManager.Task::(_decref) Task=`572e2d4d-eb1a-497c-9da4-adc338bb5d3f`::ref 0 aborting False >Thread-55382::DEBUG::2014-05-16 18:07:43,094::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [3bfb8b9e] >Thread-55382::DEBUG::2014-05-16 18:07:43,095::task::579::TaskManager.Task::(_updateState) Task=`3dd2b75a-f60a-46dc-a057-aed9af4b9776`::moving from state init -> state preparing >Thread-55382::INFO::2014-05-16 18:07:43,095::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='f6a961b4-d81e-4aea-97bf-5bf83cf62b26', volUUID='330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', options=None) >Thread-55382::DEBUG::2014-05-16 18:07:43,095::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`2540b723-36eb-443b-8918-c0a71ebce037`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3104' at 'getVolumeInfo' >Thread-55382::DEBUG::2014-05-16 18:07:43,095::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55382::DEBUG::2014-05-16 18:07:43,096::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55382::DEBUG::2014-05-16 18:07:43,096::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`2540b723-36eb-443b-8918-c0a71ebce037`::Granted request >Thread-55382::DEBUG::2014-05-16 18:07:43,096::task::811::TaskManager.Task::(resourceAcquired) Task=`3dd2b75a-f60a-46dc-a057-aed9af4b9776`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55382::DEBUG::2014-05-16 18:07:43,096::task::974::TaskManager.Task::(_decref) Task=`3dd2b75a-f60a-46dc-a057-aed9af4b9776`::ref 1 aborting False >Thread-55382::DEBUG::2014-05-16 18:07:43,096::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55382::DEBUG::2014-05-16 18:07:43,097::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55382::DEBUG::2014-05-16 18:07:43,246::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55382::DEBUG::2014-05-16 18:07:43,264::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55382::DEBUG::2014-05-16 18:07:43,264::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55382::INFO::2014-05-16 18:07:43,265::volume::883::Storage.Volume::(getInfo) Info request: sdUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c imgUUID=f6a961b4-d81e-4aea-97bf-5bf83cf62b26 volUUID = 330b9d95-7458-42ca-b1ae-4a6ac1e9c73c >Thread-55382::DEBUG::2014-05-16 18:07:43,284::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-55382::DEBUG::2014-05-16 18:07:43,293::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000489795 s, 1.0 MB/s\n'; <rc> = 0 >Thread-55382::DEBUG::2014-05-16 18:07:43,293::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000489795 s, 1.0 MB/s'], size: 512 >Thread-55382::DEBUG::2014-05-16 18:07:43,314::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-55382::DEBUG::2014-05-16 18:07:43,322::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000493785 s, 1.0 MB/s\n'; <rc> = 0 >Thread-55382::DEBUG::2014-05-16 18:07:43,322::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000493785 s, 1.0 MB/s'], size: 512 >Thread-55382::DEBUG::2014-05-16 18:07:43,322::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55382::DEBUG::2014-05-16 18:07:43,323::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55382::DEBUG::2014-05-16 18:07:43,473::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:43,483::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55382::DEBUG::2014-05-16 18:07:43,502::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55382::DEBUG::2014-05-16 18:07:43,503::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55382::INFO::2014-05-16 18:07:43,505::volume::912::Storage.Volume::(getInfo) f79908bf-a757-4a71-9ab5-3a12ede5f65c/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c info is {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 'ctime': '1400263661', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400263661', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-55382::INFO::2014-05-16 18:07:43,506::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 'ctime': '1400263661', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400263661', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-55382::DEBUG::2014-05-16 18:07:43,508::task::1168::TaskManager.Task::(prepare) Task=`3dd2b75a-f60a-46dc-a057-aed9af4b9776`::finished: {'info': {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 'ctime': '1400263661', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400263661', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-55382::DEBUG::2014-05-16 18:07:43,509::task::579::TaskManager.Task::(_updateState) Task=`3dd2b75a-f60a-46dc-a057-aed9af4b9776`::moving from state preparing -> state finished >Thread-55382::DEBUG::2014-05-16 18:07:43,510::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55382::DEBUG::2014-05-16 18:07:43,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55382::DEBUG::2014-05-16 18:07:43,514::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55382::DEBUG::2014-05-16 18:07:43,515::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55382::DEBUG::2014-05-16 18:07:43,516::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55382::DEBUG::2014-05-16 18:07:43,518::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55382::DEBUG::2014-05-16 18:07:43,520::task::974::TaskManager.Task::(_decref) Task=`3dd2b75a-f60a-46dc-a057-aed9af4b9776`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:07:43,582::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0606648 s, 16.9 MB/s\n'; <rc> = 0 >Thread-55383::DEBUG::2014-05-16 18:07:43,685::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55383::DEBUG::2014-05-16 18:07:43,686::task::579::TaskManager.Task::(_updateState) Task=`9e85de0b-94d2-45e0-83f3-c4d5a2dd6e25`::moving from state init -> state preparing >Thread-55383::INFO::2014-05-16 18:07:43,686::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='6ba4f964-f6b5-4919-ab9c-3d753570c2a3', spUUID=None, options=None) >Thread-55383::DEBUG::2014-05-16 18:07:43,686::taskManager::161::TaskManager::(clearTask) Entry. taskID: 6ba4f964-f6b5-4919-ab9c-3d753570c2a3 >Thread-55383::DEBUG::2014-05-16 18:07:43,687::taskManager::166::TaskManager::(clearTask) Return. >Thread-55383::INFO::2014-05-16 18:07:43,687::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-55383::DEBUG::2014-05-16 18:07:43,687::task::1168::TaskManager.Task::(prepare) Task=`9e85de0b-94d2-45e0-83f3-c4d5a2dd6e25`::finished: None >Thread-55383::DEBUG::2014-05-16 18:07:43,688::task::579::TaskManager.Task::(_updateState) Task=`9e85de0b-94d2-45e0-83f3-c4d5a2dd6e25`::moving from state preparing -> state finished >Thread-55383::DEBUG::2014-05-16 18:07:43,688::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55383::DEBUG::2014-05-16 18:07:43,688::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55383::DEBUG::2014-05-16 18:07:43,688::task::974::TaskManager.Task::(_decref) Task=`9e85de0b-94d2-45e0-83f3-c4d5a2dd6e25`::ref 0 aborting False >Thread-55384::DEBUG::2014-05-16 18:07:43,924::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55384::DEBUG::2014-05-16 18:07:43,924::task::579::TaskManager.Task::(_updateState) Task=`30369517-ed49-4166-8cad-fd75002b3a27`::moving from state init -> state preparing >Thread-55384::INFO::2014-05-16 18:07:43,924::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55384::INFO::2014-05-16 18:07:43,924::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55384::DEBUG::2014-05-16 18:07:43,925::task::1168::TaskManager.Task::(prepare) Task=`30369517-ed49-4166-8cad-fd75002b3a27`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55384::DEBUG::2014-05-16 18:07:43,925::task::579::TaskManager.Task::(_updateState) Task=`30369517-ed49-4166-8cad-fd75002b3a27`::moving from state preparing -> state finished >Thread-55384::DEBUG::2014-05-16 18:07:43,925::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55384::DEBUG::2014-05-16 18:07:43,925::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55384::DEBUG::2014-05-16 18:07:43,925::task::974::TaskManager.Task::(_decref) Task=`30369517-ed49-4166-8cad-fd75002b3a27`::ref 0 aborting False >Thread-55385::DEBUG::2014-05-16 18:07:43,941::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55385::DEBUG::2014-05-16 18:07:43,941::task::579::TaskManager.Task::(_updateState) Task=`7e3ece53-07de-4563-a822-5dbbae37b9cc`::moving from state init -> state preparing >Thread-55385::INFO::2014-05-16 18:07:43,941::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55385::DEBUG::2014-05-16 18:07:43,941::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3e056f2d-7893-4c09-ad60-5848cf9b06e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55385::DEBUG::2014-05-16 18:07:43,942::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55385::DEBUG::2014-05-16 18:07:43,942::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55385::DEBUG::2014-05-16 18:07:43,942::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3e056f2d-7893-4c09-ad60-5848cf9b06e7`::Granted request >Thread-55385::DEBUG::2014-05-16 18:07:43,942::task::811::TaskManager.Task::(resourceAcquired) Task=`7e3ece53-07de-4563-a822-5dbbae37b9cc`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55385::DEBUG::2014-05-16 18:07:43,943::task::974::TaskManager.Task::(_decref) Task=`7e3ece53-07de-4563-a822-5dbbae37b9cc`::ref 1 aborting False >Thread-55385::DEBUG::2014-05-16 18:07:43,943::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-55385::DEBUG::2014-05-16 18:07:43,944::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55385::DEBUG::2014-05-16 18:07:44,095::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55385::DEBUG::2014-05-16 18:07:44,097::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-55385::INFO::2014-05-16 18:07:44,098::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55385::DEBUG::2014-05-16 18:07:44,098::task::1168::TaskManager.Task::(prepare) Task=`7e3ece53-07de-4563-a822-5dbbae37b9cc`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55385::DEBUG::2014-05-16 18:07:44,098::task::579::TaskManager.Task::(_updateState) Task=`7e3ece53-07de-4563-a822-5dbbae37b9cc`::moving from state preparing -> state finished >Thread-55385::DEBUG::2014-05-16 18:07:44,098::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55385::DEBUG::2014-05-16 18:07:44,098::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55385::DEBUG::2014-05-16 18:07:44,099::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55385::DEBUG::2014-05-16 18:07:44,099::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55385::DEBUG::2014-05-16 18:07:44,099::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55385::DEBUG::2014-05-16 18:07:44,099::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55385::DEBUG::2014-05-16 18:07:44,099::task::974::TaskManager.Task::(_decref) Task=`7e3ece53-07de-4563-a822-5dbbae37b9cc`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:07:45,594::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:45,660::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307054 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:47,672::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:47,744::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360455 s, 28.4 MB/s\n'; <rc> = 0 >Thread-55387::DEBUG::2014-05-16 18:07:48,882::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 7735278.000000 / 8.016393 / 262500000.000000 = 0.367593 >Thread-55387::DEBUG::2014-05-16 18:07:48,883::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.11776772761554816, 'statsAge': 1.3420059680938721, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.36759332921791393, 'rxDropped': 0} >Thread-55387::DEBUG::2014-05-16 18:07:48,884::task::579::TaskManager.Task::(_updateState) Task=`678845b4-7c29-4d94-be4a-dcb34dc1dfae`::moving from state init -> state preparing >Thread-55387::INFO::2014-05-16 18:07:48,884::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55387::INFO::2014-05-16 18:07:48,884::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000763671', 'lastCheck': '9.5', 'valid': True}} >Thread-55387::DEBUG::2014-05-16 18:07:48,885::task::1168::TaskManager.Task::(prepare) Task=`678845b4-7c29-4d94-be4a-dcb34dc1dfae`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000763671', 'lastCheck': '9.5', 'valid': True}} >Thread-55387::DEBUG::2014-05-16 18:07:48,885::task::579::TaskManager.Task::(_updateState) Task=`678845b4-7c29-4d94-be4a-dcb34dc1dfae`::moving from state preparing -> state finished >Thread-55387::DEBUG::2014-05-16 18:07:48,885::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55387::DEBUG::2014-05-16 18:07:48,885::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55387::DEBUG::2014-05-16 18:07:48,885::task::974::TaskManager.Task::(_decref) Task=`678845b4-7c29-4d94-be4a-dcb34dc1dfae`::ref 0 aborting False >Thread-55389::DEBUG::2014-05-16 18:07:49,226::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [f071310] >Thread-55389::DEBUG::2014-05-16 18:07:49,227::task::579::TaskManager.Task::(_updateState) Task=`03244ae8-de56-499b-96b0-2d8b57972422`::moving from state init -> state preparing >Thread-55389::INFO::2014-05-16 18:07:49,227::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55389::DEBUG::2014-05-16 18:07:49,227::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a94e5f35-c13f-47b6-ad47-120f16500b67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55389::DEBUG::2014-05-16 18:07:49,227::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55389::DEBUG::2014-05-16 18:07:49,228::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55389::DEBUG::2014-05-16 18:07:49,228::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a94e5f35-c13f-47b6-ad47-120f16500b67`::Granted request >Thread-55389::DEBUG::2014-05-16 18:07:49,228::task::811::TaskManager.Task::(resourceAcquired) Task=`03244ae8-de56-499b-96b0-2d8b57972422`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55389::DEBUG::2014-05-16 18:07:49,228::task::974::TaskManager.Task::(_decref) Task=`03244ae8-de56-499b-96b0-2d8b57972422`::ref 1 aborting False >Thread-55389::INFO::2014-05-16 18:07:49,229::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55389::DEBUG::2014-05-16 18:07:49,229::task::1168::TaskManager.Task::(prepare) Task=`03244ae8-de56-499b-96b0-2d8b57972422`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55389::DEBUG::2014-05-16 18:07:49,229::task::579::TaskManager.Task::(_updateState) Task=`03244ae8-de56-499b-96b0-2d8b57972422`::moving from state preparing -> state finished >Thread-55389::DEBUG::2014-05-16 18:07:49,229::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55389::DEBUG::2014-05-16 18:07:49,229::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55389::DEBUG::2014-05-16 18:07:49,230::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55389::DEBUG::2014-05-16 18:07:49,230::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55389::DEBUG::2014-05-16 18:07:49,230::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55389::DEBUG::2014-05-16 18:07:49,230::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55389::DEBUG::2014-05-16 18:07:49,230::task::974::TaskManager.Task::(_decref) Task=`03244ae8-de56-499b-96b0-2d8b57972422`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:07:49,405::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:07:49,416::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000827357 s, 5.0 MB/s\n'; <rc> = 0 >Thread-55390::DEBUG::2014-05-16 18:07:49,651::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmCreate with ({'custom': {'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983device_a83f7abc-ef76-4109-9ca7-411c56f59c18device_fb2a63c2-acd5-491d-a28f-9b2f7d52f2eedevice_e691e18e-19ae-4540-9479-72e9cbc56d06': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=e691e18e-19ae-4540-9479-72e9cbc56d06, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fe': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=09b3d3d2-40c6-4239-a21e-49aa06ad35fe, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=55ac3e8c-17a4-4390-a958-0485bd6db983, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983device_a83f7abc-ef76-4109-9ca7-411c56f59c18': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=a83f7abc-ef76-4109-9ca7-411c56f59c18, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983device_a83f7abc-ef76-4109-9ca7-411c56f59c18device_fb2a63c2-acd5-491d-a28f-9b2f7d52f2ee': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=fb2a63c2-acd5-491d-a28f-9b2f7d52f2ee, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}'}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'cpuType': 'Nehalem', 'vmId': '85a2a9fa-aef6-4fef-b35f-0bf4909bcd11', 'devices': [{'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bWluZTwvQ29tcHV0ZXJOYW1lPg0KICAg\nICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1JlZ2lzdGVyZWRP\ncmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8L1JlZ2lzdGVy\nZWRPd25lcj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0i\nTWljcm9zb2Z0LVdpbmRvd3MtVW5hdHRlbmRlZEpvaW4iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0i\neDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwi\nIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29m\ndC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcv\nMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElkZW50aWZpY2F0aW9uPg0K\nICAgICAgICAgICAgICAgIDxDcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICAgICAgPERvbWFp\nbj48L0RvbWFpbj4NCiAgICAgICAgICAgICAgICAgICAgPFBhc3N3b3JkPjwvUGFzc3dvcmQ+DQog\nICAgICAgICAgICAgICAgICAgIDxVc2VybmFtZT48L1VzZXJuYW1lPg0KICAgICAgICAgICAgICAg\nIDwvQ3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgPERlYnVnSm9pbj50cnVlPC9EZWJ1Z0pv\naW4+DQogICAgICAgICAgICAgICAgPEpvaW5Eb21haW4+PC9Kb2luRG9tYWluPg0KICAgICAgICAg\nICAgPC9JZGVudGlmaWNhdGlvbj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5n\ncz4NCiAgICA8c2V0dGluZ3MgcGFzcz0ib29iZVN5c3RlbSI+DQogICAgICAgIDxjb21wb25lbnQg\nbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtSUUtQ2xpZW50TmV0d29ya1Byb3RvY29sSW1wbGVtZW50\nYXRpb24iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4\nNTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxu\nczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUi\nIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0K\nICAgICAgICAgICAgPEhLTE1Qcm94eUVuYWJsZT5mYWxzZTwvSEtMTVByb3h5RW5hYmxlPg0KICAg\nICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2lu\nZG93cy1JbnRlcm5hdGlvbmFsLUNvcmUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJs\naWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25T\nY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01J\nQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxT\nY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9j\nYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2hlbGwtU2V0\ndXAiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZh\nZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3\nY209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHht\nbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAg\nICAgICAgICAgPERpc3BsYXk+DQogICAgICAgICAgICAgICAgPENvbG9yRGVwdGg+MzI8L0NvbG9y\nRGVwdGg+DQogICAgICAgICAgICAgICAgPEhvcml6b250YWxSZXNvbHV0aW9uPjEwMjQ8L0hvcml6\nb250YWxSZXNvbHV0aW9uPg0KICAgICAgICAgICAgICAgIDxSZWZyZXNoUmF0ZT43NTwvUmVmcmVz\naFJhdGU+DQogICAgICAgICAgICAgICAgPFZlcnRpY2FsUmVzb2x1dGlvbj43Njg8L1ZlcnRpY2Fs\nUmVzb2x1dGlvbj4NCiAgICAgICAgICAgIDwvRGlzcGxheT4NCiAgICAgICAgICAgIDxPT0JFPg0K\nICAgICAgICAgICAgICAgIDxIaWRlRVVMQVBhZ2U+dHJ1ZTwvSGlkZUVVTEFQYWdlPg0KICAgICAg\nICAgICAgICAgIDxTa2lwVXNlck9PQkU+dHJ1ZTwvU2tpcFVzZXJPT0JFPg0KICAgICAgICAgICAg\nPC9PT0JFPg0KICAgICAgICAgICAgPFVzZXJBY2NvdW50cz4NCiAgICAgICAgICAgICAgICA8QWRt\naW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgICAgICAgICA8VmFsdWU+PC9WYWx1ZT4N\nCiAgICAgICAgICAgICAgICAgICAgPFBsYWluVGV4dD50cnVlPC9QbGFpblRleHQ+DQogICAgICAg\nICAgICAgICAgPC9BZG1pbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICA8L1VzZXJBY2Nv\ndW50cz4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9S\nZWdpc3RlcmVkT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2Vy\nPC9SZWdpc3RlcmVkT3duZXI+DQogICAgICAgICAgICA8VGltZVpvbmU+ODU8L1RpbWVab25lPg0K\nICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxzZXR0aW5ncyBwYXNz\nPSJ3aW5kb3dzUEUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLUludGVybmF0aW9uYWwtQ29yZS1XaW5QRSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1\nYmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lv\nblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9X\nTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hN\nTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8U2V0dXBVSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAgICAgICAgPC9T\nZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4N\nCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxvY2FsZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TZXR1cCIgcHJv\nY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1\nIiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0\ncDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNp\nPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAg\nICA8VXNlckRhdGE+DQogICAgICAgICAgICAgICAgPFByb2R1Y3RLZXk+DQogICAgICAgICAgICAg\nICAgICAgIDxLZXk+PC9LZXk+DQogICAgICAgICAgICAgICAgICAgIDxXaWxsU2hvd1VJPk5ldmVy\nPC9XaWxsU2hvd1VJPg0KICAgICAgICAgICAgICAgIDwvUHJvZHVjdEtleT4NCiAgICAgICAgICAg\nICAgICA8QWNjZXB0RXVsYT50cnVlPC9BY2NlcHRFdWxhPg0KICAgICAgICAgICAgICAgIDxPcmdh\nbml6YXRpb24+YXdheWZhci5vcmc8L09yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgICAgICA8RnVs\nbE5hbWU+VXNlcjwvRnVsbE5hbWU+DQogICAgICAgICAgICA8L1VzZXJEYXRhPg0KICAgICAgICA8\nL2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxjcGk6b2ZmbGluZUltYWdlIGNwaTpz\nb3VyY2U9ImNhdGFsb2c6Ly9jYXRhbG9ncy93aW5kb3dzMjAwOC14ODYvc291cmNlcy9pbnN0YWxs\nX3dpbmRvd3MgbG9uZ2hvcm4gc2VydmVyZW50ZXJwcmlzZS5jbGciIHhtbG5zOmNwaT0idXJuOnNj\naGVtYXMtbWljcm9zb2Z0LWNvbTpjcGkiIC8+DQo8L3VuYXR0ZW5kPg0K\n'}}}, 'readonly': 'true', 'deviceId': '3b145dba-675d-4f8f-bcb4-f72d5d4a852d', 'path': '', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': 'edaf2841-b832-45ba-8d26-5a6aae2f7dce'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': 'ef63a8d0-80ea-43c8-bc21-5c2249eb943a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'volumeID': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 'specParams': {}, 'readonly': 'false', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'optional': 'false', 'deviceId': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:64:b5:a3', 'linkActive': 'true', 'network': 'secondary', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '1b0975af-78d0-4b38-a144-d223998fc38a', 'device': 'bridge', 'type': 'interface'}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': '1b244f92-1f3b-4f23-b27d-1aa2ba9bd176'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'f2ae9463-1c4d-4618-aa89-ad97ba519c50'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '86fe2201-d35b-445b-9ff3-37bb6e0741d6'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '6d83f065-7782-45cf-bd71-15678baa5569'}, {'specParams': {}, 'deviceId': '85951021-c0fc-4a16-8e3d-c8e3aa0c7057', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '2', 'vmType': 'kvm', 'smartcardEnable': 'true', 'timeOffset': '3600', 'memSize': 2048, 'spiceSslCipherSuite': 'DEFAULT', 'smpCoresPerSocket': '1', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'memGuaranteedSize': 1024, 'vmName': 'mine', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} flowID [f071310] >Thread-55390::INFO::2014-05-16 18:07:49,661::API::648::vds::(_getNetworkIp) network None: using 0 >Thread-55390::INFO::2014-05-16 18:07:49,661::clientIF::394::vds::(createVm) vmContainerLock acquired by vm 85a2a9fa-aef6-4fef-b35f-0bf4909bcd11 >Thread-55390::DEBUG::2014-05-16 18:07:49,665::clientIF::407::vds::(createVm) Total desktops after creation of 85a2a9fa-aef6-4fef-b35f-0bf4909bcd11 is 1 >Thread-55391::DEBUG::2014-05-16 18:07:49,665::vm::2156::vm.Vm::(_startUnderlyingVm) vmId=`85a2a9fa-aef6-4fef-b35f-0bf4909bcd11`::Start >Thread-55390::DEBUG::2014-05-16 18:07:49,666::BindingXMLRPC::982::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '85a2a9fa-aef6-4fef-b35f-0bf4909bcd11', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983device_a83f7abc-ef76-4109-9ca7-411c56f59c18device_fb2a63c2-acd5-491d-a28f-9b2f7d52f2eedevice_e691e18e-19ae-4540-9479-72e9cbc56d06': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=e691e18e-19ae-4540-9479-72e9cbc56d06, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fe': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=09b3d3d2-40c6-4239-a21e-49aa06ad35fe, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=55ac3e8c-17a4-4390-a958-0485bd6db983, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983device_a83f7abc-ef76-4109-9ca7-411c56f59c18': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=a83f7abc-ef76-4109-9ca7-411c56f59c18, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983device_a83f7abc-ef76-4109-9ca7-411c56f59c18device_fb2a63c2-acd5-491d-a28f-9b2f7d52f2ee': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=fb2a63c2-acd5-491d-a28f-9b2f7d52f2ee, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bWluZTwvQ29tcHV0ZXJOYW1lPg0KICAg\nICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1JlZ2lzdGVyZWRP\ncmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8L1JlZ2lzdGVy\nZWRPd25lcj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0i\nTWljcm9zb2Z0LVdpbmRvd3MtVW5hdHRlbmRlZEpvaW4iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0i\neDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwi\nIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29m\ndC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcv\nMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElkZW50aWZpY2F0aW9uPg0K\nICAgICAgICAgICAgICAgIDxDcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICAgICAgPERvbWFp\nbj48L0RvbWFpbj4NCiAgICAgICAgICAgICAgICAgICAgPFBhc3N3b3JkPjwvUGFzc3dvcmQ+DQog\nICAgICAgICAgICAgICAgICAgIDxVc2VybmFtZT48L1VzZXJuYW1lPg0KICAgICAgICAgICAgICAg\nIDwvQ3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgPERlYnVnSm9pbj50cnVlPC9EZWJ1Z0pv\naW4+DQogICAgICAgICAgICAgICAgPEpvaW5Eb21haW4+PC9Kb2luRG9tYWluPg0KICAgICAgICAg\nICAgPC9JZGVudGlmaWNhdGlvbj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5n\ncz4NCiAgICA8c2V0dGluZ3MgcGFzcz0ib29iZVN5c3RlbSI+DQogICAgICAgIDxjb21wb25lbnQg\nbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtSUUtQ2xpZW50TmV0d29ya1Byb3RvY29sSW1wbGVtZW50\nYXRpb24iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4\nNTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxu\nczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUi\nIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0K\nICAgICAgICAgICAgPEhLTE1Qcm94eUVuYWJsZT5mYWxzZTwvSEtMTVByb3h5RW5hYmxlPg0KICAg\nICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2lu\nZG93cy1JbnRlcm5hdGlvbmFsLUNvcmUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJs\naWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25T\nY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01J\nQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxT\nY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9j\nYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2hlbGwtU2V0\ndXAiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZh\nZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3\nY209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHht\nbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAg\nICAgICAgICAgPERpc3BsYXk+DQogICAgICAgICAgICAgICAgPENvbG9yRGVwdGg+MzI8L0NvbG9y\nRGVwdGg+DQogICAgICAgICAgICAgICAgPEhvcml6b250YWxSZXNvbHV0aW9uPjEwMjQ8L0hvcml6\nb250YWxSZXNvbHV0aW9uPg0KICAgICAgICAgICAgICAgIDxSZWZyZXNoUmF0ZT43NTwvUmVmcmVz\naFJhdGU+DQogICAgICAgICAgICAgICAgPFZlcnRpY2FsUmVzb2x1dGlvbj43Njg8L1ZlcnRpY2Fs\nUmVzb2x1dGlvbj4NCiAgICAgICAgICAgIDwvRGlzcGxheT4NCiAgICAgICAgICAgIDxPT0JFPg0K\nICAgICAgICAgICAgICAgIDxIaWRlRVVMQVBhZ2U+dHJ1ZTwvSGlkZUVVTEFQYWdlPg0KICAgICAg\nICAgICAgICAgIDxTa2lwVXNlck9PQkU+dHJ1ZTwvU2tpcFVzZXJPT0JFPg0KICAgICAgICAgICAg\nPC9PT0JFPg0KICAgICAgICAgICAgPFVzZXJBY2NvdW50cz4NCiAgICAgICAgICAgICAgICA8QWRt\naW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgICAgICAgICA8VmFsdWU+PC9WYWx1ZT4N\nCiAgICAgICAgICAgICAgICAgICAgPFBsYWluVGV4dD50cnVlPC9QbGFpblRleHQ+DQogICAgICAg\nICAgICAgICAgPC9BZG1pbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICA8L1VzZXJBY2Nv\ndW50cz4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9S\nZWdpc3RlcmVkT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2Vy\nPC9SZWdpc3RlcmVkT3duZXI+DQogICAgICAgICAgICA8VGltZVpvbmU+ODU8L1RpbWVab25lPg0K\nICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxzZXR0aW5ncyBwYXNz\nPSJ3aW5kb3dzUEUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLUludGVybmF0aW9uYWwtQ29yZS1XaW5QRSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1\nYmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lv\nblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9X\nTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hN\nTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8U2V0dXBVSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAgICAgICAgPC9T\nZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4N\nCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxvY2FsZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TZXR1cCIgcHJv\nY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1\nIiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0\ncDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNp\nPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAg\nICA8VXNlckRhdGE+DQogICAgICAgICAgICAgICAgPFByb2R1Y3RLZXk+DQogICAgICAgICAgICAg\nICAgICAgIDxLZXk+PC9LZXk+DQogICAgICAgICAgICAgICAgICAgIDxXaWxsU2hvd1VJPk5ldmVy\nPC9XaWxsU2hvd1VJPg0KICAgICAgICAgICAgICAgIDwvUHJvZHVjdEtleT4NCiAgICAgICAgICAg\nICAgICA8QWNjZXB0RXVsYT50cnVlPC9BY2NlcHRFdWxhPg0KICAgICAgICAgICAgICAgIDxPcmdh\nbml6YXRpb24+YXdheWZhci5vcmc8L09yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgICAgICA8RnVs\nbE5hbWU+VXNlcjwvRnVsbE5hbWU+DQogICAgICAgICAgICA8L1VzZXJEYXRhPg0KICAgICAgICA8\nL2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxjcGk6b2ZmbGluZUltYWdlIGNwaTpz\nb3VyY2U9ImNhdGFsb2c6Ly9jYXRhbG9ncy93aW5kb3dzMjAwOC14ODYvc291cmNlcy9pbnN0YWxs\nX3dpbmRvd3MgbG9uZ2hvcm4gc2VydmVyZW50ZXJwcmlzZS5jbGciIHhtbG5zOmNwaT0idXJuOnNj\naGVtYXMtbWljcm9zb2Z0LWNvbTpjcGkiIC8+DQo8L3VuYXR0ZW5kPg0K\n'}}}, 'readonly': 'true', 'deviceId': '3b145dba-675d-4f8f-bcb4-f72d5d4a852d', 'path': '', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': 'edaf2841-b832-45ba-8d26-5a6aae2f7dce'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': 'ef63a8d0-80ea-43c8-bc21-5c2249eb943a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'volumeID': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 'specParams': {}, 'readonly': 'false', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'optional': 'false', 'deviceId': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:64:b5:a3', 'linkActive': 'true', 'network': 'secondary', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '1b0975af-78d0-4b38-a144-d223998fc38a', 'device': 'bridge', 'type': 'interface'}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': '1b244f92-1f3b-4f23-b27d-1aa2ba9bd176'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'f2ae9463-1c4d-4618-aa89-ad97ba519c50'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '86fe2201-d35b-445b-9ff3-37bb6e0741d6'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '6d83f065-7782-45cf-bd71-15678baa5569'}, {'specParams': {}, 'deviceId': '85951021-c0fc-4a16-8e3d-c8e3aa0c7057', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'mine', 'display': 'qxl', 'nice': '0'}} >Thread-55391::DEBUG::2014-05-16 18:07:49,667::vm::2160::vm.Vm::(_startUnderlyingVm) vmId=`85a2a9fa-aef6-4fef-b35f-0bf4909bcd11`::_ongoingCreations acquired >Thread-55391::INFO::2014-05-16 18:07:49,668::vm::3011::vm.Vm::(_run) vmId=`85a2a9fa-aef6-4fef-b35f-0bf4909bcd11`::VM wrapper has started >Thread-55391::DEBUG::2014-05-16 18:07:49,670::task::579::TaskManager.Task::(_updateState) Task=`57193e6d-348f-4fcd-a1e5-01a644434693`::moving from state init -> state preparing >Thread-55391::INFO::2014-05-16 18:07:49,671::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='f6a961b4-d81e-4aea-97bf-5bf83cf62b26', volUUID='330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', options=None) >Thread-55391::INFO::2014-05-16 18:07:49,673::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55391::DEBUG::2014-05-16 18:07:49,674::task::1168::TaskManager.Task::(prepare) Task=`57193e6d-348f-4fcd-a1e5-01a644434693`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55391::DEBUG::2014-05-16 18:07:49,675::task::579::TaskManager.Task::(_updateState) Task=`57193e6d-348f-4fcd-a1e5-01a644434693`::moving from state preparing -> state finished >Thread-55391::DEBUG::2014-05-16 18:07:49,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55391::DEBUG::2014-05-16 18:07:49,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55391::DEBUG::2014-05-16 18:07:49,677::task::974::TaskManager.Task::(_decref) Task=`57193e6d-348f-4fcd-a1e5-01a644434693`::ref 0 aborting False >Thread-55391::INFO::2014-05-16 18:07:49,744::clientIF::353::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/85a2a9fa-aef6-4fef-b35f-0bf4909bcd11.9ec880a57d83e1facafbff681ef9383b.img >Thread-55391::INFO::2014-05-16 18:07:49,745::clientIF::353::vds::(prepareVolumePath) prepared volume path: >Thread-55391::DEBUG::2014-05-16 18:07:49,746::task::579::TaskManager.Task::(_updateState) Task=`f331df34-1dbb-4975-9416-0b43960bea31`::moving from state init -> state preparing >Thread-55391::INFO::2014-05-16 18:07:49,746::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='f6a961b4-d81e-4aea-97bf-5bf83cf62b26', leafUUID='330b9d95-7458-42ca-b1ae-4a6ac1e9c73c') >Thread-55391::DEBUG::2014-05-16 18:07:49,746::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`780ef60b-3984-4aea-bc5f-2bdce488891a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage' >Thread-55391::DEBUG::2014-05-16 18:07:49,746::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55391::DEBUG::2014-05-16 18:07:49,747::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55391::DEBUG::2014-05-16 18:07:49,747::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`780ef60b-3984-4aea-bc5f-2bdce488891a`::Granted request >Thread-55391::DEBUG::2014-05-16 18:07:49,747::task::811::TaskManager.Task::(resourceAcquired) Task=`f331df34-1dbb-4975-9416-0b43960bea31`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55391::DEBUG::2014-05-16 18:07:49,747::task::974::TaskManager.Task::(_decref) Task=`f331df34-1dbb-4975-9416-0b43960bea31`::ref 1 aborting False >Thread-55391::DEBUG::2014-05-16 18:07:49,748::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55391::DEBUG::2014-05-16 18:07:49,748::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:49,757::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:49,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421213 s, 24.3 MB/s\n'; <rc> = 0 >Thread-55391::DEBUG::2014-05-16 18:07:49,917::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55391::DEBUG::2014-05-16 18:07:49,932::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55391::DEBUG::2014-05-16 18:07:49,932::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55391::DEBUG::2014-05-16 18:07:49,933::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y f79908bf-a757-4a71-9ab5-3a12ede5f65c/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca' (cwd None) >Thread-55391::DEBUG::2014-05-16 18:07:50,153::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55391::DEBUG::2014-05-16 18:07:50,154::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55391::DEBUG::2014-05-16 18:07:50,154::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55391::DEBUG::2014-05-16 18:07:50,155::blockSD::1039::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26 >Thread-55391::DEBUG::2014-05-16 18:07:50,156::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55391::DEBUG::2014-05-16 18:07:50,156::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55391::DEBUG::2014-05-16 18:07:50,303::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55391::DEBUG::2014-05-16 18:07:50,318::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55391::DEBUG::2014-05-16 18:07:50,318::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55391::INFO::2014-05-16 18:07:50,319::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'volumeID': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26'}, 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'imgVolumesInfo': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'volumeID': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26'}]} >Thread-55391::DEBUG::2014-05-16 18:07:50,319::task::1168::TaskManager.Task::(prepare) Task=`f331df34-1dbb-4975-9416-0b43960bea31`::finished: {'info': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'volumeID': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26'}, 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'imgVolumesInfo': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'volumeID': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26'}]} >Thread-55391::DEBUG::2014-05-16 18:07:50,319::task::579::TaskManager.Task::(_updateState) Task=`f331df34-1dbb-4975-9416-0b43960bea31`::moving from state preparing -> state finished >Thread-55391::DEBUG::2014-05-16 18:07:50,319::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55391::DEBUG::2014-05-16 18:07:50,320::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55391::DEBUG::2014-05-16 18:07:50,320::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55391::DEBUG::2014-05-16 18:07:50,320::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55391::DEBUG::2014-05-16 18:07:50,320::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55391::DEBUG::2014-05-16 18:07:50,320::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55391::DEBUG::2014-05-16 18:07:50,321::task::974::TaskManager.Task::(_decref) Task=`f331df34-1dbb-4975-9416-0b43960bea31`::ref 0 aborting False >Thread-55391::INFO::2014-05-16 18:07:50,321::clientIF::353::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c >Thread-55391::DEBUG::2014-05-16 18:07:50,336::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-55391::DEBUG::2014-05-16 18:07:50,408::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55391::INFO::2014-05-16 18:07:50,408::hooks::100::root::(_runHooksDir) >Thread-55391::DEBUG::2014-05-16 18:07:50,408::vm::3073::vm.Vm::(_run) vmId=`85a2a9fa-aef6-4fef-b35f-0bf4909bcd11`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>mine</name> > <uuid>85a2a9fa-aef6-4fef-b35f-0bf4909bcd11</uuid> > <memory>2097152</memory> > <currentMemory>2097152</currentMemory> > <vcpu>2</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/85a2a9fa-aef6-4fef-b35f-0bf4909bcd11.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/85a2a9fa-aef6-4fef-b35f-0bf4909bcd11.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <smartcard mode="passthrough" type="spicevmc"/> > <smartcard mode="passthrough" type="spicevmc"/> > <controller model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" type="qxl" vram="32768"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:64:b5:a3"/> > <model type="virtio"/> > <source bridge="secondary"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > </interface> > <disk device="floppy" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/85a2a9fa-aef6-4fef-b35f-0bf4909bcd11.9ec880a57d83e1facafbff681ef9383b.img" startupPolicy="optional"/> > <target bus="fdc" dev="fda"/> > <readonly/> > <serial/> > <readonly/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c"/> > <target bus="virtio" dev="vda"/> > <serial>f6a961b4-d81e-4aea-97bf-5bf83cf62b26</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > <sound model="ich6"/> > <memballoon model="virtio"/> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140407.0.el6ev</entry> > <entry name="serial">44454C4C-3500-1054-8036-C6C04F5A5131</entry> > <entry name="uuid">85a2a9fa-aef6-4fef-b35f-0bf4909bcd11</entry> > </system> > </sysinfo> > <clock adjustment="3600" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Nehalem</model> > <topology cores="1" sockets="2" threads="1"/> > </cpu> ></domain> > >Thread-55391::DEBUG::2014-05-16 18:07:50,773::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 33 level: 2 message: internal error ifname "vnet0" not in key map >Thread-55391::DEBUG::2014-05-16 18:07:50,773::vm::2177::vm.Vm::(_startUnderlyingVm) vmId=`85a2a9fa-aef6-4fef-b35f-0bf4909bcd11`::_ongoingCreations released >Thread-55391::ERROR::2014-05-16 18:07:50,773::vm::2203::vm.Vm::(_startUnderlyingVm) vmId=`85a2a9fa-aef6-4fef-b35f-0bf4909bcd11`::The vm start process failed >Traceback (most recent call last): > File "/usr/share/vdsm/vm.py", line 2163, in _startUnderlyingVm > File "/usr/share/vdsm/vm.py", line 3107, in _run > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 2665, in createXML >libvirtError: internal error ifname "vnet0" not in key map >Thread-55391::DEBUG::2014-05-16 18:07:50,778::vm::2657::vm.Vm::(setDownStatus) vmId=`85a2a9fa-aef6-4fef-b35f-0bf4909bcd11`::Changed state to Down: internal error ifname "vnet0" not in key map >Dummy-51::DEBUG::2014-05-16 18:07:51,852::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:51,918::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300169 s, 34.1 MB/s\n'; <rc> = 0 >Thread-55394::DEBUG::2014-05-16 18:07:52,097::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('85a2a9fa-aef6-4fef-b35f-0bf4909bcd11',) {} >Thread-55394::DEBUG::2014-05-16 18:07:52,097::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Down', 'hash': '0', 'exitMessage': 'internal error ifname "vnet0" not in key map', 'vmId': '85a2a9fa-aef6-4fef-b35f-0bf4909bcd11', 'timeOffset': '3600', 'exitCode': 1}]} >Thread-55395::DEBUG::2014-05-16 18:07:52,141::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmDestroy with ('85a2a9fa-aef6-4fef-b35f-0bf4909bcd11',) {} >Thread-55395::INFO::2014-05-16 18:07:52,141::API::324::vds::(destroy) vmContainerLock acquired by vm 85a2a9fa-aef6-4fef-b35f-0bf4909bcd11 >Thread-55395::DEBUG::2014-05-16 18:07:52,141::vm::4533::vm.Vm::(destroy) vmId=`85a2a9fa-aef6-4fef-b35f-0bf4909bcd11`::destroy Called >Thread-55395::INFO::2014-05-16 18:07:52,146::vm::4479::vm.Vm::(releaseVm) vmId=`85a2a9fa-aef6-4fef-b35f-0bf4909bcd11`::Release VM resources >Thread-55395::WARNING::2014-05-16 18:07:52,146::vm::1851::vm.Vm::(_set_lastStatus) vmId=`85a2a9fa-aef6-4fef-b35f-0bf4909bcd11`::trying to set state to Powering down when already Down >Thread-55395::WARNING::2014-05-16 18:07:52,146::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7ff538405890>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7ff538405890>> _deviceXML:<disk device="floppy" snapshot="no" type="file"><source file="/var/run/vdsm/payload/85a2a9fa-aef6-4fef-b35f-0bf4909bcd11.9ec880a57d83e1facafbff681ef9383b.img" startupPolicy="optional"/><target bus="fdc" dev="fda"/><readonly/><serial></serial><readonly/></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7ff538405890>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7ff538405890>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7ff538405890>> apparentsize:0 blockDev:False cache:none conf:{'status': 'Down', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '85a2a9fa-aef6-4fef-b35f-0bf4909bcd11', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983device_a83f7abc-ef76-4109-9ca7-411c56f59c18device_fb2a63c2-acd5-491d-a28f-9b2f7d52f2eedevice_e691e18e-19ae-4540-9479-72e9cbc56d06': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=e691e18e-19ae-4540-9479-72e9cbc56d06, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fe': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=09b3d3d2-40c6-4239-a21e-49aa06ad35fe, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=55ac3e8c-17a4-4390-a958-0485bd6db983, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983device_a83f7abc-ef76-4109-9ca7-411c56f59c18': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=a83f7abc-ef76-4109-9ca7-411c56f59c18, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983device_a83f7abc-ef76-4109-9ca7-411c56f59c18device_fb2a63c2-acd5-491d-a28f-9b2f7d52f2ee': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=fb2a63c2-acd5-491d-a28f-9b2f7d52f2ee, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'exitCode': 1, 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'exitMessage': 'internal error ifname "vnet0" not in key map', 'transparentHugePages': 'true', 'devices': [{'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'f2ae9463-1c4d-4618-aa89-ad97ba519c50'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '86fe2201-d35b-445b-9ff3-37bb6e0741d6'}, {'specParams': {}, 'deviceId': '85951021-c0fc-4a16-8e3d-c8e3aa0c7057', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': 'edaf2841-b832-45ba-8d26-5a6aae2f7dce'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:64:b5:a3', 'linkActive': 'true', 'network': 'secondary', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '1b0975af-78d0-4b38-a144-d223998fc38a', 'device': 'bridge', 'type': 'interface'}, {'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bWluZTwvQ29tcHV0ZXJOYW1lPg0KICAg\nICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1JlZ2lzdGVyZWRP\ncmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8L1JlZ2lzdGVy\nZWRPd25lcj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0i\nTWljcm9zb2Z0LVdpbmRvd3MtVW5hdHRlbmRlZEpvaW4iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0i\neDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwi\nIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29m\ndC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcv\nMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElkZW50aWZpY2F0aW9uPg0K\nICAgICAgICAgICAgICAgIDxDcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICAgICAgPERvbWFp\nbj48L0RvbWFpbj4NCiAgICAgICAgICAgICAgICAgICAgPFBhc3N3b3JkPjwvUGFzc3dvcmQ+DQog\nICAgICAgICAgICAgICAgICAgIDxVc2VybmFtZT48L1VzZXJuYW1lPg0KICAgICAgICAgICAgICAg\nIDwvQ3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgPERlYnVnSm9pbj50cnVlPC9EZWJ1Z0pv\naW4+DQogICAgICAgICAgICAgICAgPEpvaW5Eb21haW4+PC9Kb2luRG9tYWluPg0KICAgICAgICAg\nICAgPC9JZGVudGlmaWNhdGlvbj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5n\ncz4NCiAgICA8c2V0dGluZ3MgcGFzcz0ib29iZVN5c3RlbSI+DQogICAgICAgIDxjb21wb25lbnQg\nbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtSUUtQ2xpZW50TmV0d29ya1Byb3RvY29sSW1wbGVtZW50\nYXRpb24iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4\nNTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxu\nczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUi\nIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0K\nICAgICAgICAgICAgPEhLTE1Qcm94eUVuYWJsZT5mYWxzZTwvSEtMTVByb3h5RW5hYmxlPg0KICAg\nICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2lu\nZG93cy1JbnRlcm5hdGlvbmFsLUNvcmUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJs\naWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25T\nY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01J\nQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxT\nY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9j\nYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2hlbGwtU2V0\ndXAiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZh\nZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3\nY209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHht\nbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAg\nICAgICAgICAgPERpc3BsYXk+DQogICAgICAgICAgICAgICAgPENvbG9yRGVwdGg+MzI8L0NvbG9y\nRGVwdGg+DQogICAgICAgICAgICAgICAgPEhvcml6b250YWxSZXNvbHV0aW9uPjEwMjQ8L0hvcml6\nb250YWxSZXNvbHV0aW9uPg0KICAgICAgICAgICAgICAgIDxSZWZyZXNoUmF0ZT43NTwvUmVmcmVz\naFJhdGU+DQogICAgICAgICAgICAgICAgPFZlcnRpY2FsUmVzb2x1dGlvbj43Njg8L1ZlcnRpY2Fs\nUmVzb2x1dGlvbj4NCiAgICAgICAgICAgIDwvRGlzcGxheT4NCiAgICAgICAgICAgIDxPT0JFPg0K\nICAgICAgICAgICAgICAgIDxIaWRlRVVMQVBhZ2U+dHJ1ZTwvSGlkZUVVTEFQYWdlPg0KICAgICAg\nICAgICAgICAgIDxTa2lwVXNlck9PQkU+dHJ1ZTwvU2tpcFVzZXJPT0JFPg0KICAgICAgICAgICAg\nPC9PT0JFPg0KICAgICAgICAgICAgPFVzZXJBY2NvdW50cz4NCiAgICAgICAgICAgICAgICA8QWRt\naW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgICAgICAgICA8VmFsdWU+PC9WYWx1ZT4N\nCiAgICAgICAgICAgICAgICAgICAgPFBsYWluVGV4dD50cnVlPC9QbGFpblRleHQ+DQogICAgICAg\nICAgICAgICAgPC9BZG1pbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICA8L1VzZXJBY2Nv\ndW50cz4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9S\nZWdpc3RlcmVkT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2Vy\nPC9SZWdpc3RlcmVkT3duZXI+DQogICAgICAgICAgICA8VGltZVpvbmU+ODU8L1RpbWVab25lPg0K\nICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxzZXR0aW5ncyBwYXNz\nPSJ3aW5kb3dzUEUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLUludGVybmF0aW9uYWwtQ29yZS1XaW5QRSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1\nYmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lv\nblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9X\nTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hN\nTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8U2V0dXBVSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAgICAgICAgPC9T\nZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4N\nCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxvY2FsZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TZXR1cCIgcHJv\nY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1\nIiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0\ncDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNp\nPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAg\nICA8VXNlckRhdGE+DQogICAgICAgICAgICAgICAgPFByb2R1Y3RLZXk+DQogICAgICAgICAgICAg\nICAgICAgIDxLZXk+PC9LZXk+DQogICAgICAgICAgICAgICAgICAgIDxXaWxsU2hvd1VJPk5ldmVy\nPC9XaWxsU2hvd1VJPg0KICAgICAgICAgICAgICAgIDwvUHJvZHVjdEtleT4NCiAgICAgICAgICAg\nICAgICA8QWNjZXB0RXVsYT50cnVlPC9BY2NlcHRFdWxhPg0KICAgICAgICAgICAgICAgIDxPcmdh\nbml6YXRpb24+YXdheWZhci5vcmc8L09yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgICAgICA8RnVs\nbE5hbWU+VXNlcjwvRnVsbE5hbWU+DQogICAgICAgICAgICA8L1VzZXJEYXRhPg0KICAgICAgICA8\nL2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxjcGk6b2ZmbGluZUltYWdlIGNwaTpz\nb3VyY2U9ImNhdGFsb2c6Ly9jYXRhbG9ncy93aW5kb3dzMjAwOC14ODYvc291cmNlcy9pbnN0YWxs\nX3dpbmRvd3MgbG9uZ2hvcm4gc2VydmVyZW50ZXJwcmlzZS5jbGciIHhtbG5zOmNwaT0idXJuOnNj\naGVtYXMtbWljcm9zb2Z0LWNvbTpjcGkiIC8+DQo8L3VuYXR0ZW5kPg0K\n'}}}, 'readonly': 'true', 'deviceId': '3b145dba-675d-4f8f-bcb4-f72d5d4a852d', 'path': '/var/run/vdsm/payload/85a2a9fa-aef6-4fef-b35f-0bf4909bcd11.9ec880a57d83e1facafbff681ef9383b.img', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': 'ef63a8d0-80ea-43c8-bc21-5c2249eb943a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'volumeInfo': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'volumeID': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 'readonly': 'false', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'reqsize': '0', 'format': 'cow', 'deviceId': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'propagateErrors': 'off', 'optional': 'false', 'bootOrder': '1', 'volumeID': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'specParams': {}, 'volumeChain': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'volumeID': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26'}]}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': '1b244f92-1f3b-4f23-b27d-1aa2ba9bd176'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '6d83f065-7782-45cf-bd71-15678baa5569', 'target': 2097152}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'mine', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7ff538405890>> device:floppy deviceId:3b145dba-675d-4f8f-bcb4-f72d5d4a852d extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7ff538405890>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7ff538405890>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7ff538405890>> hasVolumeLeases:False iface:fdc index:0 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7ff538405890>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7ff538405890>> log:<logUtils.SimpleLogAdapter instance at 0x7ff5600361b8> name:fda networkDev:False path:/var/run/vdsm/payload/85a2a9fa-aef6-4fef-b35f-0bf4909bcd11.9ec880a57d83e1facafbff681ef9383b.img readonly:true reqsize:0 serial: shared:false specParams:{'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bWluZTwvQ29tcHV0ZXJOYW1lPg0KICAg\nICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1JlZ2lzdGVyZWRP\ncmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8L1JlZ2lzdGVy\nZWRPd25lcj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0i\nTWljcm9zb2Z0LVdpbmRvd3MtVW5hdHRlbmRlZEpvaW4iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0i\neDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwi\nIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29m\ndC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcv\nMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElkZW50aWZpY2F0aW9uPg0K\nICAgICAgICAgICAgICAgIDxDcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICAgICAgPERvbWFp\nbj48L0RvbWFpbj4NCiAgICAgICAgICAgICAgICAgICAgPFBhc3N3b3JkPjwvUGFzc3dvcmQ+DQog\nICAgICAgICAgICAgICAgICAgIDxVc2VybmFtZT48L1VzZXJuYW1lPg0KICAgICAgICAgICAgICAg\nIDwvQ3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgPERlYnVnSm9pbj50cnVlPC9EZWJ1Z0pv\naW4+DQogICAgICAgICAgICAgICAgPEpvaW5Eb21haW4+PC9Kb2luRG9tYWluPg0KICAgICAgICAg\nICAgPC9JZGVudGlmaWNhdGlvbj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5n\ncz4NCiAgICA8c2V0dGluZ3MgcGFzcz0ib29iZVN5c3RlbSI+DQogICAgICAgIDxjb21wb25lbnQg\nbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtSUUtQ2xpZW50TmV0d29ya1Byb3RvY29sSW1wbGVtZW50\nYXRpb24iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4\nNTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxu\nczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUi\nIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0K\nICAgICAgICAgICAgPEhLTE1Qcm94eUVuYWJsZT5mYWxzZTwvSEtMTVByb3h5RW5hYmxlPg0KICAg\nICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2lu\nZG93cy1JbnRlcm5hdGlvbmFsLUNvcmUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJs\naWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25T\nY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01J\nQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxT\nY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9j\nYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2hlbGwtU2V0\ndXAiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZh\nZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3\nY209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHht\nbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAg\nICAgICAgICAgPERpc3BsYXk+DQogICAgICAgICAgICAgICAgPENvbG9yRGVwdGg+MzI8L0NvbG9y\nRGVwdGg+DQogICAgICAgICAgICAgICAgPEhvcml6b250YWxSZXNvbHV0aW9uPjEwMjQ8L0hvcml6\nb250YWxSZXNvbHV0aW9uPg0KICAgICAgICAgICAgICAgIDxSZWZyZXNoUmF0ZT43NTwvUmVmcmVz\naFJhdGU+DQogICAgICAgICAgICAgICAgPFZlcnRpY2FsUmVzb2x1dGlvbj43Njg8L1ZlcnRpY2Fs\nUmVzb2x1dGlvbj4NCiAgICAgICAgICAgIDwvRGlzcGxheT4NCiAgICAgICAgICAgIDxPT0JFPg0K\nICAgICAgICAgICAgICAgIDxIaWRlRVVMQVBhZ2U+dHJ1ZTwvSGlkZUVVTEFQYWdlPg0KICAgICAg\nICAgICAgICAgIDxTa2lwVXNlck9PQkU+dHJ1ZTwvU2tpcFVzZXJPT0JFPg0KICAgICAgICAgICAg\nPC9PT0JFPg0KICAgICAgICAgICAgPFVzZXJBY2NvdW50cz4NCiAgICAgICAgICAgICAgICA8QWRt\naW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgICAgICAgICA8VmFsdWU+PC9WYWx1ZT4N\nCiAgICAgICAgICAgICAgICAgICAgPFBsYWluVGV4dD50cnVlPC9QbGFpblRleHQ+DQogICAgICAg\nICAgICAgICAgPC9BZG1pbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICA8L1VzZXJBY2Nv\ndW50cz4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9S\nZWdpc3RlcmVkT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2Vy\nPC9SZWdpc3RlcmVkT3duZXI+DQogICAgICAgICAgICA8VGltZVpvbmU+ODU8L1RpbWVab25lPg0K\nICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxzZXR0aW5ncyBwYXNz\nPSJ3aW5kb3dzUEUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLUludGVybmF0aW9uYWwtQ29yZS1XaW5QRSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1\nYmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lv\nblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9X\nTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hN\nTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8U2V0dXBVSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAgICAgICAgPC9T\nZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4N\nCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxvY2FsZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TZXR1cCIgcHJv\nY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1\nIiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0\ncDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNp\nPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAg\nICA8VXNlckRhdGE+DQogICAgICAgICAgICAgICAgPFByb2R1Y3RLZXk+DQogICAgICAgICAgICAg\nICAgICAgIDxLZXk+PC9LZXk+DQogICAgICAgICAgICAgICAgICAgIDxXaWxsU2hvd1VJPk5ldmVy\nPC9XaWxsU2hvd1VJPg0KICAgICAgICAgICAgICAgIDwvUHJvZHVjdEtleT4NCiAgICAgICAgICAg\nICAgICA8QWNjZXB0RXVsYT50cnVlPC9BY2NlcHRFdWxhPg0KICAgICAgICAgICAgICAgIDxPcmdh\nbml6YXRpb24+YXdheWZhci5vcmc8L09yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgICAgICA8RnVs\nbE5hbWU+VXNlcjwvRnVsbE5hbWU+DQogICAgICAgICAgICA8L1VzZXJEYXRhPg0KICAgICAgICA8\nL2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxjcGk6b2ZmbGluZUltYWdlIGNwaTpz\nb3VyY2U9ImNhdGFsb2c6Ly9jYXRhbG9ncy93aW5kb3dzMjAwOC14ODYvc291cmNlcy9pbnN0YWxs\nX3dpbmRvd3MgbG9uZ2hvcm4gc2VydmVyZW50ZXJwcmlzZS5jbGciIHhtbG5zOmNwaT0idXJuOnNj\naGVtYXMtbWljcm9zb2Z0LWNvbTpjcGkiIC8+DQo8L3VuYXR0ZW5kPg0K\n'}}} transientDisk:False truesize:0 type:disk volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath > File "/usr/share/vdsm/vm.py", line 1431, in __getitem__ >KeyError: 'domainID' >Thread-55395::WARNING::2014-05-16 18:07:52,148::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7ff53802d150>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7ff53802d150>> _deviceXML:<disk device="cdrom" snapshot="no" type="file"><address bus="1" controller="0" target="0" type="drive" unit="0"/><source file="" startupPolicy="optional"/><target bus="ide" dev="hdc"/><readonly/><serial></serial></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7ff53802d150>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7ff53802d150>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7ff53802d150>> address:{' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'} apparentsize:0 blockDev:False cache:none conf:{'status': 'Down', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '85a2a9fa-aef6-4fef-b35f-0bf4909bcd11', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983device_a83f7abc-ef76-4109-9ca7-411c56f59c18device_fb2a63c2-acd5-491d-a28f-9b2f7d52f2eedevice_e691e18e-19ae-4540-9479-72e9cbc56d06': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=e691e18e-19ae-4540-9479-72e9cbc56d06, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fe': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=09b3d3d2-40c6-4239-a21e-49aa06ad35fe, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=55ac3e8c-17a4-4390-a958-0485bd6db983, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983device_a83f7abc-ef76-4109-9ca7-411c56f59c18': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=a83f7abc-ef76-4109-9ca7-411c56f59c18, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_09b3d3d2-40c6-4239-a21e-49aa06ad35fedevice_55ac3e8c-17a4-4390-a958-0485bd6db983device_a83f7abc-ef76-4109-9ca7-411c56f59c18device_fb2a63c2-acd5-491d-a28f-9b2f7d52f2ee': 'VmDevice {vmId=85a2a9fa-aef6-4fef-b35f-0bf4909bcd11, deviceId=fb2a63c2-acd5-491d-a28f-9b2f7d52f2ee, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'exitCode': 1, 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'exitMessage': 'internal error ifname "vnet0" not in key map', 'transparentHugePages': 'true', 'devices': [{'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'f2ae9463-1c4d-4618-aa89-ad97ba519c50'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '86fe2201-d35b-445b-9ff3-37bb6e0741d6'}, {'specParams': {}, 'deviceId': '85951021-c0fc-4a16-8e3d-c8e3aa0c7057', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': 'edaf2841-b832-45ba-8d26-5a6aae2f7dce'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:64:b5:a3', 'linkActive': 'true', 'network': 'secondary', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '1b0975af-78d0-4b38-a144-d223998fc38a', 'device': 'bridge', 'type': 'interface'}, {'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bWluZTwvQ29tcHV0ZXJOYW1lPg0KICAg\nICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1JlZ2lzdGVyZWRP\ncmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8L1JlZ2lzdGVy\nZWRPd25lcj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0i\nTWljcm9zb2Z0LVdpbmRvd3MtVW5hdHRlbmRlZEpvaW4iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0i\neDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwi\nIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29m\ndC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcv\nMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElkZW50aWZpY2F0aW9uPg0K\nICAgICAgICAgICAgICAgIDxDcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICAgICAgPERvbWFp\nbj48L0RvbWFpbj4NCiAgICAgICAgICAgICAgICAgICAgPFBhc3N3b3JkPjwvUGFzc3dvcmQ+DQog\nICAgICAgICAgICAgICAgICAgIDxVc2VybmFtZT48L1VzZXJuYW1lPg0KICAgICAgICAgICAgICAg\nIDwvQ3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgPERlYnVnSm9pbj50cnVlPC9EZWJ1Z0pv\naW4+DQogICAgICAgICAgICAgICAgPEpvaW5Eb21haW4+PC9Kb2luRG9tYWluPg0KICAgICAgICAg\nICAgPC9JZGVudGlmaWNhdGlvbj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5n\ncz4NCiAgICA8c2V0dGluZ3MgcGFzcz0ib29iZVN5c3RlbSI+DQogICAgICAgIDxjb21wb25lbnQg\nbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtSUUtQ2xpZW50TmV0d29ya1Byb3RvY29sSW1wbGVtZW50\nYXRpb24iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4\nNTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxu\nczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUi\nIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0K\nICAgICAgICAgICAgPEhLTE1Qcm94eUVuYWJsZT5mYWxzZTwvSEtMTVByb3h5RW5hYmxlPg0KICAg\nICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2lu\nZG93cy1JbnRlcm5hdGlvbmFsLUNvcmUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJs\naWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25T\nY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01J\nQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxT\nY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9j\nYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2hlbGwtU2V0\ndXAiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZh\nZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3\nY209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHht\nbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAg\nICAgICAgICAgPERpc3BsYXk+DQogICAgICAgICAgICAgICAgPENvbG9yRGVwdGg+MzI8L0NvbG9y\nRGVwdGg+DQogICAgICAgICAgICAgICAgPEhvcml6b250YWxSZXNvbHV0aW9uPjEwMjQ8L0hvcml6\nb250YWxSZXNvbHV0aW9uPg0KICAgICAgICAgICAgICAgIDxSZWZyZXNoUmF0ZT43NTwvUmVmcmVz\naFJhdGU+DQogICAgICAgICAgICAgICAgPFZlcnRpY2FsUmVzb2x1dGlvbj43Njg8L1ZlcnRpY2Fs\nUmVzb2x1dGlvbj4NCiAgICAgICAgICAgIDwvRGlzcGxheT4NCiAgICAgICAgICAgIDxPT0JFPg0K\nICAgICAgICAgICAgICAgIDxIaWRlRVVMQVBhZ2U+dHJ1ZTwvSGlkZUVVTEFQYWdlPg0KICAgICAg\nICAgICAgICAgIDxTa2lwVXNlck9PQkU+dHJ1ZTwvU2tpcFVzZXJPT0JFPg0KICAgICAgICAgICAg\nPC9PT0JFPg0KICAgICAgICAgICAgPFVzZXJBY2NvdW50cz4NCiAgICAgICAgICAgICAgICA8QWRt\naW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgICAgICAgICA8VmFsdWU+PC9WYWx1ZT4N\nCiAgICAgICAgICAgICAgICAgICAgPFBsYWluVGV4dD50cnVlPC9QbGFpblRleHQ+DQogICAgICAg\nICAgICAgICAgPC9BZG1pbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICA8L1VzZXJBY2Nv\ndW50cz4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9S\nZWdpc3RlcmVkT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2Vy\nPC9SZWdpc3RlcmVkT3duZXI+DQogICAgICAgICAgICA8VGltZVpvbmU+ODU8L1RpbWVab25lPg0K\nICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxzZXR0aW5ncyBwYXNz\nPSJ3aW5kb3dzUEUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLUludGVybmF0aW9uYWwtQ29yZS1XaW5QRSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1\nYmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lv\nblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9X\nTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hN\nTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8U2V0dXBVSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAgICAgICAgPC9T\nZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4N\nCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxvY2FsZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TZXR1cCIgcHJv\nY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1\nIiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0\ncDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNp\nPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAg\nICA8VXNlckRhdGE+DQogICAgICAgICAgICAgICAgPFByb2R1Y3RLZXk+DQogICAgICAgICAgICAg\nICAgICAgIDxLZXk+PC9LZXk+DQogICAgICAgICAgICAgICAgICAgIDxXaWxsU2hvd1VJPk5ldmVy\nPC9XaWxsU2hvd1VJPg0KICAgICAgICAgICAgICAgIDwvUHJvZHVjdEtleT4NCiAgICAgICAgICAg\nICAgICA8QWNjZXB0RXVsYT50cnVlPC9BY2NlcHRFdWxhPg0KICAgICAgICAgICAgICAgIDxPcmdh\nbml6YXRpb24+YXdheWZhci5vcmc8L09yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgICAgICA8RnVs\nbE5hbWU+VXNlcjwvRnVsbE5hbWU+DQogICAgICAgICAgICA8L1VzZXJEYXRhPg0KICAgICAgICA8\nL2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxjcGk6b2ZmbGluZUltYWdlIGNwaTpz\nb3VyY2U9ImNhdGFsb2c6Ly9jYXRhbG9ncy93aW5kb3dzMjAwOC14ODYvc291cmNlcy9pbnN0YWxs\nX3dpbmRvd3MgbG9uZ2hvcm4gc2VydmVyZW50ZXJwcmlzZS5jbGciIHhtbG5zOmNwaT0idXJuOnNj\naGVtYXMtbWljcm9zb2Z0LWNvbTpjcGkiIC8+DQo8L3VuYXR0ZW5kPg0K\n'}}}, 'readonly': 'true', 'deviceId': '3b145dba-675d-4f8f-bcb4-f72d5d4a852d', 'path': '/var/run/vdsm/payload/85a2a9fa-aef6-4fef-b35f-0bf4909bcd11.9ec880a57d83e1facafbff681ef9383b.img', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': 'ef63a8d0-80ea-43c8-bc21-5c2249eb943a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'volumeInfo': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'volumeID': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 'readonly': 'false', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'reqsize': '0', 'format': 'cow', 'deviceId': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'propagateErrors': 'off', 'optional': 'false', 'bootOrder': '1', 'volumeID': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'specParams': {}, 'volumeChain': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'volumeID': '330b9d95-7458-42ca-b1ae-4a6ac1e9c73c', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f6a961b4-d81e-4aea-97bf-5bf83cf62b26'}]}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': '1b244f92-1f3b-4f23-b27d-1aa2ba9bd176'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '6d83f065-7782-45cf-bd71-15678baa5569', 'target': 2097152}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'mine', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7ff53802d150>> device:cdrom deviceId:ef63a8d0-80ea-43c8-bc21-5c2249eb943a extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7ff53802d150>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7ff53802d150>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7ff53802d150>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7ff53802d150>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7ff53802d150>> log:<logUtils.SimpleLogAdapter instance at 0x7ff5600361b8> name:hdc networkDev:False path: readonly:true reqsize:0 serial: shared:false specParams:{'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'} transientDisk:False truesize:0 type:disk volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath > File "/usr/share/vdsm/vm.py", line 1431, in __getitem__ >KeyError: 'domainID' >Thread-55395::DEBUG::2014-05-16 18:07:52,149::task::579::TaskManager.Task::(_updateState) Task=`406db335-85c6-45a5-b360-589163d01161`::moving from state init -> state preparing >Thread-55395::INFO::2014-05-16 18:07:52,150::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='f6a961b4-d81e-4aea-97bf-5bf83cf62b26', volUUID=None) >Thread-55395::DEBUG::2014-05-16 18:07:52,150::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`32ba0d16-7d3e-4cda-af7b-66908162ae76`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'teardownImage' >Thread-55395::DEBUG::2014-05-16 18:07:52,150::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55395::DEBUG::2014-05-16 18:07:52,151::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55395::DEBUG::2014-05-16 18:07:52,151::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`32ba0d16-7d3e-4cda-af7b-66908162ae76`::Granted request >Thread-55395::DEBUG::2014-05-16 18:07:52,151::task::811::TaskManager.Task::(resourceAcquired) Task=`406db335-85c6-45a5-b360-589163d01161`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55395::DEBUG::2014-05-16 18:07:52,151::task::974::TaskManager.Task::(_decref) Task=`406db335-85c6-45a5-b360-589163d01161`::ref 1 aborting False >Thread-55395::DEBUG::2014-05-16 18:07:52,152::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55395::DEBUG::2014-05-16 18:07:52,152::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55395::DEBUG::2014-05-16 18:07:52,318::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55395::DEBUG::2014-05-16 18:07:52,333::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55395::DEBUG::2014-05-16 18:07:52,333::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55395::DEBUG::2014-05-16 18:07:52,334::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c' (cwd None) >Thread-55395::DEBUG::2014-05-16 18:07:52,504::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55395::DEBUG::2014-05-16 18:07:52,504::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55395::DEBUG::2014-05-16 18:07:52,504::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55395::INFO::2014-05-16 18:07:52,505::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-55395::DEBUG::2014-05-16 18:07:52,505::task::1168::TaskManager.Task::(prepare) Task=`406db335-85c6-45a5-b360-589163d01161`::finished: None >Thread-55395::DEBUG::2014-05-16 18:07:52,505::task::579::TaskManager.Task::(_updateState) Task=`406db335-85c6-45a5-b360-589163d01161`::moving from state preparing -> state finished >Thread-55395::DEBUG::2014-05-16 18:07:52,505::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55395::DEBUG::2014-05-16 18:07:52,506::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55395::DEBUG::2014-05-16 18:07:52,506::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55395::DEBUG::2014-05-16 18:07:52,506::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55395::DEBUG::2014-05-16 18:07:52,506::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55395::DEBUG::2014-05-16 18:07:52,506::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55395::DEBUG::2014-05-16 18:07:52,507::task::974::TaskManager.Task::(_decref) Task=`406db335-85c6-45a5-b360-589163d01161`::ref 0 aborting False >Thread-55395::WARNING::2014-05-16 18:07:52,508::utils::114::root::(rmFile) File: /var/lib/libvirt/qemu/channels/85a2a9fa-aef6-4fef-b35f-0bf4909bcd11.com.redhat.rhevm.vdsm already removed >Thread-55395::WARNING::2014-05-16 18:07:52,508::utils::114::root::(rmFile) File: /var/lib/libvirt/qemu/channels/85a2a9fa-aef6-4fef-b35f-0bf4909bcd11.org.qemu.guest_agent.0 already removed >Thread-55395::DEBUG::2014-05-16 18:07:52,509::task::579::TaskManager.Task::(_updateState) Task=`3a180dfc-30a3-4a3b-ade1-725dcd73b8fb`::moving from state init -> state preparing >Thread-55395::INFO::2014-05-16 18:07:52,509::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='85a2a9fa-aef6-4fef-b35f-0bf4909bcd11') >Thread-55395::INFO::2014-05-16 18:07:52,510::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-55395::DEBUG::2014-05-16 18:07:52,510::task::1168::TaskManager.Task::(prepare) Task=`3a180dfc-30a3-4a3b-ade1-725dcd73b8fb`::finished: None >Thread-55395::DEBUG::2014-05-16 18:07:52,511::task::579::TaskManager.Task::(_updateState) Task=`3a180dfc-30a3-4a3b-ade1-725dcd73b8fb`::moving from state preparing -> state finished >Thread-55395::DEBUG::2014-05-16 18:07:52,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55395::DEBUG::2014-05-16 18:07:52,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55395::DEBUG::2014-05-16 18:07:52,511::task::974::TaskManager.Task::(_decref) Task=`3a180dfc-30a3-4a3b-ade1-725dcd73b8fb`::ref 0 aborting False >Thread-55395::DEBUG::2014-05-16 18:07:52,512::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd' (cwd None) >Thread-55395::DEBUG::2014-05-16 18:07:52,818::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55395::INFO::2014-05-16 18:07:52,819::hooks::100::root::(_runHooksDir) >Thread-55395::DEBUG::2014-05-16 18:07:52,819::vm::4527::vm.Vm::(deleteVm) vmId=`85a2a9fa-aef6-4fef-b35f-0bf4909bcd11`::Total desktops after destroy of 85a2a9fa-aef6-4fef-b35f-0bf4909bcd11 is 0 >Thread-55395::DEBUG::2014-05-16 18:07:52,819::BindingXMLRPC::982::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >Dummy-51::DEBUG::2014-05-16 18:07:53,929::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:54,001::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351314 s, 29.1 MB/s\n'; <rc> = 0 >Thread-55398::DEBUG::2014-05-16 18:07:54,173::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55398::DEBUG::2014-05-16 18:07:54,174::task::579::TaskManager.Task::(_updateState) Task=`a2d2938e-f53c-4a4d-8106-a31ee6cc2b62`::moving from state init -> state preparing >Thread-55398::INFO::2014-05-16 18:07:54,174::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55398::INFO::2014-05-16 18:07:54,174::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55398::DEBUG::2014-05-16 18:07:54,175::task::1168::TaskManager.Task::(prepare) Task=`a2d2938e-f53c-4a4d-8106-a31ee6cc2b62`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55398::DEBUG::2014-05-16 18:07:54,175::task::579::TaskManager.Task::(_updateState) Task=`a2d2938e-f53c-4a4d-8106-a31ee6cc2b62`::moving from state preparing -> state finished >Thread-55398::DEBUG::2014-05-16 18:07:54,175::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55398::DEBUG::2014-05-16 18:07:54,175::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55398::DEBUG::2014-05-16 18:07:54,175::task::974::TaskManager.Task::(_decref) Task=`a2d2938e-f53c-4a4d-8106-a31ee6cc2b62`::ref 0 aborting False >Thread-55399::DEBUG::2014-05-16 18:07:54,184::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55399::DEBUG::2014-05-16 18:07:54,185::task::579::TaskManager.Task::(_updateState) Task=`701321b7-000d-4cf6-b2ef-8d36f2a9b1d3`::moving from state init -> state preparing >Thread-55399::INFO::2014-05-16 18:07:54,185::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55399::DEBUG::2014-05-16 18:07:54,185::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e418eb3e-1dd7-44fa-a84b-ee6cf7ed4637`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55399::DEBUG::2014-05-16 18:07:54,186::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55399::DEBUG::2014-05-16 18:07:54,186::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55399::DEBUG::2014-05-16 18:07:54,186::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e418eb3e-1dd7-44fa-a84b-ee6cf7ed4637`::Granted request >Thread-55399::DEBUG::2014-05-16 18:07:54,186::task::811::TaskManager.Task::(resourceAcquired) Task=`701321b7-000d-4cf6-b2ef-8d36f2a9b1d3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55399::DEBUG::2014-05-16 18:07:54,186::task::974::TaskManager.Task::(_decref) Task=`701321b7-000d-4cf6-b2ef-8d36f2a9b1d3`::ref 1 aborting False >Thread-55399::INFO::2014-05-16 18:07:54,187::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55399::DEBUG::2014-05-16 18:07:54,187::task::1168::TaskManager.Task::(prepare) Task=`701321b7-000d-4cf6-b2ef-8d36f2a9b1d3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55399::DEBUG::2014-05-16 18:07:54,187::task::579::TaskManager.Task::(_updateState) Task=`701321b7-000d-4cf6-b2ef-8d36f2a9b1d3`::moving from state preparing -> state finished >Thread-55399::DEBUG::2014-05-16 18:07:54,188::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55399::DEBUG::2014-05-16 18:07:54,188::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55399::DEBUG::2014-05-16 18:07:54,188::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55399::DEBUG::2014-05-16 18:07:54,188::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55399::DEBUG::2014-05-16 18:07:54,188::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55399::DEBUG::2014-05-16 18:07:54,188::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55399::DEBUG::2014-05-16 18:07:54,189::task::974::TaskManager.Task::(_decref) Task=`701321b7-000d-4cf6-b2ef-8d36f2a9b1d3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:07:56,013::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:56,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315724 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:07:58,092::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:07:58,160::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311811 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:07:59,454::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:07:59,465::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111982 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:00,171::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:00,243::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333197 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:02,255::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:02,325::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311561 s, 32.9 MB/s\n'; <rc> = 0 >Thread-55403::DEBUG::2014-05-16 18:08:04,280::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55403::DEBUG::2014-05-16 18:08:04,281::task::579::TaskManager.Task::(_updateState) Task=`008416fb-788e-4eb0-9448-0edb614bd97c`::moving from state init -> state preparing >Thread-55403::INFO::2014-05-16 18:08:04,281::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55403::INFO::2014-05-16 18:08:04,281::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55403::DEBUG::2014-05-16 18:08:04,281::task::1168::TaskManager.Task::(prepare) Task=`008416fb-788e-4eb0-9448-0edb614bd97c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55403::DEBUG::2014-05-16 18:08:04,282::task::579::TaskManager.Task::(_updateState) Task=`008416fb-788e-4eb0-9448-0edb614bd97c`::moving from state preparing -> state finished >Thread-55403::DEBUG::2014-05-16 18:08:04,282::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55403::DEBUG::2014-05-16 18:08:04,282::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55403::DEBUG::2014-05-16 18:08:04,282::task::974::TaskManager.Task::(_decref) Task=`008416fb-788e-4eb0-9448-0edb614bd97c`::ref 0 aborting False >Thread-55404::DEBUG::2014-05-16 18:08:04,303::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55404::DEBUG::2014-05-16 18:08:04,304::task::579::TaskManager.Task::(_updateState) Task=`7eb2f1c0-85c8-43c1-80fe-27ce3dfe4e42`::moving from state init -> state preparing >Thread-55404::INFO::2014-05-16 18:08:04,304::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55404::DEBUG::2014-05-16 18:08:04,304::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`346be1b8-c6ea-4722-98da-b68183d6ec94`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55404::DEBUG::2014-05-16 18:08:04,304::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55404::DEBUG::2014-05-16 18:08:04,304::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55404::DEBUG::2014-05-16 18:08:04,305::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`346be1b8-c6ea-4722-98da-b68183d6ec94`::Granted request >Thread-55404::DEBUG::2014-05-16 18:08:04,305::task::811::TaskManager.Task::(resourceAcquired) Task=`7eb2f1c0-85c8-43c1-80fe-27ce3dfe4e42`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55404::DEBUG::2014-05-16 18:08:04,305::task::974::TaskManager.Task::(_decref) Task=`7eb2f1c0-85c8-43c1-80fe-27ce3dfe4e42`::ref 1 aborting False >Thread-55404::INFO::2014-05-16 18:08:04,306::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55404::DEBUG::2014-05-16 18:08:04,306::task::1168::TaskManager.Task::(prepare) Task=`7eb2f1c0-85c8-43c1-80fe-27ce3dfe4e42`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55404::DEBUG::2014-05-16 18:08:04,306::task::579::TaskManager.Task::(_updateState) Task=`7eb2f1c0-85c8-43c1-80fe-27ce3dfe4e42`::moving from state preparing -> state finished >Thread-55404::DEBUG::2014-05-16 18:08:04,306::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55404::DEBUG::2014-05-16 18:08:04,306::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55404::DEBUG::2014-05-16 18:08:04,307::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55404::DEBUG::2014-05-16 18:08:04,307::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55404::DEBUG::2014-05-16 18:08:04,307::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55404::DEBUG::2014-05-16 18:08:04,307::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55404::DEBUG::2014-05-16 18:08:04,307::task::974::TaskManager.Task::(_decref) Task=`7eb2f1c0-85c8-43c1-80fe-27ce3dfe4e42`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:08:04,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:04,407::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338974 s, 30.2 MB/s\n'; <rc> = 0 >Thread-55405::DEBUG::2014-05-16 18:08:05,171::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5411975.000000 / 8.008383 / 262500000.000000 = 0.257443 >Thread-55405::DEBUG::2014-05-16 18:08:05,172::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0064026243456207109, 'statsAge': 1.607666015625, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25744333333004432, 'rxDropped': 0} >Thread-55405::DEBUG::2014-05-16 18:08:05,172::task::579::TaskManager.Task::(_updateState) Task=`7df77a8e-c2dd-41cf-83c9-2dc2d3957949`::moving from state init -> state preparing >Thread-55405::INFO::2014-05-16 18:08:05,172::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55405::INFO::2014-05-16 18:08:05,173::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111982', 'lastCheck': '5.7', 'valid': True}} >Thread-55405::DEBUG::2014-05-16 18:08:05,173::task::1168::TaskManager.Task::(prepare) Task=`7df77a8e-c2dd-41cf-83c9-2dc2d3957949`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111982', 'lastCheck': '5.7', 'valid': True}} >Thread-55405::DEBUG::2014-05-16 18:08:05,173::task::579::TaskManager.Task::(_updateState) Task=`7df77a8e-c2dd-41cf-83c9-2dc2d3957949`::moving from state preparing -> state finished >Thread-55405::DEBUG::2014-05-16 18:08:05,173::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55405::DEBUG::2014-05-16 18:08:05,173::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55405::DEBUG::2014-05-16 18:08:05,173::task::974::TaskManager.Task::(_decref) Task=`7df77a8e-c2dd-41cf-83c9-2dc2d3957949`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:08:06,418::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:06,490::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354059 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:08,501::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:08,569::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315536 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:08:09,506::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:08:09,517::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000839607 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:10,581::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:10,648::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305837 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:12,659::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:12,727::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316331 s, 32.4 MB/s\n'; <rc> = 0 >Thread-55410::DEBUG::2014-05-16 18:08:14,379::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55410::DEBUG::2014-05-16 18:08:14,380::task::579::TaskManager.Task::(_updateState) Task=`14cdb524-11f6-4104-8e2c-85a5c84da3dd`::moving from state init -> state preparing >Thread-55410::INFO::2014-05-16 18:08:14,380::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55410::INFO::2014-05-16 18:08:14,380::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55410::DEBUG::2014-05-16 18:08:14,381::task::1168::TaskManager.Task::(prepare) Task=`14cdb524-11f6-4104-8e2c-85a5c84da3dd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55410::DEBUG::2014-05-16 18:08:14,381::task::579::TaskManager.Task::(_updateState) Task=`14cdb524-11f6-4104-8e2c-85a5c84da3dd`::moving from state preparing -> state finished >Thread-55410::DEBUG::2014-05-16 18:08:14,381::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55410::DEBUG::2014-05-16 18:08:14,381::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55410::DEBUG::2014-05-16 18:08:14,381::task::974::TaskManager.Task::(_decref) Task=`14cdb524-11f6-4104-8e2c-85a5c84da3dd`::ref 0 aborting False >Thread-55411::DEBUG::2014-05-16 18:08:14,389::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55411::DEBUG::2014-05-16 18:08:14,390::task::579::TaskManager.Task::(_updateState) Task=`87e36f15-fc47-4c75-a538-1b12c9d599f6`::moving from state init -> state preparing >Thread-55411::INFO::2014-05-16 18:08:14,390::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55411::DEBUG::2014-05-16 18:08:14,390::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`08f4ac9e-3e84-4619-a1fc-8ce69907b320`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55411::DEBUG::2014-05-16 18:08:14,391::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55411::DEBUG::2014-05-16 18:08:14,392::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55411::DEBUG::2014-05-16 18:08:14,392::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`08f4ac9e-3e84-4619-a1fc-8ce69907b320`::Granted request >Thread-55411::DEBUG::2014-05-16 18:08:14,392::task::811::TaskManager.Task::(resourceAcquired) Task=`87e36f15-fc47-4c75-a538-1b12c9d599f6`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55411::DEBUG::2014-05-16 18:08:14,392::task::974::TaskManager.Task::(_decref) Task=`87e36f15-fc47-4c75-a538-1b12c9d599f6`::ref 1 aborting False >Thread-55411::INFO::2014-05-16 18:08:14,393::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55411::DEBUG::2014-05-16 18:08:14,393::task::1168::TaskManager.Task::(prepare) Task=`87e36f15-fc47-4c75-a538-1b12c9d599f6`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '111266496512', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55411::DEBUG::2014-05-16 18:08:14,393::task::579::TaskManager.Task::(_updateState) Task=`87e36f15-fc47-4c75-a538-1b12c9d599f6`::moving from state preparing -> state finished >Thread-55411::DEBUG::2014-05-16 18:08:14,393::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55411::DEBUG::2014-05-16 18:08:14,394::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55411::DEBUG::2014-05-16 18:08:14,394::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55411::DEBUG::2014-05-16 18:08:14,394::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55411::DEBUG::2014-05-16 18:08:14,394::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55411::DEBUG::2014-05-16 18:08:14,394::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55411::DEBUG::2014-05-16 18:08:14,394::task::974::TaskManager.Task::(_decref) Task=`87e36f15-fc47-4c75-a538-1b12c9d599f6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:08:14,739::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:14,810::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351005 s, 29.2 MB/s\n'; <rc> = 0 >Thread-55412::DEBUG::2014-05-16 18:08:16,622::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [2fa4c194] >Thread-55412::DEBUG::2014-05-16 18:08:16,623::task::579::TaskManager.Task::(_updateState) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::moving from state init -> state preparing >Thread-55412::INFO::2014-05-16 18:08:16,623::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='f6a961b4-d81e-4aea-97bf-5bf83cf62b26', postZero='false', force='false') >Thread-55412::DEBUG::2014-05-16 18:08:16,623::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f6a961b4-d81e-4aea-97bf-5bf83cf62b26`ReqID=`5c6c6572-7cff-4eaa-8bbb-df95a87f5eec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1526' at 'deleteImage' >Thread-55412::DEBUG::2014-05-16 18:08:16,624::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f6a961b4-d81e-4aea-97bf-5bf83cf62b26' for lock type 'exclusive' >Thread-55412::DEBUG::2014-05-16 18:08:16,624::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f6a961b4-d81e-4aea-97bf-5bf83cf62b26' is free. Now locking as 'exclusive' (1 active user) >Thread-55412::DEBUG::2014-05-16 18:08:16,624::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f6a961b4-d81e-4aea-97bf-5bf83cf62b26`ReqID=`5c6c6572-7cff-4eaa-8bbb-df95a87f5eec`::Granted request >Thread-55412::DEBUG::2014-05-16 18:08:16,624::task::811::TaskManager.Task::(resourceAcquired) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::_resourcesAcquired: Storage.f6a961b4-d81e-4aea-97bf-5bf83cf62b26 (exclusive) >Thread-55412::DEBUG::2014-05-16 18:08:16,624::task::974::TaskManager.Task::(_decref) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::ref 1 aborting False >Thread-55412::DEBUG::2014-05-16 18:08:16,625::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`71e5e757-9003-48be-bdf5-9972ac9dc111`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1527' at 'deleteImage' >Thread-55412::DEBUG::2014-05-16 18:08:16,625::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55412::DEBUG::2014-05-16 18:08:16,625::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55412::DEBUG::2014-05-16 18:08:16,625::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`71e5e757-9003-48be-bdf5-9972ac9dc111`::Granted request >Thread-55412::DEBUG::2014-05-16 18:08:16,625::task::811::TaskManager.Task::(resourceAcquired) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55412::DEBUG::2014-05-16 18:08:16,625::task::974::TaskManager.Task::(_decref) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::ref 1 aborting False >Thread-55412::DEBUG::2014-05-16 18:08:16,626::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55412::DEBUG::2014-05-16 18:08:16,626::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55412::DEBUG::2014-05-16 18:08:16,786::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55412::DEBUG::2014-05-16 18:08:16,804::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55412::DEBUG::2014-05-16 18:08:16,804::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55412::DEBUG::2014-05-16 18:08:16,805::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n -a y --deltag IU_f6a961b4-d81e-4aea-97bf-5bf83cf62b26 --addtag IU__remove_me_f6a961b4-d81e-4aea-97bf-5bf83cf62b26 f79908bf-a757-4a71-9ab5-3a12ede5f65c/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:16,821::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:16,900::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388996 s, 26.3 MB/s\n'; <rc> = 0 >Thread-55412::DEBUG::2014-05-16 18:08:17,092::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-55412::DEBUG::2014-05-16 18:08:17,093::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55412::DEBUG::2014-05-16 18:08:17,094::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55412::WARNING::2014-05-16 18:08:17,094::lvm::1108::Storage.LVM::(removeLVs) Removing active volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c >Thread-55412::DEBUG::2014-05-16 18:08:17,094::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n f79908bf-a757-4a71-9ab5-3a12ede5f65c/330b9d95-7458-42ca-b1ae-4a6ac1e9c73c' (cwd None) >Thread-55412::DEBUG::2014-05-16 18:08:17,267::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-55412::DEBUG::2014-05-16 18:08:17,268::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55412::DEBUG::2014-05-16 18:08:17,268::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55412::DEBUG::2014-05-16 18:08:17,269::blockSD::935::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26/77c78124-ee6c-46b1-9112-a738f448beca'] >Thread-55412::DEBUG::2014-05-16 18:08:17,269::blockSD::946::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f6a961b4-d81e-4aea-97bf-5bf83cf62b26 >Thread-55412::DEBUG::2014-05-16 18:08:17,270::task::736::TaskManager.Task::(_save) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6d116d30-bf13-415a-992d-4ee4a79907f6 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6d116d30-bf13-415a-992d-4ee4a79907f6.temp >Thread-55412::DEBUG::2014-05-16 18:08:17,304::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_f6a961b4-d81e-4aea-97bf-5bf83cf62b26 for task 6d116d30-bf13-415a-992d-4ee4a79907f6 >Thread-55412::INFO::2014-05-16 18:08:17,304::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-55412::DEBUG::2014-05-16 18:08:17,304::task::1163::TaskManager.Task::(prepare) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::Prepare: 1 jobs exist, move to acquiring >Thread-55412::DEBUG::2014-05-16 18:08:17,304::task::579::TaskManager.Task::(_updateState) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::moving from state preparing -> state acquiring >Thread-55412::DEBUG::2014-05-16 18:08:17,305::task::736::TaskManager.Task::(_save) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6d116d30-bf13-415a-992d-4ee4a79907f6 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6d116d30-bf13-415a-992d-4ee4a79907f6.temp >Thread-55412::DEBUG::2014-05-16 18:08:17,310::task::579::TaskManager.Task::(_updateState) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::moving from state acquiring -> state queued >Thread-55412::DEBUG::2014-05-16 18:08:17,310::task::736::TaskManager.Task::(_save) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6d116d30-bf13-415a-992d-4ee4a79907f6 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6d116d30-bf13-415a-992d-4ee4a79907f6.temp >Thread-55412::DEBUG::2014-05-16 18:08:17,316::taskManager::50::TaskManager::(_queueTask) queuing task: 6d116d30-bf13-415a-992d-4ee4a79907f6 >6ba4f964-f6b5-4919-ab9c-3d753570c2a3::DEBUG::2014-05-16 18:08:17,316::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-55412::DEBUG::2014-05-16 18:08:17,316::taskManager::56::TaskManager::(_queueTask) task queued: 6d116d30-bf13-415a-992d-4ee4a79907f6 >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,317::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 6d116d30-bf13-415a-992d-4ee4a79907f6 running: <bound method Task.commit of <storage.task.Task instance at 0x2b22a28>> with: None >Thread-55412::DEBUG::2014-05-16 18:08:17,318::task::1165::TaskManager.Task::(prepare) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::returning >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,319::task::1176::TaskManager.Task::(commit) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::committing task: 6d116d30-bf13-415a-992d-4ee4a79907f6 >Thread-55412::DEBUG::2014-05-16 18:08:17,319::task::974::TaskManager.Task::(_decref) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::ref 0 aborting False >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,320::task::579::TaskManager.Task::(_updateState) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::moving from state queued -> state running >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,322::task::736::TaskManager.Task::(_save) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6d116d30-bf13-415a-992d-4ee4a79907f6 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6d116d30-bf13-415a-992d-4ee4a79907f6.temp >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,327::task::889::TaskManager.Task::(_runJobs) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::Task.run: running job 0: deleteImage_f6a961b4-d81e-4aea-97bf-5bf83cf62b26: <function <lambda> at 0x7ff538492668> (args: () kwargs: {}) >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,327::task::315::TaskManager.Task::(run) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::Job.run: running deleteImage_f6a961b4-d81e-4aea-97bf-5bf83cf62b26: <function <lambda> at 0x7ff538492668> (args: () kwargs: {}) callback None >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,328::task::579::TaskManager.Task::(_updateState) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::moving from state running -> state finished >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,328::task::736::TaskManager.Task::(_save) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6d116d30-bf13-415a-992d-4ee4a79907f6 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/6d116d30-bf13-415a-992d-4ee4a79907f6.temp >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,334::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>, 'Storage.f6a961b4-d81e-4aea-97bf-5bf83cf62b26': < ResourceRef 'Storage.f6a961b4-d81e-4aea-97bf-5bf83cf62b26', isValid: 'True' obj: 'None'>} >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,334::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,335::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,335::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,335::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,335::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,335::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f6a961b4-d81e-4aea-97bf-5bf83cf62b26' >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,336::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f6a961b4-d81e-4aea-97bf-5bf83cf62b26' (0 active users) >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,336::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f6a961b4-d81e-4aea-97bf-5bf83cf62b26' is free, finding out if anyone is waiting for it. >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,336::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f6a961b4-d81e-4aea-97bf-5bf83cf62b26', Clearing records. >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,336::task::897::TaskManager.Task::(_runJobs) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::Task.run: exit - success: result True >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,336::task::974::TaskManager.Task::(_decref) Task=`6d116d30-bf13-415a-992d-4ee4a79907f6`::ref 0 aborting False >6d116d30-bf13-415a-992d-4ee4a79907f6::DEBUG::2014-05-16 18:08:17,336::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-51::DEBUG::2014-05-16 18:08:18,912::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:18,983::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349204 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:08:19,543::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:08:19,544::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:08:19,703::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:08:19,705::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:08:19,725::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:08:19,735::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581263 s, 7.0 MB/s\n'; <rc> = 0 >Thread-55414::DEBUG::2014-05-16 18:08:20,432::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4013351.000000 / 8.008359 / 262500000.000000 = 0.190912 >Thread-55414::DEBUG::2014-05-16 18:08:20,432::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.022915484881964193, 'statsAge': 0.85055017471313477, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.19091247377465265, 'rxDropped': 0} >Thread-55414::DEBUG::2014-05-16 18:08:20,433::task::579::TaskManager.Task::(_updateState) Task=`bec248e3-25b4-47e3-84d3-92c8aa3a75de`::moving from state init -> state preparing >Thread-55414::INFO::2014-05-16 18:08:20,433::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55414::INFO::2014-05-16 18:08:20,433::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581263', 'lastCheck': '0.7', 'valid': True}} >Thread-55414::DEBUG::2014-05-16 18:08:20,434::task::1168::TaskManager.Task::(prepare) Task=`bec248e3-25b4-47e3-84d3-92c8aa3a75de`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581263', 'lastCheck': '0.7', 'valid': True}} >Thread-55414::DEBUG::2014-05-16 18:08:20,434::task::579::TaskManager.Task::(_updateState) Task=`bec248e3-25b4-47e3-84d3-92c8aa3a75de`::moving from state preparing -> state finished >Thread-55414::DEBUG::2014-05-16 18:08:20,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55414::DEBUG::2014-05-16 18:08:20,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55414::DEBUG::2014-05-16 18:08:20,434::task::974::TaskManager.Task::(_decref) Task=`bec248e3-25b4-47e3-84d3-92c8aa3a75de`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:08:20,994::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:21,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358748 s, 28.5 MB/s\n'; <rc> = 0 >Thread-55416::DEBUG::2014-05-16 18:08:22,982::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55416::DEBUG::2014-05-16 18:08:22,983::task::579::TaskManager.Task::(_updateState) Task=`39e03ab0-8e0f-471b-a779-eef3d1c30c06`::moving from state init -> state preparing >Thread-55416::INFO::2014-05-16 18:08:22,983::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-55416::DEBUG::2014-05-16 18:08:22,983::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-55416::DEBUG::2014-05-16 18:08:22,983::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 6d116d30-bf13-415a-992d-4ee4a79907f6 >Thread-55416::DEBUG::2014-05-16 18:08:22,983::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6d116d30-bf13-415a-992d-4ee4a79907f6'} >Thread-55416::DEBUG::2014-05-16 18:08:22,983::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'6d116d30-bf13-415a-992d-4ee4a79907f6': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6d116d30-bf13-415a-992d-4ee4a79907f6'}} >Thread-55416::INFO::2014-05-16 18:08:22,983::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'6d116d30-bf13-415a-992d-4ee4a79907f6': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6d116d30-bf13-415a-992d-4ee4a79907f6'}}} >Thread-55416::DEBUG::2014-05-16 18:08:22,984::task::1168::TaskManager.Task::(prepare) Task=`39e03ab0-8e0f-471b-a779-eef3d1c30c06`::finished: {'allTasksStatus': {'6d116d30-bf13-415a-992d-4ee4a79907f6': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6d116d30-bf13-415a-992d-4ee4a79907f6'}}} >Thread-55416::DEBUG::2014-05-16 18:08:22,984::task::579::TaskManager.Task::(_updateState) Task=`39e03ab0-8e0f-471b-a779-eef3d1c30c06`::moving from state preparing -> state finished >Thread-55416::DEBUG::2014-05-16 18:08:22,984::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55416::DEBUG::2014-05-16 18:08:22,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55416::DEBUG::2014-05-16 18:08:22,984::task::974::TaskManager.Task::(_decref) Task=`39e03ab0-8e0f-471b-a779-eef3d1c30c06`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:08:23,080::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:23,148::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309753 s, 33.1 MB/s\n'; <rc> = 0 >Thread-55417::DEBUG::2014-05-16 18:08:23,188::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55417::DEBUG::2014-05-16 18:08:23,188::task::579::TaskManager.Task::(_updateState) Task=`a720b69a-55e4-4b40-88c0-fc9c19db1e80`::moving from state init -> state preparing >Thread-55417::INFO::2014-05-16 18:08:23,188::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='6d116d30-bf13-415a-992d-4ee4a79907f6', spUUID=None, options=None) >Thread-55417::DEBUG::2014-05-16 18:08:23,189::taskManager::161::TaskManager::(clearTask) Entry. taskID: 6d116d30-bf13-415a-992d-4ee4a79907f6 >Thread-55417::DEBUG::2014-05-16 18:08:23,189::taskManager::166::TaskManager::(clearTask) Return. >Thread-55417::INFO::2014-05-16 18:08:23,189::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-55417::DEBUG::2014-05-16 18:08:23,190::task::1168::TaskManager.Task::(prepare) Task=`a720b69a-55e4-4b40-88c0-fc9c19db1e80`::finished: None >Thread-55417::DEBUG::2014-05-16 18:08:23,190::task::579::TaskManager.Task::(_updateState) Task=`a720b69a-55e4-4b40-88c0-fc9c19db1e80`::moving from state preparing -> state finished >Thread-55417::DEBUG::2014-05-16 18:08:23,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55417::DEBUG::2014-05-16 18:08:23,190::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55417::DEBUG::2014-05-16 18:08:23,190::task::974::TaskManager.Task::(_decref) Task=`a720b69a-55e4-4b40-88c0-fc9c19db1e80`::ref 0 aborting False >Thread-55419::DEBUG::2014-05-16 18:08:24,473::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55419::DEBUG::2014-05-16 18:08:24,474::task::579::TaskManager.Task::(_updateState) Task=`365119d4-97a6-4f1c-845b-841c57e421c3`::moving from state init -> state preparing >Thread-55419::INFO::2014-05-16 18:08:24,474::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55419::INFO::2014-05-16 18:08:24,474::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55419::DEBUG::2014-05-16 18:08:24,474::task::1168::TaskManager.Task::(prepare) Task=`365119d4-97a6-4f1c-845b-841c57e421c3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55419::DEBUG::2014-05-16 18:08:24,475::task::579::TaskManager.Task::(_updateState) Task=`365119d4-97a6-4f1c-845b-841c57e421c3`::moving from state preparing -> state finished >Thread-55419::DEBUG::2014-05-16 18:08:24,475::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55419::DEBUG::2014-05-16 18:08:24,475::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55419::DEBUG::2014-05-16 18:08:24,475::task::974::TaskManager.Task::(_decref) Task=`365119d4-97a6-4f1c-845b-841c57e421c3`::ref 0 aborting False >Thread-55420::DEBUG::2014-05-16 18:08:24,489::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55420::DEBUG::2014-05-16 18:08:24,489::task::579::TaskManager.Task::(_updateState) Task=`fd2c7b9c-1831-4004-8589-cbf368079aff`::moving from state init -> state preparing >Thread-55420::INFO::2014-05-16 18:08:24,489::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55420::DEBUG::2014-05-16 18:08:24,490::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cbdfba72-31ec-491d-94dd-20b99760627e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55420::DEBUG::2014-05-16 18:08:24,490::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55420::DEBUG::2014-05-16 18:08:24,490::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55420::DEBUG::2014-05-16 18:08:24,490::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cbdfba72-31ec-491d-94dd-20b99760627e`::Granted request >Thread-55420::DEBUG::2014-05-16 18:08:24,491::task::811::TaskManager.Task::(resourceAcquired) Task=`fd2c7b9c-1831-4004-8589-cbf368079aff`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55420::DEBUG::2014-05-16 18:08:24,491::task::974::TaskManager.Task::(_decref) Task=`fd2c7b9c-1831-4004-8589-cbf368079aff`::ref 1 aborting False >Thread-55420::INFO::2014-05-16 18:08:24,491::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55420::DEBUG::2014-05-16 18:08:24,492::task::1168::TaskManager.Task::(prepare) Task=`fd2c7b9c-1831-4004-8589-cbf368079aff`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55420::DEBUG::2014-05-16 18:08:24,492::task::579::TaskManager.Task::(_updateState) Task=`fd2c7b9c-1831-4004-8589-cbf368079aff`::moving from state preparing -> state finished >Thread-55420::DEBUG::2014-05-16 18:08:24,492::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55420::DEBUG::2014-05-16 18:08:24,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55420::DEBUG::2014-05-16 18:08:24,492::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55420::DEBUG::2014-05-16 18:08:24,492::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55420::DEBUG::2014-05-16 18:08:24,493::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55420::DEBUG::2014-05-16 18:08:24,493::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55420::DEBUG::2014-05-16 18:08:24,493::task::974::TaskManager.Task::(_decref) Task=`fd2c7b9c-1831-4004-8589-cbf368079aff`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:08:25,159::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:25,226::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304072 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:27,237::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:27,314::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344379 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:29,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:29,398::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350298 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:08:29,771::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:08:29,781::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000745864 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:31,409::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:31,476::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304709 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:33,488::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:33,562::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036743 s, 27.9 MB/s\n'; <rc> = 0 >Thread-55424::DEBUG::2014-05-16 18:08:34,547::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55424::DEBUG::2014-05-16 18:08:34,548::task::579::TaskManager.Task::(_updateState) Task=`cd93039c-efec-420d-9c0e-68587e7a98bf`::moving from state init -> state preparing >Thread-55424::INFO::2014-05-16 18:08:34,548::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55424::INFO::2014-05-16 18:08:34,549::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55424::DEBUG::2014-05-16 18:08:34,549::task::1168::TaskManager.Task::(prepare) Task=`cd93039c-efec-420d-9c0e-68587e7a98bf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55424::DEBUG::2014-05-16 18:08:34,549::task::579::TaskManager.Task::(_updateState) Task=`cd93039c-efec-420d-9c0e-68587e7a98bf`::moving from state preparing -> state finished >Thread-55424::DEBUG::2014-05-16 18:08:34,549::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55424::DEBUG::2014-05-16 18:08:34,549::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55424::DEBUG::2014-05-16 18:08:34,549::task::974::TaskManager.Task::(_decref) Task=`cd93039c-efec-420d-9c0e-68587e7a98bf`::ref 0 aborting False >Thread-55425::DEBUG::2014-05-16 18:08:34,599::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55425::DEBUG::2014-05-16 18:08:34,599::task::579::TaskManager.Task::(_updateState) Task=`64920159-bd9f-454d-baef-7d2a426e2db3`::moving from state init -> state preparing >Thread-55425::INFO::2014-05-16 18:08:34,600::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55425::DEBUG::2014-05-16 18:08:34,600::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`663cf0a5-21b6-456e-9b71-be94c9c747bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55425::DEBUG::2014-05-16 18:08:34,600::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55425::DEBUG::2014-05-16 18:08:34,600::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55425::DEBUG::2014-05-16 18:08:34,601::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`663cf0a5-21b6-456e-9b71-be94c9c747bd`::Granted request >Thread-55425::DEBUG::2014-05-16 18:08:34,601::task::811::TaskManager.Task::(resourceAcquired) Task=`64920159-bd9f-454d-baef-7d2a426e2db3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55425::DEBUG::2014-05-16 18:08:34,601::task::974::TaskManager.Task::(_decref) Task=`64920159-bd9f-454d-baef-7d2a426e2db3`::ref 1 aborting False >Thread-55425::INFO::2014-05-16 18:08:34,602::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55425::DEBUG::2014-05-16 18:08:34,602::task::1168::TaskManager.Task::(prepare) Task=`64920159-bd9f-454d-baef-7d2a426e2db3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55425::DEBUG::2014-05-16 18:08:34,602::task::579::TaskManager.Task::(_updateState) Task=`64920159-bd9f-454d-baef-7d2a426e2db3`::moving from state preparing -> state finished >Thread-55425::DEBUG::2014-05-16 18:08:34,602::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55425::DEBUG::2014-05-16 18:08:34,602::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55425::DEBUG::2014-05-16 18:08:34,603::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55425::DEBUG::2014-05-16 18:08:34,603::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55425::DEBUG::2014-05-16 18:08:34,603::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55425::DEBUG::2014-05-16 18:08:34,603::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55425::DEBUG::2014-05-16 18:08:34,603::task::974::TaskManager.Task::(_decref) Task=`64920159-bd9f-454d-baef-7d2a426e2db3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:08:35,574::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:35,649::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03941 s, 26.0 MB/s\n'; <rc> = 0 >Thread-55426::DEBUG::2014-05-16 18:08:35,754::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315313.000000 / 8.009430 / 262500000.000000 = 0.205249 >Thread-55426::DEBUG::2014-05-16 18:08:35,754::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0071857201558070873, 'statsAge': 0.15403985977172852, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20524915343541977, 'rxDropped': 0} >Thread-55426::DEBUG::2014-05-16 18:08:35,755::task::579::TaskManager.Task::(_updateState) Task=`dcc67676-b308-4c66-93e9-c3f3e0028b16`::moving from state init -> state preparing >Thread-55426::INFO::2014-05-16 18:08:35,755::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55426::INFO::2014-05-16 18:08:35,755::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745864', 'lastCheck': '6.0', 'valid': True}} >Thread-55426::DEBUG::2014-05-16 18:08:35,755::task::1168::TaskManager.Task::(prepare) Task=`dcc67676-b308-4c66-93e9-c3f3e0028b16`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745864', 'lastCheck': '6.0', 'valid': True}} >Thread-55426::DEBUG::2014-05-16 18:08:35,755::task::579::TaskManager.Task::(_updateState) Task=`dcc67676-b308-4c66-93e9-c3f3e0028b16`::moving from state preparing -> state finished >Thread-55426::DEBUG::2014-05-16 18:08:35,756::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55426::DEBUG::2014-05-16 18:08:35,756::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55426::DEBUG::2014-05-16 18:08:35,756::task::974::TaskManager.Task::(_decref) Task=`dcc67676-b308-4c66-93e9-c3f3e0028b16`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:08:37,661::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:37,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321497 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:39,742::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:39,889::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309926 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:08:39,911::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:08:39,934::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000754954 s, 5.4 MB/s\n'; <rc> = 0 >Thread-55429::DEBUG::2014-05-16 18:08:40,073::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [31f040af] >Thread-55429::DEBUG::2014-05-16 18:08:40,074::task::579::TaskManager.Task::(_updateState) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::moving from state init -> state preparing >Thread-55429::INFO::2014-05-16 18:08:40,074::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='17f84cd8-0e95-49d2-a1a9-ed099d088e06', postZero='false', force='false') >Thread-55429::DEBUG::2014-05-16 18:08:40,075::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.17f84cd8-0e95-49d2-a1a9-ed099d088e06`ReqID=`bb8148eb-ff41-4284-b2e8-e48be575ddef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1526' at 'deleteImage' >Thread-55429::DEBUG::2014-05-16 18:08:40,075::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.17f84cd8-0e95-49d2-a1a9-ed099d088e06' for lock type 'exclusive' >Thread-55429::DEBUG::2014-05-16 18:08:40,075::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.17f84cd8-0e95-49d2-a1a9-ed099d088e06' is free. Now locking as 'exclusive' (1 active user) >Thread-55429::DEBUG::2014-05-16 18:08:40,075::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.17f84cd8-0e95-49d2-a1a9-ed099d088e06`ReqID=`bb8148eb-ff41-4284-b2e8-e48be575ddef`::Granted request >Thread-55429::DEBUG::2014-05-16 18:08:40,076::task::811::TaskManager.Task::(resourceAcquired) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::_resourcesAcquired: Storage.17f84cd8-0e95-49d2-a1a9-ed099d088e06 (exclusive) >Thread-55429::DEBUG::2014-05-16 18:08:40,076::task::974::TaskManager.Task::(_decref) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::ref 1 aborting False >Thread-55429::DEBUG::2014-05-16 18:08:40,076::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`f23f6d9b-a22f-4d1e-86fb-168939702ac4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1527' at 'deleteImage' >Thread-55429::DEBUG::2014-05-16 18:08:40,076::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55429::DEBUG::2014-05-16 18:08:40,076::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55429::DEBUG::2014-05-16 18:08:40,077::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`f23f6d9b-a22f-4d1e-86fb-168939702ac4`::Granted request >Thread-55429::DEBUG::2014-05-16 18:08:40,077::task::811::TaskManager.Task::(resourceAcquired) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55429::DEBUG::2014-05-16 18:08:40,077::task::974::TaskManager.Task::(_decref) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::ref 1 aborting False >Thread-55429::DEBUG::2014-05-16 18:08:40,077::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55429::DEBUG::2014-05-16 18:08:40,078::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55429::DEBUG::2014-05-16 18:08:40,230::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55429::DEBUG::2014-05-16 18:08:40,245::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55429::DEBUG::2014-05-16 18:08:40,245::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55429::DEBUG::2014-05-16 18:08:40,246::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n -a y --deltag IU_17f84cd8-0e95-49d2-a1a9-ed099d088e06 --addtag IU__remove_me_17f84cd8-0e95-49d2-a1a9-ed099d088e06 f79908bf-a757-4a71-9ab5-3a12ede5f65c/c05a9aae-80c7-4360-a966-bde67fa126e0' (cwd None) >Thread-55429::DEBUG::2014-05-16 18:08:40,485::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-55429::DEBUG::2014-05-16 18:08:40,486::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55429::DEBUG::2014-05-16 18:08:40,486::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55429::WARNING::2014-05-16 18:08:40,486::lvm::1108::Storage.LVM::(removeLVs) Removing active volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/c05a9aae-80c7-4360-a966-bde67fa126e0 >Thread-55429::DEBUG::2014-05-16 18:08:40,487::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n f79908bf-a757-4a71-9ab5-3a12ede5f65c/c05a9aae-80c7-4360-a966-bde67fa126e0' (cwd None) >Thread-55429::DEBUG::2014-05-16 18:08:40,656::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-55429::DEBUG::2014-05-16 18:08:40,656::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55429::DEBUG::2014-05-16 18:08:40,656::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55429::DEBUG::2014-05-16 18:08:40,657::blockSD::935::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/17f84cd8-0e95-49d2-a1a9-ed099d088e06/c05a9aae-80c7-4360-a966-bde67fa126e0'] >Thread-55429::DEBUG::2014-05-16 18:08:40,657::blockSD::946::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/17f84cd8-0e95-49d2-a1a9-ed099d088e06 >Thread-55429::DEBUG::2014-05-16 18:08:40,658::task::736::TaskManager.Task::(_save) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/ac3061c0-7445-46b0-912d-eba1984422bd temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/ac3061c0-7445-46b0-912d-eba1984422bd.temp >Thread-55429::DEBUG::2014-05-16 18:08:40,663::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_17f84cd8-0e95-49d2-a1a9-ed099d088e06 for task ac3061c0-7445-46b0-912d-eba1984422bd >Thread-55429::INFO::2014-05-16 18:08:40,663::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-55429::DEBUG::2014-05-16 18:08:40,664::task::1163::TaskManager.Task::(prepare) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::Prepare: 1 jobs exist, move to acquiring >Thread-55429::DEBUG::2014-05-16 18:08:40,664::task::579::TaskManager.Task::(_updateState) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::moving from state preparing -> state acquiring >Thread-55429::DEBUG::2014-05-16 18:08:40,664::task::736::TaskManager.Task::(_save) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/ac3061c0-7445-46b0-912d-eba1984422bd temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/ac3061c0-7445-46b0-912d-eba1984422bd.temp >Thread-55429::DEBUG::2014-05-16 18:08:40,670::task::579::TaskManager.Task::(_updateState) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::moving from state acquiring -> state queued >Thread-55429::DEBUG::2014-05-16 18:08:40,671::task::736::TaskManager.Task::(_save) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/ac3061c0-7445-46b0-912d-eba1984422bd temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/ac3061c0-7445-46b0-912d-eba1984422bd.temp >Thread-55429::DEBUG::2014-05-16 18:08:40,676::taskManager::50::TaskManager::(_queueTask) queuing task: ac3061c0-7445-46b0-912d-eba1984422bd >Thread-55429::DEBUG::2014-05-16 18:08:40,677::taskManager::56::TaskManager::(_queueTask) task queued: ac3061c0-7445-46b0-912d-eba1984422bd >8572ec72-79a2-4bdc-86f7-4c5d4bc63029::DEBUG::2014-05-16 18:08:40,677::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,678::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: ac3061c0-7445-46b0-912d-eba1984422bd running: <bound method Task.commit of <storage.task.Task instance at 0x2afeea8>> with: None >Thread-55429::DEBUG::2014-05-16 18:08:40,678::task::1165::TaskManager.Task::(prepare) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::returning >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,679::task::1176::TaskManager.Task::(commit) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::committing task: ac3061c0-7445-46b0-912d-eba1984422bd >Thread-55429::DEBUG::2014-05-16 18:08:40,680::task::974::TaskManager.Task::(_decref) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::ref 0 aborting False >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,681::task::579::TaskManager.Task::(_updateState) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::moving from state queued -> state running >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,682::task::736::TaskManager.Task::(_save) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/ac3061c0-7445-46b0-912d-eba1984422bd temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/ac3061c0-7445-46b0-912d-eba1984422bd.temp >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,688::task::889::TaskManager.Task::(_runJobs) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::Task.run: running job 0: deleteImage_17f84cd8-0e95-49d2-a1a9-ed099d088e06: <function <lambda> at 0x7ff5384149b0> (args: () kwargs: {}) >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,688::task::315::TaskManager.Task::(run) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::Job.run: running deleteImage_17f84cd8-0e95-49d2-a1a9-ed099d088e06: <function <lambda> at 0x7ff5384149b0> (args: () kwargs: {}) callback None >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,688::task::579::TaskManager.Task::(_updateState) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::moving from state running -> state finished >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,689::task::736::TaskManager.Task::(_save) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/ac3061c0-7445-46b0-912d-eba1984422bd temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/ac3061c0-7445-46b0-912d-eba1984422bd.temp >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,695::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.17f84cd8-0e95-49d2-a1a9-ed099d088e06': < ResourceRef 'Storage.17f84cd8-0e95-49d2-a1a9-ed099d088e06', isValid: 'True' obj: 'None'>, 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,695::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,695::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.17f84cd8-0e95-49d2-a1a9-ed099d088e06' >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,695::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.17f84cd8-0e95-49d2-a1a9-ed099d088e06' (0 active users) >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,695::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.17f84cd8-0e95-49d2-a1a9-ed099d088e06' is free, finding out if anyone is waiting for it. >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,695::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.17f84cd8-0e95-49d2-a1a9-ed099d088e06', Clearing records. >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,696::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,696::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,696::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,696::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,696::task::897::TaskManager.Task::(_runJobs) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::Task.run: exit - success: result True >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,697::task::974::TaskManager.Task::(_decref) Task=`ac3061c0-7445-46b0-912d-eba1984422bd`::ref 0 aborting False >ac3061c0-7445-46b0-912d-eba1984422bd::DEBUG::2014-05-16 18:08:40,697::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-51::DEBUG::2014-05-16 18:08:42,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:42,099::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350325 s, 29.2 MB/s\n'; <rc> = 0 >Thread-55431::DEBUG::2014-05-16 18:08:43,148::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55431::DEBUG::2014-05-16 18:08:43,148::task::579::TaskManager.Task::(_updateState) Task=`5add6736-85a4-445f-baa1-4038c6214e0c`::moving from state init -> state preparing >Thread-55431::INFO::2014-05-16 18:08:43,149::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-55431::DEBUG::2014-05-16 18:08:43,149::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-55431::DEBUG::2014-05-16 18:08:43,149::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: ac3061c0-7445-46b0-912d-eba1984422bd >Thread-55431::DEBUG::2014-05-16 18:08:43,149::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ac3061c0-7445-46b0-912d-eba1984422bd'} >Thread-55431::DEBUG::2014-05-16 18:08:43,149::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'ac3061c0-7445-46b0-912d-eba1984422bd': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ac3061c0-7445-46b0-912d-eba1984422bd'}} >Thread-55431::INFO::2014-05-16 18:08:43,149::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'ac3061c0-7445-46b0-912d-eba1984422bd': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ac3061c0-7445-46b0-912d-eba1984422bd'}}} >Thread-55431::DEBUG::2014-05-16 18:08:43,149::task::1168::TaskManager.Task::(prepare) Task=`5add6736-85a4-445f-baa1-4038c6214e0c`::finished: {'allTasksStatus': {'ac3061c0-7445-46b0-912d-eba1984422bd': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ac3061c0-7445-46b0-912d-eba1984422bd'}}} >Thread-55431::DEBUG::2014-05-16 18:08:43,150::task::579::TaskManager.Task::(_updateState) Task=`5add6736-85a4-445f-baa1-4038c6214e0c`::moving from state preparing -> state finished >Thread-55431::DEBUG::2014-05-16 18:08:43,150::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55431::DEBUG::2014-05-16 18:08:43,150::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55431::DEBUG::2014-05-16 18:08:43,150::task::974::TaskManager.Task::(_decref) Task=`5add6736-85a4-445f-baa1-4038c6214e0c`::ref 0 aborting False >Thread-55432::DEBUG::2014-05-16 18:08:43,211::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55432::DEBUG::2014-05-16 18:08:43,211::task::579::TaskManager.Task::(_updateState) Task=`45753bd0-5631-4e57-9947-f1fce4458114`::moving from state init -> state preparing >Thread-55432::INFO::2014-05-16 18:08:43,211::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='ac3061c0-7445-46b0-912d-eba1984422bd', spUUID=None, options=None) >Thread-55432::DEBUG::2014-05-16 18:08:43,211::taskManager::161::TaskManager::(clearTask) Entry. taskID: ac3061c0-7445-46b0-912d-eba1984422bd >Thread-55432::DEBUG::2014-05-16 18:08:43,212::taskManager::166::TaskManager::(clearTask) Return. >Thread-55432::INFO::2014-05-16 18:08:43,212::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-55432::DEBUG::2014-05-16 18:08:43,212::task::1168::TaskManager.Task::(prepare) Task=`45753bd0-5631-4e57-9947-f1fce4458114`::finished: None >Thread-55432::DEBUG::2014-05-16 18:08:43,212::task::579::TaskManager.Task::(_updateState) Task=`45753bd0-5631-4e57-9947-f1fce4458114`::moving from state preparing -> state finished >Thread-55432::DEBUG::2014-05-16 18:08:43,213::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55432::DEBUG::2014-05-16 18:08:43,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55432::DEBUG::2014-05-16 18:08:43,213::task::974::TaskManager.Task::(_decref) Task=`45753bd0-5631-4e57-9947-f1fce4458114`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:08:44,111::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:44,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344116 s, 29.8 MB/s\n'; <rc> = 0 >Thread-55433::DEBUG::2014-05-16 18:08:44,639::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55433::DEBUG::2014-05-16 18:08:44,640::task::579::TaskManager.Task::(_updateState) Task=`f61ed4cd-8329-490d-a060-d3237d04d9c8`::moving from state init -> state preparing >Thread-55433::INFO::2014-05-16 18:08:44,640::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55433::INFO::2014-05-16 18:08:44,640::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55433::DEBUG::2014-05-16 18:08:44,641::task::1168::TaskManager.Task::(prepare) Task=`f61ed4cd-8329-490d-a060-d3237d04d9c8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55433::DEBUG::2014-05-16 18:08:44,641::task::579::TaskManager.Task::(_updateState) Task=`f61ed4cd-8329-490d-a060-d3237d04d9c8`::moving from state preparing -> state finished >Thread-55433::DEBUG::2014-05-16 18:08:44,641::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55433::DEBUG::2014-05-16 18:08:44,641::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55433::DEBUG::2014-05-16 18:08:44,641::task::974::TaskManager.Task::(_decref) Task=`f61ed4cd-8329-490d-a060-d3237d04d9c8`::ref 0 aborting False >Thread-55434::DEBUG::2014-05-16 18:08:44,651::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55434::DEBUG::2014-05-16 18:08:44,651::task::579::TaskManager.Task::(_updateState) Task=`a21e3667-9bda-4d29-884c-f2a2656fa9f8`::moving from state init -> state preparing >Thread-55434::INFO::2014-05-16 18:08:44,652::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55434::DEBUG::2014-05-16 18:08:44,652::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fbc11f45-0930-45e2-b3b2-2de081c683e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55434::DEBUG::2014-05-16 18:08:44,652::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55434::DEBUG::2014-05-16 18:08:44,652::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55434::DEBUG::2014-05-16 18:08:44,652::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fbc11f45-0930-45e2-b3b2-2de081c683e1`::Granted request >Thread-55434::DEBUG::2014-05-16 18:08:44,653::task::811::TaskManager.Task::(resourceAcquired) Task=`a21e3667-9bda-4d29-884c-f2a2656fa9f8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55434::DEBUG::2014-05-16 18:08:44,653::task::974::TaskManager.Task::(_decref) Task=`a21e3667-9bda-4d29-884c-f2a2656fa9f8`::ref 1 aborting False >Thread-55434::DEBUG::2014-05-16 18:08:44,653::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-55434::DEBUG::2014-05-16 18:08:44,654::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55434::DEBUG::2014-05-16 18:08:44,803::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55434::DEBUG::2014-05-16 18:08:44,805::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-55434::INFO::2014-05-16 18:08:44,805::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55434::DEBUG::2014-05-16 18:08:44,805::task::1168::TaskManager.Task::(prepare) Task=`a21e3667-9bda-4d29-884c-f2a2656fa9f8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55434::DEBUG::2014-05-16 18:08:44,806::task::579::TaskManager.Task::(_updateState) Task=`a21e3667-9bda-4d29-884c-f2a2656fa9f8`::moving from state preparing -> state finished >Thread-55434::DEBUG::2014-05-16 18:08:44,806::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55434::DEBUG::2014-05-16 18:08:44,806::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55434::DEBUG::2014-05-16 18:08:44,806::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55434::DEBUG::2014-05-16 18:08:44,807::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55434::DEBUG::2014-05-16 18:08:44,807::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55434::DEBUG::2014-05-16 18:08:44,807::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55434::DEBUG::2014-05-16 18:08:44,807::task::974::TaskManager.Task::(_decref) Task=`a21e3667-9bda-4d29-884c-f2a2656fa9f8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:08:46,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:46,259::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309364 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:48,271::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:48,344::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360085 s, 28.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:08:50,044::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:08:50,054::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000807179 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:50,355::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:50,428::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348035 s, 29.4 MB/s\n'; <rc> = 0 >Thread-55437::DEBUG::2014-05-16 18:08:50,984::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5469944.000000 / 8.008257 / 262500000.000000 = 0.260205 >Thread-55437::DEBUG::2014-05-16 18:08:50,984::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.007118652738641363, 'statsAge': 1.366671085357666, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.26020496261720921, 'rxDropped': 0} >Thread-55437::DEBUG::2014-05-16 18:08:50,985::task::579::TaskManager.Task::(_updateState) Task=`b065869e-d453-48bb-8e2a-b13e2caf867e`::moving from state init -> state preparing >Thread-55437::INFO::2014-05-16 18:08:50,985::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55437::INFO::2014-05-16 18:08:50,985::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807179', 'lastCheck': '0.9', 'valid': True}} >Thread-55437::DEBUG::2014-05-16 18:08:50,986::task::1168::TaskManager.Task::(prepare) Task=`b065869e-d453-48bb-8e2a-b13e2caf867e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807179', 'lastCheck': '0.9', 'valid': True}} >Thread-55437::DEBUG::2014-05-16 18:08:50,986::task::579::TaskManager.Task::(_updateState) Task=`b065869e-d453-48bb-8e2a-b13e2caf867e`::moving from state preparing -> state finished >Thread-55437::DEBUG::2014-05-16 18:08:50,986::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55437::DEBUG::2014-05-16 18:08:50,986::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55437::DEBUG::2014-05-16 18:08:50,986::task::974::TaskManager.Task::(_decref) Task=`b065869e-d453-48bb-8e2a-b13e2caf867e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:08:52,440::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:52,507::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309327 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:54,519::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:54,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345441 s, 29.6 MB/s\n'; <rc> = 0 >Thread-55440::DEBUG::2014-05-16 18:08:54,924::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55440::DEBUG::2014-05-16 18:08:54,924::task::579::TaskManager.Task::(_updateState) Task=`85894177-0d48-4194-ac31-f4aba0941c3a`::moving from state init -> state preparing >Thread-55440::INFO::2014-05-16 18:08:54,925::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55440::INFO::2014-05-16 18:08:54,925::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55440::DEBUG::2014-05-16 18:08:54,925::task::1168::TaskManager.Task::(prepare) Task=`85894177-0d48-4194-ac31-f4aba0941c3a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55440::DEBUG::2014-05-16 18:08:54,925::task::579::TaskManager.Task::(_updateState) Task=`85894177-0d48-4194-ac31-f4aba0941c3a`::moving from state preparing -> state finished >Thread-55440::DEBUG::2014-05-16 18:08:54,925::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55440::DEBUG::2014-05-16 18:08:54,926::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55440::DEBUG::2014-05-16 18:08:54,926::task::974::TaskManager.Task::(_decref) Task=`85894177-0d48-4194-ac31-f4aba0941c3a`::ref 0 aborting False >Thread-55441::DEBUG::2014-05-16 18:08:54,934::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55441::DEBUG::2014-05-16 18:08:54,935::task::579::TaskManager.Task::(_updateState) Task=`08e703c9-72d5-486f-9abe-56bde07686e2`::moving from state init -> state preparing >Thread-55441::INFO::2014-05-16 18:08:54,935::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55441::DEBUG::2014-05-16 18:08:54,935::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b707a9a1-fd93-4efa-98b0-5e68053170af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55441::DEBUG::2014-05-16 18:08:54,935::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55441::DEBUG::2014-05-16 18:08:54,935::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55441::DEBUG::2014-05-16 18:08:54,936::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b707a9a1-fd93-4efa-98b0-5e68053170af`::Granted request >Thread-55441::DEBUG::2014-05-16 18:08:54,936::task::811::TaskManager.Task::(resourceAcquired) Task=`08e703c9-72d5-486f-9abe-56bde07686e2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55441::DEBUG::2014-05-16 18:08:54,936::task::974::TaskManager.Task::(_decref) Task=`08e703c9-72d5-486f-9abe-56bde07686e2`::ref 1 aborting False >Thread-55441::INFO::2014-05-16 18:08:54,937::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55441::DEBUG::2014-05-16 18:08:54,937::task::1168::TaskManager.Task::(prepare) Task=`08e703c9-72d5-486f-9abe-56bde07686e2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55441::DEBUG::2014-05-16 18:08:54,937::task::579::TaskManager.Task::(_updateState) Task=`08e703c9-72d5-486f-9abe-56bde07686e2`::moving from state preparing -> state finished >Thread-55441::DEBUG::2014-05-16 18:08:54,937::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55441::DEBUG::2014-05-16 18:08:54,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55441::DEBUG::2014-05-16 18:08:54,937::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55441::DEBUG::2014-05-16 18:08:54,937::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55441::DEBUG::2014-05-16 18:08:54,938::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55441::DEBUG::2014-05-16 18:08:54,938::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55441::DEBUG::2014-05-16 18:08:54,938::task::974::TaskManager.Task::(_decref) Task=`08e703c9-72d5-486f-9abe-56bde07686e2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:08:56,600::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:56,667::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301202 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:08:58,678::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:08:58,747::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316445 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:09:00,092::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:09:00,107::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000985196 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:00,758::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:00,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304841 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:02,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:02,907::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344995 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:04,918::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55445::DEBUG::2014-05-16 18:09:04,976::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55445::DEBUG::2014-05-16 18:09:04,978::task::579::TaskManager.Task::(_updateState) Task=`cbb2ef87-287c-4dae-aa02-f989e3a8f8c8`::moving from state init -> state preparing >Thread-55445::INFO::2014-05-16 18:09:04,979::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55445::INFO::2014-05-16 18:09:04,981::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55445::DEBUG::2014-05-16 18:09:04,982::task::1168::TaskManager.Task::(prepare) Task=`cbb2ef87-287c-4dae-aa02-f989e3a8f8c8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55445::DEBUG::2014-05-16 18:09:04,982::task::579::TaskManager.Task::(_updateState) Task=`cbb2ef87-287c-4dae-aa02-f989e3a8f8c8`::moving from state preparing -> state finished >Thread-55445::DEBUG::2014-05-16 18:09:04,983::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55445::DEBUG::2014-05-16 18:09:04,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55445::DEBUG::2014-05-16 18:09:04,985::task::974::TaskManager.Task::(_decref) Task=`cbb2ef87-287c-4dae-aa02-f989e3a8f8c8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:09:05,005::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344548 s, 29.7 MB/s\n'; <rc> = 0 >Thread-55446::DEBUG::2014-05-16 18:09:05,009::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55446::DEBUG::2014-05-16 18:09:05,010::task::579::TaskManager.Task::(_updateState) Task=`7d7fc6da-3451-4f0e-9f6b-e9c7d2ad151b`::moving from state init -> state preparing >Thread-55446::INFO::2014-05-16 18:09:05,011::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55446::DEBUG::2014-05-16 18:09:05,013::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`232926b3-bcc6-41cd-8f12-e7530542aa3e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55446::DEBUG::2014-05-16 18:09:05,013::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55446::DEBUG::2014-05-16 18:09:05,014::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55446::DEBUG::2014-05-16 18:09:05,015::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`232926b3-bcc6-41cd-8f12-e7530542aa3e`::Granted request >Thread-55446::DEBUG::2014-05-16 18:09:05,017::task::811::TaskManager.Task::(resourceAcquired) Task=`7d7fc6da-3451-4f0e-9f6b-e9c7d2ad151b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55446::DEBUG::2014-05-16 18:09:05,017::task::974::TaskManager.Task::(_decref) Task=`7d7fc6da-3451-4f0e-9f6b-e9c7d2ad151b`::ref 1 aborting False >Thread-55446::INFO::2014-05-16 18:09:05,020::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55446::DEBUG::2014-05-16 18:09:05,021::task::1168::TaskManager.Task::(prepare) Task=`7d7fc6da-3451-4f0e-9f6b-e9c7d2ad151b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55446::DEBUG::2014-05-16 18:09:05,021::task::579::TaskManager.Task::(_updateState) Task=`7d7fc6da-3451-4f0e-9f6b-e9c7d2ad151b`::moving from state preparing -> state finished >Thread-55446::DEBUG::2014-05-16 18:09:05,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55446::DEBUG::2014-05-16 18:09:05,023::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55446::DEBUG::2014-05-16 18:09:05,024::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55446::DEBUG::2014-05-16 18:09:05,025::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55446::DEBUG::2014-05-16 18:09:05,025::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55446::DEBUG::2014-05-16 18:09:05,026::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55446::DEBUG::2014-05-16 18:09:05,027::task::974::TaskManager.Task::(_decref) Task=`7d7fc6da-3451-4f0e-9f6b-e9c7d2ad151b`::ref 0 aborting False >Thread-55447::DEBUG::2014-05-16 18:09:06,143::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4341091.000000 / 8.008351 / 262500000.000000 = 0.206503 >Thread-55447::DEBUG::2014-05-16 18:09:06,144::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0064392781280579719, 'statsAge': 0.50956511497497559, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20650305341229933, 'rxDropped': 0} >Thread-55447::DEBUG::2014-05-16 18:09:06,144::task::579::TaskManager.Task::(_updateState) Task=`7ace8622-ffca-4d4d-b624-13f4e5562974`::moving from state init -> state preparing >Thread-55447::INFO::2014-05-16 18:09:06,144::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55447::INFO::2014-05-16 18:09:06,144::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000985196', 'lastCheck': '6.0', 'valid': True}} >Thread-55447::DEBUG::2014-05-16 18:09:06,145::task::1168::TaskManager.Task::(prepare) Task=`7ace8622-ffca-4d4d-b624-13f4e5562974`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000985196', 'lastCheck': '6.0', 'valid': True}} >Thread-55447::DEBUG::2014-05-16 18:09:06,145::task::579::TaskManager.Task::(_updateState) Task=`7ace8622-ffca-4d4d-b624-13f4e5562974`::moving from state preparing -> state finished >Thread-55447::DEBUG::2014-05-16 18:09:06,145::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55447::DEBUG::2014-05-16 18:09:06,145::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55447::DEBUG::2014-05-16 18:09:06,145::task::974::TaskManager.Task::(_decref) Task=`7ace8622-ffca-4d4d-b624-13f4e5562974`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:09:07,039::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:07,106::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305431 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:09,118::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:09,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359671 s, 28.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:09:10,142::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:09:10,153::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000778052 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:11,204::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:11,276::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350998 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:13,287::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:13,355::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314915 s, 32.5 MB/s\n'; <rc> = 0 >Thread-55451::DEBUG::2014-05-16 18:09:15,144::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55451::DEBUG::2014-05-16 18:09:15,145::task::579::TaskManager.Task::(_updateState) Task=`ea8b4cdc-12f7-4f1c-8615-342aa42b8cff`::moving from state init -> state preparing >Thread-55451::INFO::2014-05-16 18:09:15,145::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55451::INFO::2014-05-16 18:09:15,145::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55451::DEBUG::2014-05-16 18:09:15,146::task::1168::TaskManager.Task::(prepare) Task=`ea8b4cdc-12f7-4f1c-8615-342aa42b8cff`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55451::DEBUG::2014-05-16 18:09:15,146::task::579::TaskManager.Task::(_updateState) Task=`ea8b4cdc-12f7-4f1c-8615-342aa42b8cff`::moving from state preparing -> state finished >Thread-55451::DEBUG::2014-05-16 18:09:15,146::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55451::DEBUG::2014-05-16 18:09:15,146::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55451::DEBUG::2014-05-16 18:09:15,146::task::974::TaskManager.Task::(_decref) Task=`ea8b4cdc-12f7-4f1c-8615-342aa42b8cff`::ref 0 aborting False >Thread-55452::DEBUG::2014-05-16 18:09:15,168::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55452::DEBUG::2014-05-16 18:09:15,169::task::579::TaskManager.Task::(_updateState) Task=`f78eb024-b5bb-43eb-80f4-aacda61a2323`::moving from state init -> state preparing >Thread-55452::INFO::2014-05-16 18:09:15,169::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55452::DEBUG::2014-05-16 18:09:15,169::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`447bf7ad-4b89-427d-88bc-633bd8fd7d1a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55452::DEBUG::2014-05-16 18:09:15,169::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55452::DEBUG::2014-05-16 18:09:15,170::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55452::DEBUG::2014-05-16 18:09:15,170::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`447bf7ad-4b89-427d-88bc-633bd8fd7d1a`::Granted request >Thread-55452::DEBUG::2014-05-16 18:09:15,170::task::811::TaskManager.Task::(resourceAcquired) Task=`f78eb024-b5bb-43eb-80f4-aacda61a2323`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55452::DEBUG::2014-05-16 18:09:15,170::task::974::TaskManager.Task::(_decref) Task=`f78eb024-b5bb-43eb-80f4-aacda61a2323`::ref 1 aborting False >Thread-55452::INFO::2014-05-16 18:09:15,171::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55452::DEBUG::2014-05-16 18:09:15,171::task::1168::TaskManager.Task::(prepare) Task=`f78eb024-b5bb-43eb-80f4-aacda61a2323`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55452::DEBUG::2014-05-16 18:09:15,171::task::579::TaskManager.Task::(_updateState) Task=`f78eb024-b5bb-43eb-80f4-aacda61a2323`::moving from state preparing -> state finished >Thread-55452::DEBUG::2014-05-16 18:09:15,172::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55452::DEBUG::2014-05-16 18:09:15,172::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55452::DEBUG::2014-05-16 18:09:15,172::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55452::DEBUG::2014-05-16 18:09:15,172::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55452::DEBUG::2014-05-16 18:09:15,172::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55452::DEBUG::2014-05-16 18:09:15,172::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55452::DEBUG::2014-05-16 18:09:15,173::task::974::TaskManager.Task::(_decref) Task=`f78eb024-b5bb-43eb-80f4-aacda61a2323`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:09:15,366::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:15,438::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353972 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:17,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:17,517::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312993 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:19,528::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:19,599::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348174 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:09:20,189::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:09:20,200::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000779525 s, 5.3 MB/s\n'; <rc> = 0 >Thread-55455::DEBUG::2014-05-16 18:09:21,371::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313754.000000 / 8.008489 / 262500000.000000 = 0.205199 >Thread-55455::DEBUG::2014-05-16 18:09:21,372::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053653543788027159, 'statsAge': 1.7227320671081543, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20519911796029622, 'rxDropped': 0} >Thread-55455::DEBUG::2014-05-16 18:09:21,372::task::579::TaskManager.Task::(_updateState) Task=`28a70396-5bf0-4f60-b02b-596678cb4062`::moving from state init -> state preparing >Thread-55455::INFO::2014-05-16 18:09:21,372::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55455::INFO::2014-05-16 18:09:21,373::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000779525', 'lastCheck': '1.2', 'valid': True}} >Thread-55455::DEBUG::2014-05-16 18:09:21,373::task::1168::TaskManager.Task::(prepare) Task=`28a70396-5bf0-4f60-b02b-596678cb4062`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000779525', 'lastCheck': '1.2', 'valid': True}} >Thread-55455::DEBUG::2014-05-16 18:09:21,373::task::579::TaskManager.Task::(_updateState) Task=`28a70396-5bf0-4f60-b02b-596678cb4062`::moving from state preparing -> state finished >Thread-55455::DEBUG::2014-05-16 18:09:21,373::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55455::DEBUG::2014-05-16 18:09:21,373::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55455::DEBUG::2014-05-16 18:09:21,373::task::974::TaskManager.Task::(_decref) Task=`28a70396-5bf0-4f60-b02b-596678cb4062`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:09:21,611::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:21,683::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302774 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:23,694::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:23,767::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359199 s, 28.5 MB/s\n'; <rc> = 0 >Thread-55458::DEBUG::2014-05-16 18:09:25,306::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55458::DEBUG::2014-05-16 18:09:25,306::task::579::TaskManager.Task::(_updateState) Task=`4683edc5-7cb6-4d73-a53c-9c124f35c4f4`::moving from state init -> state preparing >Thread-55458::INFO::2014-05-16 18:09:25,306::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55458::INFO::2014-05-16 18:09:25,307::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55458::DEBUG::2014-05-16 18:09:25,307::task::1168::TaskManager.Task::(prepare) Task=`4683edc5-7cb6-4d73-a53c-9c124f35c4f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55458::DEBUG::2014-05-16 18:09:25,307::task::579::TaskManager.Task::(_updateState) Task=`4683edc5-7cb6-4d73-a53c-9c124f35c4f4`::moving from state preparing -> state finished >Thread-55458::DEBUG::2014-05-16 18:09:25,307::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55458::DEBUG::2014-05-16 18:09:25,307::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55458::DEBUG::2014-05-16 18:09:25,307::task::974::TaskManager.Task::(_decref) Task=`4683edc5-7cb6-4d73-a53c-9c124f35c4f4`::ref 0 aborting False >Thread-55459::DEBUG::2014-05-16 18:09:25,318::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55459::DEBUG::2014-05-16 18:09:25,318::task::579::TaskManager.Task::(_updateState) Task=`5629d810-3c9b-47b3-ba3b-ff0d8a5fc55b`::moving from state init -> state preparing >Thread-55459::INFO::2014-05-16 18:09:25,318::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55459::DEBUG::2014-05-16 18:09:25,319::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d58eaee9-cacc-480c-8e70-d83074e09fdb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55459::DEBUG::2014-05-16 18:09:25,319::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55459::DEBUG::2014-05-16 18:09:25,319::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55459::DEBUG::2014-05-16 18:09:25,319::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d58eaee9-cacc-480c-8e70-d83074e09fdb`::Granted request >Thread-55459::DEBUG::2014-05-16 18:09:25,319::task::811::TaskManager.Task::(resourceAcquired) Task=`5629d810-3c9b-47b3-ba3b-ff0d8a5fc55b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55459::DEBUG::2014-05-16 18:09:25,319::task::974::TaskManager.Task::(_decref) Task=`5629d810-3c9b-47b3-ba3b-ff0d8a5fc55b`::ref 1 aborting False >Thread-55459::INFO::2014-05-16 18:09:25,320::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55459::DEBUG::2014-05-16 18:09:25,320::task::1168::TaskManager.Task::(prepare) Task=`5629d810-3c9b-47b3-ba3b-ff0d8a5fc55b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55459::DEBUG::2014-05-16 18:09:25,320::task::579::TaskManager.Task::(_updateState) Task=`5629d810-3c9b-47b3-ba3b-ff0d8a5fc55b`::moving from state preparing -> state finished >Thread-55459::DEBUG::2014-05-16 18:09:25,320::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55459::DEBUG::2014-05-16 18:09:25,321::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55459::DEBUG::2014-05-16 18:09:25,321::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55459::DEBUG::2014-05-16 18:09:25,321::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55459::DEBUG::2014-05-16 18:09:25,321::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55459::DEBUG::2014-05-16 18:09:25,321::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55459::DEBUG::2014-05-16 18:09:25,321::task::974::TaskManager.Task::(_decref) Task=`5629d810-3c9b-47b3-ba3b-ff0d8a5fc55b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:09:25,778::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:25,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304623 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:27,856::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:27,923::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311303 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:29,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:30,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353955 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:09:30,236::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:09:30,247::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000856644 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:32,018::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:32,085::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313031 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:34,096::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:34,164::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316516 s, 32.4 MB/s\n'; <rc> = 0 >Thread-55463::DEBUG::2014-05-16 18:09:34,807::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [5d705734] >Thread-55463::DEBUG::2014-05-16 18:09:34,808::task::579::TaskManager.Task::(_updateState) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::moving from state init -> state preparing >Thread-55463::INFO::2014-05-16 18:09:34,808::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='1bc8999f-f8c1-4144-bc96-05d43428080a', size='34359738368', volFormat=4, preallocate=2, diskType=2, volUUID='5eb31ec3-0351-420b-bee1-03bf96920f43', desc='', srcImgUUID='7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', srcVolUUID='77c78124-ee6c-46b1-9112-a738f448beca') >Thread-55463::DEBUG::2014-05-16 18:09:34,809::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`1ec45bbb-8cac-4876-bcaf-e59b126e9dd4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1484' at 'createVolume' >Thread-55463::DEBUG::2014-05-16 18:09:34,809::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55463::DEBUG::2014-05-16 18:09:34,809::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55463::DEBUG::2014-05-16 18:09:34,809::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`1ec45bbb-8cac-4876-bcaf-e59b126e9dd4`::Granted request >Thread-55463::DEBUG::2014-05-16 18:09:34,809::task::811::TaskManager.Task::(resourceAcquired) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55463::DEBUG::2014-05-16 18:09:34,810::task::974::TaskManager.Task::(_decref) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::ref 1 aborting False >Thread-55463::DEBUG::2014-05-16 18:09:34,811::task::736::TaskManager.Task::(_save) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a.temp >Thread-55463::DEBUG::2014-05-16 18:09:34,816::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 3f15a681-112c-4f3c-9bff-cb8773f02b1a >Thread-55463::INFO::2014-05-16 18:09:34,817::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-55463::DEBUG::2014-05-16 18:09:34,817::task::1163::TaskManager.Task::(prepare) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::Prepare: 1 jobs exist, move to acquiring >Thread-55463::DEBUG::2014-05-16 18:09:34,817::task::579::TaskManager.Task::(_updateState) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::moving from state preparing -> state acquiring >Thread-55463::DEBUG::2014-05-16 18:09:34,817::task::736::TaskManager.Task::(_save) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a.temp >Thread-55463::DEBUG::2014-05-16 18:09:34,823::task::579::TaskManager.Task::(_updateState) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::moving from state acquiring -> state queued >Thread-55463::DEBUG::2014-05-16 18:09:34,823::task::736::TaskManager.Task::(_save) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a.temp >Thread-55463::DEBUG::2014-05-16 18:09:34,828::taskManager::50::TaskManager::(_queueTask) queuing task: 3f15a681-112c-4f3c-9bff-cb8773f02b1a >Thread-55463::DEBUG::2014-05-16 18:09:34,829::taskManager::56::TaskManager::(_queueTask) task queued: 3f15a681-112c-4f3c-9bff-cb8773f02b1a >f97a28c2-612e-47c6-8a7c-43fb87d45560::DEBUG::2014-05-16 18:09:34,829::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:34,830::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 3f15a681-112c-4f3c-9bff-cb8773f02b1a running: <bound method Task.commit of <storage.task.Task instance at 0x7ff534471638>> with: None >Thread-55463::DEBUG::2014-05-16 18:09:34,830::task::1165::TaskManager.Task::(prepare) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::returning >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:34,831::task::1176::TaskManager.Task::(commit) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::committing task: 3f15a681-112c-4f3c-9bff-cb8773f02b1a >Thread-55463::DEBUG::2014-05-16 18:09:34,832::task::974::TaskManager.Task::(_decref) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::ref 0 aborting False >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:34,832::task::579::TaskManager.Task::(_updateState) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::moving from state queued -> state running >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:34,834::task::736::TaskManager.Task::(_save) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a.temp >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:34,840::task::889::TaskManager.Task::(_runJobs) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x2b04510>> (args: ('f79908bf-a757-4a71-9ab5-3a12ede5f65c', '1bc8999f-f8c1-4144-bc96-05d43428080a', 67108864, 4, 2, 2, '5eb31ec3-0351-420b-bee1-03bf96920f43', '', '7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', '77c78124-ee6c-46b1-9112-a738f448beca') kwargs: {}) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:34,840::task::315::TaskManager.Task::(run) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x2b04510>> (args: ('f79908bf-a757-4a71-9ab5-3a12ede5f65c', '1bc8999f-f8c1-4144-bc96-05d43428080a', 67108864, 4, 2, 2, '5eb31ec3-0351-420b-bee1-03bf96920f43', '', '7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', '77c78124-ee6c-46b1-9112-a738f448beca') kwargs: {}) callback None >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:34,840::resourceManager::197::ResourceManager.Request::(__init__) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.1bc8999f-f8c1-4144-bc96-05d43428080a`ReqID=`3263dd3c-6f0d-4685-97e6-c99a549162ed`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1895' at 'createVolume' >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:34,840::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.1bc8999f-f8c1-4144-bc96-05d43428080a' for lock type 'exclusive' >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:34,841::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:34,841::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:34,991::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,004::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,005::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,005::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 1bc8999f-f8c1-4144-bc96-05d43428080a does not exist in domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,005::resourceManager::600::ResourceManager::(registerResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.1bc8999f-f8c1-4144-bc96-05d43428080a' is free. Now locking as 'exclusive' (1 active user) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,005::resourceManager::237::ResourceManager.Request::(grant) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.1bc8999f-f8c1-4144-bc96-05d43428080a`ReqID=`3263dd3c-6f0d-4685-97e6-c99a549162ed`::Granted request >3f15a681-112c-4f3c-9bff-cb8773f02b1a::INFO::2014-05-16 18:09:35,006::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a for image's volumes >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,007::task::736::TaskManager.Task::(_save) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a.temp >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,032::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,041::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000511361 s, 1.0 MB/s\n'; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,041::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000511361 s, 1.0 MB/s'], size: 512 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,041::volume::300::Storage.Volume::(share) Share volume 77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,060::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,068::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000510072 s, 1.0 MB/s\n'; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,069::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000510072 s, 1.0 MB/s'], size: 512 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,069::task::736::TaskManager.Task::(_save) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a.temp >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,076::blockVolume::380::Storage.Volume::(_share) Share volume 77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,096::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,104::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000514631 s, 995 kB/s\n'; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,105::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000514631 s, 995 kB/s'], size: 512 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::INFO::2014-05-16 18:09:35,105::volume::446::Storage.Volume::(create) Creating volume 5eb31ec3-0351-420b-bee1-03bf96920f43 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,105::task::736::TaskManager.Task::(_save) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a.temp >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,114::task::736::TaskManager.Task::(_save) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a.temp >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,122::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 5eb31ec3-0351-420b-bee1-03bf96920f43 f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,308::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,308::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,309::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,309::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,309::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::WARNING::2014-05-16 18:09:35,310::utils::114::root::(rmFile) File: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43 already removed >3f15a681-112c-4f3c-9bff-cb8773f02b1a::INFO::2014-05-16 18:09:35,311::blockVolume::196::Storage.Volume::(_create) Request to create snapshot 1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43 of volume 7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96/77c78124-ee6c-46b1-9112-a738f448beca >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,312::task::736::TaskManager.Task::(_save) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a.temp >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,345::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,354::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000509218 s, 1.0 MB/s\n'; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,354::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000509218 s, 1.0 MB/s'], size: 512 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::INFO::2014-05-16 18:09:35,355::volume::793::Storage.Volume::(prepare) Volume: preparing volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,381::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,390::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000516075 s, 992 kB/s\n'; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,390::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000516075 s, 992 kB/s'], size: 512 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,391::resourceManager::197::ResourceManager.Request::(__init__) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca`ReqID=`4d540fbe-ec8c-4b82-b478-d62d84f73295`::Request was made in '/usr/share/vdsm/storage/volume.py' line '810' at 'prepare' >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,391::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' for lock type 'shared' >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,391::resourceManager::600::ResourceManager::(registerResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' is free. Now locking as 'shared' (1 active user) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,391::resourceManager::237::ResourceManager.Request::(grant) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca`ReqID=`4d540fbe-ec8c-4b82-b478-d62d84f73295`::Granted request >Thread-55464::DEBUG::2014-05-16 18:09:35,397::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55464::DEBUG::2014-05-16 18:09:35,399::task::579::TaskManager.Task::(_updateState) Task=`abd40005-87a0-485b-bcc0-a6cdc19118a5`::moving from state init -> state preparing >Thread-55464::INFO::2014-05-16 18:09:35,400::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55464::INFO::2014-05-16 18:09:35,402::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55464::DEBUG::2014-05-16 18:09:35,403::task::1168::TaskManager.Task::(prepare) Task=`abd40005-87a0-485b-bcc0-a6cdc19118a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55464::DEBUG::2014-05-16 18:09:35,404::task::579::TaskManager.Task::(_updateState) Task=`abd40005-87a0-485b-bcc0-a6cdc19118a5`::moving from state preparing -> state finished >Thread-55464::DEBUG::2014-05-16 18:09:35,405::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55464::DEBUG::2014-05-16 18:09:35,406::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55464::DEBUG::2014-05-16 18:09:35,407::task::974::TaskManager.Task::(_decref) Task=`abd40005-87a0-485b-bcc0-a6cdc19118a5`::ref 0 aborting False >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,429::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-55465::DEBUG::2014-05-16 18:09:35,441::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55465::DEBUG::2014-05-16 18:09:35,442::task::579::TaskManager.Task::(_updateState) Task=`a7ebbcda-4815-4ef6-afb9-bdfd22d2eee0`::moving from state init -> state preparing >Thread-55465::INFO::2014-05-16 18:09:35,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,445::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000414663 s, 1.2 MB/s\n'; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,446::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000414663 s, 1.2 MB/s'], size: 512 >Thread-55465::DEBUG::2014-05-16 18:09:35,446::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`01fe081c-b5a1-4f6f-a724-487cc5b32508`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,447::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43 >Thread-55465::DEBUG::2014-05-16 18:09:35,447::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55465::DEBUG::2014-05-16 18:09:35,449::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55465::DEBUG::2014-05-16 18:09:35,449::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`01fe081c-b5a1-4f6f-a724-487cc5b32508`::Granted request >Thread-55465::DEBUG::2014-05-16 18:09:35,452::task::811::TaskManager.Task::(resourceAcquired) Task=`a7ebbcda-4815-4ef6-afb9-bdfd22d2eee0`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55465::DEBUG::2014-05-16 18:09:35,453::task::974::TaskManager.Task::(_decref) Task=`a7ebbcda-4815-4ef6-afb9-bdfd22d2eee0`::ref 1 aborting False >Thread-55465::DEBUG::2014-05-16 18:09:35,456::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-55465::DEBUG::2014-05-16 18:09:35,462::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,488::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,497::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000490151 s, 1.0 MB/s\n'; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,497::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000490151 s, 1.0 MB/s'], size: 512 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,516::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,525::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000511129 s, 1.0 MB/s\n'; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,525::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000511129 s, 1.0 MB/s'], size: 512 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,526::volume::1058::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../1bc8999f-f8c1-4144-bc96-05d43428080a/77c78124-ee6c-46b1-9112-a738f448beca /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43' (cwd /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,566::volume::1058::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::INFO::2014-05-16 18:09:35,567::blockVolume::420::Storage.Volume::(teardown) Tearing down volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca justme False >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,567::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,567::resourceManager::634::ResourceManager::(releaseResource) Released resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' (0 active users) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,567::resourceManager::640::ResourceManager::(releaseResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' is free, finding out if anyone is waiting for it. >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,568::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca' (cwd None) >Thread-55465::DEBUG::2014-05-16 18:09:35,620::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55465::DEBUG::2014-05-16 18:09:35,622::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-55465::INFO::2014-05-16 18:09:35,623::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55465::DEBUG::2014-05-16 18:09:35,623::task::1168::TaskManager.Task::(prepare) Task=`a7ebbcda-4815-4ef6-afb9-bdfd22d2eee0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55465::DEBUG::2014-05-16 18:09:35,623::task::579::TaskManager.Task::(_updateState) Task=`a7ebbcda-4815-4ef6-afb9-bdfd22d2eee0`::moving from state preparing -> state finished >Thread-55465::DEBUG::2014-05-16 18:09:35,623::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55465::DEBUG::2014-05-16 18:09:35,623::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55465::DEBUG::2014-05-16 18:09:35,624::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55465::DEBUG::2014-05-16 18:09:35,624::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55465::DEBUG::2014-05-16 18:09:35,624::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55465::DEBUG::2014-05-16 18:09:35,624::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55465::DEBUG::2014-05-16 18:09:35,625::task::974::TaskManager.Task::(_decref) Task=`a7ebbcda-4815-4ef6-afb9-bdfd22d2eee0`::ref 0 aborting False >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,731::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,731::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,731::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,732::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca', Clearing records. >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,732::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,732::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,881::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,895::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,895::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,896::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:35,896::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,041::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,057::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,057::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::WARNING::2014-05-16 18:09:36,057::blockSD::743::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv f79908bf-a757-4a71-9ab5-3a12ede5f65c/5eb31ec3-0351-420b-bee1-03bf96920f43 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,057::blockSD::766::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 15 in VG f79908bf-a757-4a71-9ab5-3a12ede5f65c >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,058::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_15 --addtag IU_1bc8999f-f8c1-4144-bc96-05d43428080a --addtag PU_77c78124-ee6c-46b1-9112-a738f448beca f79908bf-a757-4a71-9ab5-3a12ede5f65c/5eb31ec3-0351-420b-bee1-03bf96920f43' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:36,175::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,250::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,253::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,255::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,263::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/5eb31ec3-0351-420b-bee1-03bf96920f43' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:36,289::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411494 s, 24.9 MB/s\n'; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,420::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,420::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,421::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,422::task::736::TaskManager.Task::(_save) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a.temp >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,452::blockVolume::622::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=5eb31ec3-0351-420b-bee1-03bf96920f43 sdUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c, metaId=('f79908bf-a757-4a71-9ab5-3a12ede5f65c', 15) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,467::task::736::TaskManager.Task::(_save) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a.temp >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,477::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.1bc8999f-f8c1-4144-bc96-05d43428080a' >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,477::resourceManager::634::ResourceManager::(releaseResource) Released resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.1bc8999f-f8c1-4144-bc96-05d43428080a' (0 active users) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,477::resourceManager::640::ResourceManager::(releaseResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.1bc8999f-f8c1-4144-bc96-05d43428080a' is free, finding out if anyone is waiting for it. >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,477::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.1bc8999f-f8c1-4144-bc96-05d43428080a', Clearing records. >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,478::task::579::TaskManager.Task::(_updateState) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::moving from state running -> state finished >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,478::task::736::TaskManager.Task::(_save) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3f15a681-112c-4f3c-9bff-cb8773f02b1a.temp >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,489::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,489::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,490::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,490::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,490::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,490::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,491::task::897::TaskManager.Task::(_runJobs) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::Task.run: exit - success: result {'uuid': '5eb31ec3-0351-420b-bee1-03bf96920f43'} >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,491::task::974::TaskManager.Task::(_decref) Task=`3f15a681-112c-4f3c-9bff-cb8773f02b1a`::ref 0 aborting False >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:09:36,491::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-55466::DEBUG::2014-05-16 18:09:36,607::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314097.000000 / 8.008245 / 262500000.000000 = 0.205222 >Thread-55466::DEBUG::2014-05-16 18:09:36,607::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051149189184410398, 'statsAge': 0.93856382369995117, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20522168410112845, 'rxDropped': 0} >Thread-55466::DEBUG::2014-05-16 18:09:36,608::task::579::TaskManager.Task::(_updateState) Task=`72aac961-05bb-4678-a618-69780c5ef337`::moving from state init -> state preparing >Thread-55466::INFO::2014-05-16 18:09:36,608::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55466::INFO::2014-05-16 18:09:36,608::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000856644', 'lastCheck': '6.3', 'valid': True}} >Thread-55466::DEBUG::2014-05-16 18:09:36,608::task::1168::TaskManager.Task::(prepare) Task=`72aac961-05bb-4678-a618-69780c5ef337`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000856644', 'lastCheck': '6.3', 'valid': True}} >Thread-55466::DEBUG::2014-05-16 18:09:36,608::task::579::TaskManager.Task::(_updateState) Task=`72aac961-05bb-4678-a618-69780c5ef337`::moving from state preparing -> state finished >Thread-55466::DEBUG::2014-05-16 18:09:36,609::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55466::DEBUG::2014-05-16 18:09:36,609::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55466::DEBUG::2014-05-16 18:09:36,609::task::974::TaskManager.Task::(_decref) Task=`72aac961-05bb-4678-a618-69780c5ef337`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:09:38,299::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:38,367::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314042 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:09:40,280::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:09:40,291::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103052 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:40,378::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:40,450::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356053 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:42,462::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:42,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354297 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55470::DEBUG::2014-05-16 18:09:43,182::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55470::DEBUG::2014-05-16 18:09:43,183::task::579::TaskManager.Task::(_updateState) Task=`97ea50a8-c6da-460a-b8a8-0e7899cb9cc0`::moving from state init -> state preparing >Thread-55470::INFO::2014-05-16 18:09:43,183::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-55470::DEBUG::2014-05-16 18:09:43,183::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-55470::DEBUG::2014-05-16 18:09:43,183::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 3f15a681-112c-4f3c-9bff-cb8773f02b1a >Thread-55470::DEBUG::2014-05-16 18:09:43,183::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3f15a681-112c-4f3c-9bff-cb8773f02b1a'} >Thread-55470::DEBUG::2014-05-16 18:09:43,184::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'3f15a681-112c-4f3c-9bff-cb8773f02b1a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3f15a681-112c-4f3c-9bff-cb8773f02b1a'}} >Thread-55470::INFO::2014-05-16 18:09:43,184::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'3f15a681-112c-4f3c-9bff-cb8773f02b1a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3f15a681-112c-4f3c-9bff-cb8773f02b1a'}}} >Thread-55470::DEBUG::2014-05-16 18:09:43,184::task::1168::TaskManager.Task::(prepare) Task=`97ea50a8-c6da-460a-b8a8-0e7899cb9cc0`::finished: {'allTasksStatus': {'3f15a681-112c-4f3c-9bff-cb8773f02b1a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3f15a681-112c-4f3c-9bff-cb8773f02b1a'}}} >Thread-55470::DEBUG::2014-05-16 18:09:43,184::task::579::TaskManager.Task::(_updateState) Task=`97ea50a8-c6da-460a-b8a8-0e7899cb9cc0`::moving from state preparing -> state finished >Thread-55470::DEBUG::2014-05-16 18:09:43,184::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55470::DEBUG::2014-05-16 18:09:43,184::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55470::DEBUG::2014-05-16 18:09:43,184::task::974::TaskManager.Task::(_decref) Task=`97ea50a8-c6da-460a-b8a8-0e7899cb9cc0`::ref 0 aborting False >Thread-55471::DEBUG::2014-05-16 18:09:43,482::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [5d705734] >Thread-55471::DEBUG::2014-05-16 18:09:43,482::task::579::TaskManager.Task::(_updateState) Task=`d54313c8-37a6-4d30-8c25-c86313df5029`::moving from state init -> state preparing >Thread-55471::INFO::2014-05-16 18:09:43,483::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='1bc8999f-f8c1-4144-bc96-05d43428080a', volUUID='5eb31ec3-0351-420b-bee1-03bf96920f43', options=None) >Thread-55471::DEBUG::2014-05-16 18:09:43,483::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`7a32e776-2777-4bd8-9927-dc41513ab225`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3104' at 'getVolumeInfo' >Thread-55471::DEBUG::2014-05-16 18:09:43,483::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55471::DEBUG::2014-05-16 18:09:43,483::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55471::DEBUG::2014-05-16 18:09:43,483::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`7a32e776-2777-4bd8-9927-dc41513ab225`::Granted request >Thread-55471::DEBUG::2014-05-16 18:09:43,484::task::811::TaskManager.Task::(resourceAcquired) Task=`d54313c8-37a6-4d30-8c25-c86313df5029`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55471::DEBUG::2014-05-16 18:09:43,484::task::974::TaskManager.Task::(_decref) Task=`d54313c8-37a6-4d30-8c25-c86313df5029`::ref 1 aborting False >Thread-55471::DEBUG::2014-05-16 18:09:43,484::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55471::DEBUG::2014-05-16 18:09:43,485::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55471::DEBUG::2014-05-16 18:09:43,628::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55471::DEBUG::2014-05-16 18:09:43,644::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55471::DEBUG::2014-05-16 18:09:43,644::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55471::INFO::2014-05-16 18:09:43,645::volume::883::Storage.Volume::(getInfo) Info request: sdUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c imgUUID=1bc8999f-f8c1-4144-bc96-05d43428080a volUUID = 5eb31ec3-0351-420b-bee1-03bf96920f43 >Thread-55471::DEBUG::2014-05-16 18:09:43,663::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-55471::DEBUG::2014-05-16 18:09:43,672::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000524604 s, 976 kB/s\n'; <rc> = 0 >Thread-55471::DEBUG::2014-05-16 18:09:43,672::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000524604 s, 976 kB/s'], size: 512 >Thread-55471::DEBUG::2014-05-16 18:09:43,696::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-55471::DEBUG::2014-05-16 18:09:43,704::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000439413 s, 1.2 MB/s\n'; <rc> = 0 >Thread-55471::DEBUG::2014-05-16 18:09:43,705::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000439413 s, 1.2 MB/s'], size: 512 >Thread-55471::DEBUG::2014-05-16 18:09:43,705::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55471::DEBUG::2014-05-16 18:09:43,706::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55471::DEBUG::2014-05-16 18:09:43,849::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55471::DEBUG::2014-05-16 18:09:43,864::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55471::DEBUG::2014-05-16 18:09:43,864::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55471::INFO::2014-05-16 18:09:43,865::volume::912::Storage.Volume::(getInfo) f79908bf-a757-4a71-9ab5-3a12ede5f65c/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43 info is {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': '1bc8999f-f8c1-4144-bc96-05d43428080a', 'ctime': '1400263776', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400263776', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-55471::INFO::2014-05-16 18:09:43,865::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': '1bc8999f-f8c1-4144-bc96-05d43428080a', 'ctime': '1400263776', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400263776', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-55471::DEBUG::2014-05-16 18:09:43,865::task::1168::TaskManager.Task::(prepare) Task=`d54313c8-37a6-4d30-8c25-c86313df5029`::finished: {'info': {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': '1bc8999f-f8c1-4144-bc96-05d43428080a', 'ctime': '1400263776', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400263776', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-55471::DEBUG::2014-05-16 18:09:43,865::task::579::TaskManager.Task::(_updateState) Task=`d54313c8-37a6-4d30-8c25-c86313df5029`::moving from state preparing -> state finished >Thread-55471::DEBUG::2014-05-16 18:09:43,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55471::DEBUG::2014-05-16 18:09:43,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55471::DEBUG::2014-05-16 18:09:43,866::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55471::DEBUG::2014-05-16 18:09:43,866::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55471::DEBUG::2014-05-16 18:09:43,866::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55471::DEBUG::2014-05-16 18:09:43,867::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55471::DEBUG::2014-05-16 18:09:43,867::task::974::TaskManager.Task::(_decref) Task=`d54313c8-37a6-4d30-8c25-c86313df5029`::ref 0 aborting False >Thread-55472::DEBUG::2014-05-16 18:09:43,945::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55472::DEBUG::2014-05-16 18:09:43,945::task::579::TaskManager.Task::(_updateState) Task=`2c130eb1-f31c-4a69-ba9d-dc03f0b2f109`::moving from state init -> state preparing >Thread-55472::INFO::2014-05-16 18:09:43,946::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='3f15a681-112c-4f3c-9bff-cb8773f02b1a', spUUID=None, options=None) >Thread-55472::DEBUG::2014-05-16 18:09:43,946::taskManager::161::TaskManager::(clearTask) Entry. taskID: 3f15a681-112c-4f3c-9bff-cb8773f02b1a >Thread-55472::DEBUG::2014-05-16 18:09:43,947::taskManager::166::TaskManager::(clearTask) Return. >Thread-55472::INFO::2014-05-16 18:09:43,947::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-55472::DEBUG::2014-05-16 18:09:43,947::task::1168::TaskManager.Task::(prepare) Task=`2c130eb1-f31c-4a69-ba9d-dc03f0b2f109`::finished: None >Thread-55472::DEBUG::2014-05-16 18:09:43,947::task::579::TaskManager.Task::(_updateState) Task=`2c130eb1-f31c-4a69-ba9d-dc03f0b2f109`::moving from state preparing -> state finished >Thread-55472::DEBUG::2014-05-16 18:09:43,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55472::DEBUG::2014-05-16 18:09:43,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55472::DEBUG::2014-05-16 18:09:43,948::task::974::TaskManager.Task::(_decref) Task=`2c130eb1-f31c-4a69-ba9d-dc03f0b2f109`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:09:44,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:44,618::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352769 s, 29.0 MB/s\n'; <rc> = 0 >Thread-55473::DEBUG::2014-05-16 18:09:45,688::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55473::DEBUG::2014-05-16 18:09:45,689::task::579::TaskManager.Task::(_updateState) Task=`27bb34e3-dcfc-4aed-a53e-9315a16c131d`::moving from state init -> state preparing >Thread-55473::INFO::2014-05-16 18:09:45,689::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55473::INFO::2014-05-16 18:09:45,690::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55473::DEBUG::2014-05-16 18:09:45,690::task::1168::TaskManager.Task::(prepare) Task=`27bb34e3-dcfc-4aed-a53e-9315a16c131d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55473::DEBUG::2014-05-16 18:09:45,690::task::579::TaskManager.Task::(_updateState) Task=`27bb34e3-dcfc-4aed-a53e-9315a16c131d`::moving from state preparing -> state finished >Thread-55473::DEBUG::2014-05-16 18:09:45,690::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55473::DEBUG::2014-05-16 18:09:45,691::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55473::DEBUG::2014-05-16 18:09:45,691::task::974::TaskManager.Task::(_decref) Task=`27bb34e3-dcfc-4aed-a53e-9315a16c131d`::ref 0 aborting False >Thread-55474::DEBUG::2014-05-16 18:09:45,699::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55474::DEBUG::2014-05-16 18:09:45,700::task::579::TaskManager.Task::(_updateState) Task=`4391b12d-e3d5-4502-a64f-4a6aaebbbbbd`::moving from state init -> state preparing >Thread-55474::INFO::2014-05-16 18:09:45,700::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55474::DEBUG::2014-05-16 18:09:45,700::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e4f1e524-48a0-401a-ad91-d7d5ac86d956`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55474::DEBUG::2014-05-16 18:09:45,700::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55474::DEBUG::2014-05-16 18:09:45,701::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55474::DEBUG::2014-05-16 18:09:45,701::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e4f1e524-48a0-401a-ad91-d7d5ac86d956`::Granted request >Thread-55474::DEBUG::2014-05-16 18:09:45,701::task::811::TaskManager.Task::(resourceAcquired) Task=`4391b12d-e3d5-4502-a64f-4a6aaebbbbbd`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55474::DEBUG::2014-05-16 18:09:45,701::task::974::TaskManager.Task::(_decref) Task=`4391b12d-e3d5-4502-a64f-4a6aaebbbbbd`::ref 1 aborting False >Thread-55474::INFO::2014-05-16 18:09:45,702::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55474::DEBUG::2014-05-16 18:09:45,702::task::1168::TaskManager.Task::(prepare) Task=`4391b12d-e3d5-4502-a64f-4a6aaebbbbbd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55474::DEBUG::2014-05-16 18:09:45,702::task::579::TaskManager.Task::(_updateState) Task=`4391b12d-e3d5-4502-a64f-4a6aaebbbbbd`::moving from state preparing -> state finished >Thread-55474::DEBUG::2014-05-16 18:09:45,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55474::DEBUG::2014-05-16 18:09:45,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55474::DEBUG::2014-05-16 18:09:45,703::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55474::DEBUG::2014-05-16 18:09:45,703::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55474::DEBUG::2014-05-16 18:09:45,703::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55474::DEBUG::2014-05-16 18:09:45,703::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55474::DEBUG::2014-05-16 18:09:45,703::task::974::TaskManager.Task::(_decref) Task=`4391b12d-e3d5-4502-a64f-4a6aaebbbbbd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:09:46,630::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:46,697::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307866 s, 33.3 MB/s\n'; <rc> = 0 >Thread-55476::DEBUG::2014-05-16 18:09:48,496::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [61ae572c] >Thread-55476::DEBUG::2014-05-16 18:09:48,496::task::579::TaskManager.Task::(_updateState) Task=`7d5e815c-407e-43bb-b50b-649ea934aa7e`::moving from state init -> state preparing >Thread-55476::INFO::2014-05-16 18:09:48,497::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55476::DEBUG::2014-05-16 18:09:48,497::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7948db6b-25c2-4860-924c-c0df4a341e1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55476::DEBUG::2014-05-16 18:09:48,497::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55476::DEBUG::2014-05-16 18:09:48,497::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55476::DEBUG::2014-05-16 18:09:48,498::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7948db6b-25c2-4860-924c-c0df4a341e1b`::Granted request >Thread-55476::DEBUG::2014-05-16 18:09:48,498::task::811::TaskManager.Task::(resourceAcquired) Task=`7d5e815c-407e-43bb-b50b-649ea934aa7e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55476::DEBUG::2014-05-16 18:09:48,498::task::974::TaskManager.Task::(_decref) Task=`7d5e815c-407e-43bb-b50b-649ea934aa7e`::ref 1 aborting False >Thread-55476::INFO::2014-05-16 18:09:48,499::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55476::DEBUG::2014-05-16 18:09:48,499::task::1168::TaskManager.Task::(prepare) Task=`7d5e815c-407e-43bb-b50b-649ea934aa7e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55476::DEBUG::2014-05-16 18:09:48,499::task::579::TaskManager.Task::(_updateState) Task=`7d5e815c-407e-43bb-b50b-649ea934aa7e`::moving from state preparing -> state finished >Thread-55476::DEBUG::2014-05-16 18:09:48,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55476::DEBUG::2014-05-16 18:09:48,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55476::DEBUG::2014-05-16 18:09:48,500::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55476::DEBUG::2014-05-16 18:09:48,500::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55476::DEBUG::2014-05-16 18:09:48,500::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55476::DEBUG::2014-05-16 18:09:48,500::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55476::DEBUG::2014-05-16 18:09:48,500::task::974::TaskManager.Task::(_decref) Task=`7d5e815c-407e-43bb-b50b-649ea934aa7e`::ref 0 aborting False >Thread-55477::DEBUG::2014-05-16 18:09:48,645::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmCreate with ({'custom': {'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9ddevice_9abad8b1-cceb-474e-8e8c-2aa2bea117bedevice_df4252e7-74de-4999-a70c-8b4e9d6b1958': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=df4252e7-74de-4999-a70c-8b4e9d6b1958, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9ddevice_9abad8b1-cceb-474e-8e8c-2aa2bea117bedevice_df4252e7-74de-4999-a70c-8b4e9d6b1958device_f51f6d29-d633-4597-b32b-1f6b82866849': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=f51f6d29-d633-4597-b32b-1f6b82866849, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9d': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9d, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9ddevice_9abad8b1-cceb-474e-8e8c-2aa2bea117be': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=9abad8b1-cceb-474e-8e8c-2aa2bea117be, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fb': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=4d250972-4b6a-4fd5-8d95-288bdc0da4fb, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'cpuType': 'Nehalem', 'vmId': 'd2f76d20-1d18-4a21-b631-f32987b77d5c', 'devices': [{'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bWluZTwvQ29tcHV0ZXJOYW1lPg0KICAg\nICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1JlZ2lzdGVyZWRP\ncmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8L1JlZ2lzdGVy\nZWRPd25lcj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0i\nTWljcm9zb2Z0LVdpbmRvd3MtVW5hdHRlbmRlZEpvaW4iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0i\neDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwi\nIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29m\ndC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcv\nMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElkZW50aWZpY2F0aW9uPg0K\nICAgICAgICAgICAgICAgIDxDcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICAgICAgPERvbWFp\nbj48L0RvbWFpbj4NCiAgICAgICAgICAgICAgICAgICAgPFBhc3N3b3JkPjwvUGFzc3dvcmQ+DQog\nICAgICAgICAgICAgICAgICAgIDxVc2VybmFtZT48L1VzZXJuYW1lPg0KICAgICAgICAgICAgICAg\nIDwvQ3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgPERlYnVnSm9pbj50cnVlPC9EZWJ1Z0pv\naW4+DQogICAgICAgICAgICAgICAgPEpvaW5Eb21haW4+PC9Kb2luRG9tYWluPg0KICAgICAgICAg\nICAgPC9JZGVudGlmaWNhdGlvbj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5n\ncz4NCiAgICA8c2V0dGluZ3MgcGFzcz0ib29iZVN5c3RlbSI+DQogICAgICAgIDxjb21wb25lbnQg\nbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtSUUtQ2xpZW50TmV0d29ya1Byb3RvY29sSW1wbGVtZW50\nYXRpb24iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4\nNTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxu\nczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUi\nIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0K\nICAgICAgICAgICAgPEhLTE1Qcm94eUVuYWJsZT5mYWxzZTwvSEtMTVByb3h5RW5hYmxlPg0KICAg\nICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2lu\nZG93cy1JbnRlcm5hdGlvbmFsLUNvcmUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJs\naWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25T\nY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01J\nQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxT\nY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9j\nYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2hlbGwtU2V0\ndXAiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZh\nZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3\nY209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHht\nbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAg\nICAgICAgICAgPERpc3BsYXk+DQogICAgICAgICAgICAgICAgPENvbG9yRGVwdGg+MzI8L0NvbG9y\nRGVwdGg+DQogICAgICAgICAgICAgICAgPEhvcml6b250YWxSZXNvbHV0aW9uPjEwMjQ8L0hvcml6\nb250YWxSZXNvbHV0aW9uPg0KICAgICAgICAgICAgICAgIDxSZWZyZXNoUmF0ZT43NTwvUmVmcmVz\naFJhdGU+DQogICAgICAgICAgICAgICAgPFZlcnRpY2FsUmVzb2x1dGlvbj43Njg8L1ZlcnRpY2Fs\nUmVzb2x1dGlvbj4NCiAgICAgICAgICAgIDwvRGlzcGxheT4NCiAgICAgICAgICAgIDxPT0JFPg0K\nICAgICAgICAgICAgICAgIDxIaWRlRVVMQVBhZ2U+dHJ1ZTwvSGlkZUVVTEFQYWdlPg0KICAgICAg\nICAgICAgICAgIDxTa2lwVXNlck9PQkU+dHJ1ZTwvU2tpcFVzZXJPT0JFPg0KICAgICAgICAgICAg\nPC9PT0JFPg0KICAgICAgICAgICAgPFVzZXJBY2NvdW50cz4NCiAgICAgICAgICAgICAgICA8QWRt\naW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgICAgICAgICA8VmFsdWU+PC9WYWx1ZT4N\nCiAgICAgICAgICAgICAgICAgICAgPFBsYWluVGV4dD50cnVlPC9QbGFpblRleHQ+DQogICAgICAg\nICAgICAgICAgPC9BZG1pbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICA8L1VzZXJBY2Nv\ndW50cz4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9S\nZWdpc3RlcmVkT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2Vy\nPC9SZWdpc3RlcmVkT3duZXI+DQogICAgICAgICAgICA8VGltZVpvbmU+ODU8L1RpbWVab25lPg0K\nICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxzZXR0aW5ncyBwYXNz\nPSJ3aW5kb3dzUEUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLUludGVybmF0aW9uYWwtQ29yZS1XaW5QRSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1\nYmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lv\nblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9X\nTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hN\nTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8U2V0dXBVSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAgICAgICAgPC9T\nZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4N\nCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxvY2FsZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TZXR1cCIgcHJv\nY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1\nIiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0\ncDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNp\nPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAg\nICA8VXNlckRhdGE+DQogICAgICAgICAgICAgICAgPFByb2R1Y3RLZXk+DQogICAgICAgICAgICAg\nICAgICAgIDxLZXk+PC9LZXk+DQogICAgICAgICAgICAgICAgICAgIDxXaWxsU2hvd1VJPk5ldmVy\nPC9XaWxsU2hvd1VJPg0KICAgICAgICAgICAgICAgIDwvUHJvZHVjdEtleT4NCiAgICAgICAgICAg\nICAgICA8QWNjZXB0RXVsYT50cnVlPC9BY2NlcHRFdWxhPg0KICAgICAgICAgICAgICAgIDxPcmdh\nbml6YXRpb24+YXdheWZhci5vcmc8L09yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgICAgICA8RnVs\nbE5hbWU+VXNlcjwvRnVsbE5hbWU+DQogICAgICAgICAgICA8L1VzZXJEYXRhPg0KICAgICAgICA8\nL2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxjcGk6b2ZmbGluZUltYWdlIGNwaTpz\nb3VyY2U9ImNhdGFsb2c6Ly9jYXRhbG9ncy93aW5kb3dzMjAwOC14ODYvc291cmNlcy9pbnN0YWxs\nX3dpbmRvd3MgbG9uZ2hvcm4gc2VydmVyZW50ZXJwcmlzZS5jbGciIHhtbG5zOmNwaT0idXJuOnNj\naGVtYXMtbWljcm9zb2Z0LWNvbTpjcGkiIC8+DQo8L3VuYXR0ZW5kPg0K\n'}}}, 'readonly': 'true', 'deviceId': 'b6b4e487-cabc-487e-8122-a845ec582cbd', 'path': '', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '616e04aa-693b-4e82-a20f-d14780508da8'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': '0bd30893-8cea-47a9-9f0f-1133d41debc6', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'volumeID': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a', 'specParams': {}, 'readonly': 'false', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'optional': 'false', 'deviceId': '1bc8999f-f8c1-4144-bc96-05d43428080a', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': 'dab686fa-b984-4c25-8c9c-9754fd2f14e7'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '755169fc-5ce6-4cbb-a1fe-11580258338b'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'b9e9e836-9bf1-4083-9eb3-914317abe527'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '6feec942-283d-44fb-ae04-5bb5ef84f5e2'}, {'specParams': {}, 'deviceId': 'b4d51202-5f3f-4774-8b0c-c40199b4ea37', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '2', 'vmType': 'kvm', 'smartcardEnable': 'true', 'timeOffset': '3600', 'memSize': 2048, 'spiceSslCipherSuite': 'DEFAULT', 'smpCoresPerSocket': '1', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'memGuaranteedSize': 1024, 'vmName': 'mine', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} flowID [61ae572c] >Thread-55477::INFO::2014-05-16 18:09:48,656::API::648::vds::(_getNetworkIp) network None: using 0 >Thread-55477::INFO::2014-05-16 18:09:48,656::clientIF::394::vds::(createVm) vmContainerLock acquired by vm d2f76d20-1d18-4a21-b631-f32987b77d5c >Thread-55478::DEBUG::2014-05-16 18:09:48,659::vm::2156::vm.Vm::(_startUnderlyingVm) vmId=`d2f76d20-1d18-4a21-b631-f32987b77d5c`::Start >Thread-55477::DEBUG::2014-05-16 18:09:48,659::clientIF::407::vds::(createVm) Total desktops after creation of d2f76d20-1d18-4a21-b631-f32987b77d5c is 1 >Thread-55478::DEBUG::2014-05-16 18:09:48,659::vm::2160::vm.Vm::(_startUnderlyingVm) vmId=`d2f76d20-1d18-4a21-b631-f32987b77d5c`::_ongoingCreations acquired >Thread-55477::DEBUG::2014-05-16 18:09:48,659::BindingXMLRPC::982::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'd2f76d20-1d18-4a21-b631-f32987b77d5c', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9ddevice_9abad8b1-cceb-474e-8e8c-2aa2bea117bedevice_df4252e7-74de-4999-a70c-8b4e9d6b1958': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=df4252e7-74de-4999-a70c-8b4e9d6b1958, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9ddevice_9abad8b1-cceb-474e-8e8c-2aa2bea117bedevice_df4252e7-74de-4999-a70c-8b4e9d6b1958device_f51f6d29-d633-4597-b32b-1f6b82866849': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=f51f6d29-d633-4597-b32b-1f6b82866849, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9d': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9d, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9ddevice_9abad8b1-cceb-474e-8e8c-2aa2bea117be': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=9abad8b1-cceb-474e-8e8c-2aa2bea117be, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fb': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=4d250972-4b6a-4fd5-8d95-288bdc0da4fb, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bWluZTwvQ29tcHV0ZXJOYW1lPg0KICAg\nICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1JlZ2lzdGVyZWRP\ncmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8L1JlZ2lzdGVy\nZWRPd25lcj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0i\nTWljcm9zb2Z0LVdpbmRvd3MtVW5hdHRlbmRlZEpvaW4iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0i\neDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwi\nIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29m\ndC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcv\nMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElkZW50aWZpY2F0aW9uPg0K\nICAgICAgICAgICAgICAgIDxDcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICAgICAgPERvbWFp\nbj48L0RvbWFpbj4NCiAgICAgICAgICAgICAgICAgICAgPFBhc3N3b3JkPjwvUGFzc3dvcmQ+DQog\nICAgICAgICAgICAgICAgICAgIDxVc2VybmFtZT48L1VzZXJuYW1lPg0KICAgICAgICAgICAgICAg\nIDwvQ3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgPERlYnVnSm9pbj50cnVlPC9EZWJ1Z0pv\naW4+DQogICAgICAgICAgICAgICAgPEpvaW5Eb21haW4+PC9Kb2luRG9tYWluPg0KICAgICAgICAg\nICAgPC9JZGVudGlmaWNhdGlvbj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5n\ncz4NCiAgICA8c2V0dGluZ3MgcGFzcz0ib29iZVN5c3RlbSI+DQogICAgICAgIDxjb21wb25lbnQg\nbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtSUUtQ2xpZW50TmV0d29ya1Byb3RvY29sSW1wbGVtZW50\nYXRpb24iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4\nNTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxu\nczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUi\nIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0K\nICAgICAgICAgICAgPEhLTE1Qcm94eUVuYWJsZT5mYWxzZTwvSEtMTVByb3h5RW5hYmxlPg0KICAg\nICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2lu\nZG93cy1JbnRlcm5hdGlvbmFsLUNvcmUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJs\naWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25T\nY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01J\nQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxT\nY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9j\nYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2hlbGwtU2V0\ndXAiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZh\nZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3\nY209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHht\nbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAg\nICAgICAgICAgPERpc3BsYXk+DQogICAgICAgICAgICAgICAgPENvbG9yRGVwdGg+MzI8L0NvbG9y\nRGVwdGg+DQogICAgICAgICAgICAgICAgPEhvcml6b250YWxSZXNvbHV0aW9uPjEwMjQ8L0hvcml6\nb250YWxSZXNvbHV0aW9uPg0KICAgICAgICAgICAgICAgIDxSZWZyZXNoUmF0ZT43NTwvUmVmcmVz\naFJhdGU+DQogICAgICAgICAgICAgICAgPFZlcnRpY2FsUmVzb2x1dGlvbj43Njg8L1ZlcnRpY2Fs\nUmVzb2x1dGlvbj4NCiAgICAgICAgICAgIDwvRGlzcGxheT4NCiAgICAgICAgICAgIDxPT0JFPg0K\nICAgICAgICAgICAgICAgIDxIaWRlRVVMQVBhZ2U+dHJ1ZTwvSGlkZUVVTEFQYWdlPg0KICAgICAg\nICAgICAgICAgIDxTa2lwVXNlck9PQkU+dHJ1ZTwvU2tpcFVzZXJPT0JFPg0KICAgICAgICAgICAg\nPC9PT0JFPg0KICAgICAgICAgICAgPFVzZXJBY2NvdW50cz4NCiAgICAgICAgICAgICAgICA8QWRt\naW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgICAgICAgICA8VmFsdWU+PC9WYWx1ZT4N\nCiAgICAgICAgICAgICAgICAgICAgPFBsYWluVGV4dD50cnVlPC9QbGFpblRleHQ+DQogICAgICAg\nICAgICAgICAgPC9BZG1pbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICA8L1VzZXJBY2Nv\ndW50cz4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9S\nZWdpc3RlcmVkT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2Vy\nPC9SZWdpc3RlcmVkT3duZXI+DQogICAgICAgICAgICA8VGltZVpvbmU+ODU8L1RpbWVab25lPg0K\nICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxzZXR0aW5ncyBwYXNz\nPSJ3aW5kb3dzUEUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLUludGVybmF0aW9uYWwtQ29yZS1XaW5QRSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1\nYmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lv\nblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9X\nTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hN\nTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8U2V0dXBVSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAgICAgICAgPC9T\nZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4N\nCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxvY2FsZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TZXR1cCIgcHJv\nY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1\nIiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0\ncDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNp\nPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAg\nICA8VXNlckRhdGE+DQogICAgICAgICAgICAgICAgPFByb2R1Y3RLZXk+DQogICAgICAgICAgICAg\nICAgICAgIDxLZXk+PC9LZXk+DQogICAgICAgICAgICAgICAgICAgIDxXaWxsU2hvd1VJPk5ldmVy\nPC9XaWxsU2hvd1VJPg0KICAgICAgICAgICAgICAgIDwvUHJvZHVjdEtleT4NCiAgICAgICAgICAg\nICAgICA8QWNjZXB0RXVsYT50cnVlPC9BY2NlcHRFdWxhPg0KICAgICAgICAgICAgICAgIDxPcmdh\nbml6YXRpb24+YXdheWZhci5vcmc8L09yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgICAgICA8RnVs\nbE5hbWU+VXNlcjwvRnVsbE5hbWU+DQogICAgICAgICAgICA8L1VzZXJEYXRhPg0KICAgICAgICA8\nL2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxjcGk6b2ZmbGluZUltYWdlIGNwaTpz\nb3VyY2U9ImNhdGFsb2c6Ly9jYXRhbG9ncy93aW5kb3dzMjAwOC14ODYvc291cmNlcy9pbnN0YWxs\nX3dpbmRvd3MgbG9uZ2hvcm4gc2VydmVyZW50ZXJwcmlzZS5jbGciIHhtbG5zOmNwaT0idXJuOnNj\naGVtYXMtbWljcm9zb2Z0LWNvbTpjcGkiIC8+DQo8L3VuYXR0ZW5kPg0K\n'}}}, 'readonly': 'true', 'deviceId': 'b6b4e487-cabc-487e-8122-a845ec582cbd', 'path': '', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '616e04aa-693b-4e82-a20f-d14780508da8'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': '0bd30893-8cea-47a9-9f0f-1133d41debc6', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'volumeID': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a', 'specParams': {}, 'readonly': 'false', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'optional': 'false', 'deviceId': '1bc8999f-f8c1-4144-bc96-05d43428080a', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': 'dab686fa-b984-4c25-8c9c-9754fd2f14e7'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '755169fc-5ce6-4cbb-a1fe-11580258338b'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'b9e9e836-9bf1-4083-9eb3-914317abe527'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '6feec942-283d-44fb-ae04-5bb5ef84f5e2'}, {'specParams': {}, 'deviceId': 'b4d51202-5f3f-4774-8b0c-c40199b4ea37', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'mine', 'display': 'qxl', 'nice': '0'}} >Thread-55478::INFO::2014-05-16 18:09:48,660::vm::3011::vm.Vm::(_run) vmId=`d2f76d20-1d18-4a21-b631-f32987b77d5c`::VM wrapper has started >Thread-55478::DEBUG::2014-05-16 18:09:48,661::task::579::TaskManager.Task::(_updateState) Task=`958cc0cd-ee18-47e0-bb2a-fe687e0b6911`::moving from state init -> state preparing >Thread-55478::INFO::2014-05-16 18:09:48,661::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='1bc8999f-f8c1-4144-bc96-05d43428080a', volUUID='5eb31ec3-0351-420b-bee1-03bf96920f43', options=None) >Thread-55478::INFO::2014-05-16 18:09:48,662::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55478::DEBUG::2014-05-16 18:09:48,662::task::1168::TaskManager.Task::(prepare) Task=`958cc0cd-ee18-47e0-bb2a-fe687e0b6911`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55478::DEBUG::2014-05-16 18:09:48,662::task::579::TaskManager.Task::(_updateState) Task=`958cc0cd-ee18-47e0-bb2a-fe687e0b6911`::moving from state preparing -> state finished >Thread-55478::DEBUG::2014-05-16 18:09:48,662::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55478::DEBUG::2014-05-16 18:09:48,662::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55478::DEBUG::2014-05-16 18:09:48,662::task::974::TaskManager.Task::(_decref) Task=`958cc0cd-ee18-47e0-bb2a-fe687e0b6911`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:09:48,709::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55478::INFO::2014-05-16 18:09:48,732::clientIF::353::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/d2f76d20-1d18-4a21-b631-f32987b77d5c.9ec880a57d83e1facafbff681ef9383b.img >Thread-55478::INFO::2014-05-16 18:09:48,736::clientIF::353::vds::(prepareVolumePath) prepared volume path: >Thread-55478::DEBUG::2014-05-16 18:09:48,737::task::579::TaskManager.Task::(_updateState) Task=`3ae19aca-0a72-4cb9-a6ed-d478a560003c`::moving from state init -> state preparing >Thread-55478::INFO::2014-05-16 18:09:48,737::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='1bc8999f-f8c1-4144-bc96-05d43428080a', leafUUID='5eb31ec3-0351-420b-bee1-03bf96920f43') >Thread-55478::DEBUG::2014-05-16 18:09:48,738::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`c36fdadc-2cf6-4794-9a2a-c408aea4ad70`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage' >Thread-55478::DEBUG::2014-05-16 18:09:48,738::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55478::DEBUG::2014-05-16 18:09:48,738::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55478::DEBUG::2014-05-16 18:09:48,739::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`c36fdadc-2cf6-4794-9a2a-c408aea4ad70`::Granted request >Thread-55478::DEBUG::2014-05-16 18:09:48,739::task::811::TaskManager.Task::(resourceAcquired) Task=`3ae19aca-0a72-4cb9-a6ed-d478a560003c`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55478::DEBUG::2014-05-16 18:09:48,739::task::974::TaskManager.Task::(_decref) Task=`3ae19aca-0a72-4cb9-a6ed-d478a560003c`::ref 1 aborting False >Thread-55478::DEBUG::2014-05-16 18:09:48,740::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55478::DEBUG::2014-05-16 18:09:48,740::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:48,789::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423155 s, 24.2 MB/s\n'; <rc> = 0 >Thread-55478::DEBUG::2014-05-16 18:09:48,897::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55478::DEBUG::2014-05-16 18:09:48,912::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55478::DEBUG::2014-05-16 18:09:48,912::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55478::DEBUG::2014-05-16 18:09:48,913::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca f79908bf-a757-4a71-9ab5-3a12ede5f65c/5eb31ec3-0351-420b-bee1-03bf96920f43' (cwd None) >Thread-55478::DEBUG::2014-05-16 18:09:49,124::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55478::DEBUG::2014-05-16 18:09:49,125::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55478::DEBUG::2014-05-16 18:09:49,125::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55478::DEBUG::2014-05-16 18:09:49,126::blockSD::1039::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a >Thread-55478::DEBUG::2014-05-16 18:09:49,127::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55478::DEBUG::2014-05-16 18:09:49,128::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55478::DEBUG::2014-05-16 18:09:49,287::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55478::DEBUG::2014-05-16 18:09:49,301::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55478::DEBUG::2014-05-16 18:09:49,301::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55478::INFO::2014-05-16 18:09:49,302::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43', 'volumeID': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a'}, 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43', 'imgVolumesInfo': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43', 'volumeID': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a'}]} >Thread-55478::DEBUG::2014-05-16 18:09:49,302::task::1168::TaskManager.Task::(prepare) Task=`3ae19aca-0a72-4cb9-a6ed-d478a560003c`::finished: {'info': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43', 'volumeID': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a'}, 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43', 'imgVolumesInfo': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43', 'volumeID': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a'}]} >Thread-55478::DEBUG::2014-05-16 18:09:49,302::task::579::TaskManager.Task::(_updateState) Task=`3ae19aca-0a72-4cb9-a6ed-d478a560003c`::moving from state preparing -> state finished >Thread-55478::DEBUG::2014-05-16 18:09:49,302::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55478::DEBUG::2014-05-16 18:09:49,303::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55478::DEBUG::2014-05-16 18:09:49,303::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55478::DEBUG::2014-05-16 18:09:49,303::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55478::DEBUG::2014-05-16 18:09:49,303::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55478::DEBUG::2014-05-16 18:09:49,303::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55478::DEBUG::2014-05-16 18:09:49,304::task::974::TaskManager.Task::(_decref) Task=`3ae19aca-0a72-4cb9-a6ed-d478a560003c`::ref 0 aborting False >Thread-55478::INFO::2014-05-16 18:09:49,304::clientIF::353::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43 >Thread-55478::DEBUG::2014-05-16 18:09:49,322::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-55478::DEBUG::2014-05-16 18:09:49,392::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55478::INFO::2014-05-16 18:09:49,393::hooks::100::root::(_runHooksDir) >Thread-55478::DEBUG::2014-05-16 18:09:49,393::vm::3073::vm.Vm::(_run) vmId=`d2f76d20-1d18-4a21-b631-f32987b77d5c`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>mine</name> > <uuid>d2f76d20-1d18-4a21-b631-f32987b77d5c</uuid> > <memory>2097152</memory> > <currentMemory>2097152</currentMemory> > <vcpu>2</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/d2f76d20-1d18-4a21-b631-f32987b77d5c.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/d2f76d20-1d18-4a21-b631-f32987b77d5c.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <smartcard mode="passthrough" type="spicevmc"/> > <smartcard mode="passthrough" type="spicevmc"/> > <controller model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" type="qxl" vram="32768"/> > </video> > <disk device="floppy" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/d2f76d20-1d18-4a21-b631-f32987b77d5c.9ec880a57d83e1facafbff681ef9383b.img" startupPolicy="optional"/> > <target bus="fdc" dev="fda"/> > <readonly/> > <serial/> > <readonly/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43"/> > <target bus="virtio" dev="vda"/> > <serial>1bc8999f-f8c1-4144-bc96-05d43428080a</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > <sound model="ich6"/> > <memballoon model="virtio"/> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140407.0.el6ev</entry> > <entry name="serial">44454C4C-3500-1054-8036-C6C04F5A5131</entry> > <entry name="uuid">d2f76d20-1d18-4a21-b631-f32987b77d5c</entry> > </system> > </sysinfo> > <clock adjustment="3600" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Nehalem</model> > <topology cores="1" sockets="2" threads="1"/> > </cpu> ></domain> > >Thread-55478::DEBUG::2014-05-16 18:09:49,494::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 67 edom: 10 level: 2 message: unsupported configuration: this QEMU binary lacks multiple smartcard support >Thread-55478::DEBUG::2014-05-16 18:09:49,495::vm::2177::vm.Vm::(_startUnderlyingVm) vmId=`d2f76d20-1d18-4a21-b631-f32987b77d5c`::_ongoingCreations released >Thread-55478::ERROR::2014-05-16 18:09:49,495::vm::2203::vm.Vm::(_startUnderlyingVm) vmId=`d2f76d20-1d18-4a21-b631-f32987b77d5c`::The vm start process failed >Traceback (most recent call last): > File "/usr/share/vdsm/vm.py", line 2163, in _startUnderlyingVm > File "/usr/share/vdsm/vm.py", line 3107, in _run > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 2665, in createXML >libvirtError: unsupported configuration: this QEMU binary lacks multiple smartcard support >Thread-55478::DEBUG::2014-05-16 18:09:49,499::vm::2657::vm.Vm::(setDownStatus) vmId=`d2f76d20-1d18-4a21-b631-f32987b77d5c`::Changed state to Down: unsupported configuration: this QEMU binary lacks multiple smartcard support >Thread-30::DEBUG::2014-05-16 18:09:50,330::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:09:50,341::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066228 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:50,802::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:50,873::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344423 s, 29.7 MB/s\n'; <rc> = 0 >Thread-55481::DEBUG::2014-05-16 18:09:52,067::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5540485.000000 / 8.019914 / 262500000.000000 = 0.263177 >Thread-55481::DEBUG::2014-05-16 18:09:52,067::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.01227259307435623, 'statsAge': 0.36989903450012207, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.26317749951454361, 'rxDropped': 0} >Thread-55481::DEBUG::2014-05-16 18:09:52,067::task::579::TaskManager.Task::(_updateState) Task=`86f73fdb-ad5e-42e2-8124-2892a83157a4`::moving from state init -> state preparing >Thread-55481::INFO::2014-05-16 18:09:52,067::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55481::INFO::2014-05-16 18:09:52,068::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066228', 'lastCheck': '1.7', 'valid': True}} >Thread-55481::DEBUG::2014-05-16 18:09:52,068::task::1168::TaskManager.Task::(prepare) Task=`86f73fdb-ad5e-42e2-8124-2892a83157a4`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066228', 'lastCheck': '1.7', 'valid': True}} >Thread-55481::DEBUG::2014-05-16 18:09:52,068::task::579::TaskManager.Task::(_updateState) Task=`86f73fdb-ad5e-42e2-8124-2892a83157a4`::moving from state preparing -> state finished >Thread-55481::DEBUG::2014-05-16 18:09:52,068::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55481::DEBUG::2014-05-16 18:09:52,068::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55481::DEBUG::2014-05-16 18:09:52,068::task::974::TaskManager.Task::(_decref) Task=`86f73fdb-ad5e-42e2-8124-2892a83157a4`::ref 0 aborting False >Thread-55483::DEBUG::2014-05-16 18:09:52,129::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmDestroy with ('d2f76d20-1d18-4a21-b631-f32987b77d5c',) {} >Thread-55483::INFO::2014-05-16 18:09:52,129::API::324::vds::(destroy) vmContainerLock acquired by vm d2f76d20-1d18-4a21-b631-f32987b77d5c >Thread-55483::DEBUG::2014-05-16 18:09:52,129::vm::4533::vm.Vm::(destroy) vmId=`d2f76d20-1d18-4a21-b631-f32987b77d5c`::destroy Called >Thread-55483::INFO::2014-05-16 18:09:52,137::vm::4479::vm.Vm::(releaseVm) vmId=`d2f76d20-1d18-4a21-b631-f32987b77d5c`::Release VM resources >Thread-55483::WARNING::2014-05-16 18:09:52,138::vm::1851::vm.Vm::(_set_lastStatus) vmId=`d2f76d20-1d18-4a21-b631-f32987b77d5c`::trying to set state to Powering down when already Down >Thread-55483::WARNING::2014-05-16 18:09:52,138::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7ff538412690>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7ff538412690>> _deviceXML:<disk device="floppy" snapshot="no" type="file"><source file="/var/run/vdsm/payload/d2f76d20-1d18-4a21-b631-f32987b77d5c.9ec880a57d83e1facafbff681ef9383b.img" startupPolicy="optional"/><target bus="fdc" dev="fda"/><readonly/><serial></serial><readonly/></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7ff538412690>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7ff538412690>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7ff538412690>> apparentsize:0 blockDev:False cache:none conf:{'status': 'Down', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'd2f76d20-1d18-4a21-b631-f32987b77d5c', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9ddevice_9abad8b1-cceb-474e-8e8c-2aa2bea117bedevice_df4252e7-74de-4999-a70c-8b4e9d6b1958': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=df4252e7-74de-4999-a70c-8b4e9d6b1958, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9ddevice_9abad8b1-cceb-474e-8e8c-2aa2bea117bedevice_df4252e7-74de-4999-a70c-8b4e9d6b1958device_f51f6d29-d633-4597-b32b-1f6b82866849': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=f51f6d29-d633-4597-b32b-1f6b82866849, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9d': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9d, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9ddevice_9abad8b1-cceb-474e-8e8c-2aa2bea117be': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=9abad8b1-cceb-474e-8e8c-2aa2bea117be, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fb': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=4d250972-4b6a-4fd5-8d95-288bdc0da4fb, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'exitCode': 1, 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'exitMessage': 'unsupported configuration: this QEMU binary lacks multiple smartcard support', 'transparentHugePages': 'true', 'devices': [{'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '755169fc-5ce6-4cbb-a1fe-11580258338b'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'b9e9e836-9bf1-4083-9eb3-914317abe527'}, {'specParams': {}, 'deviceId': 'b4d51202-5f3f-4774-8b0c-c40199b4ea37', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '616e04aa-693b-4e82-a20f-d14780508da8'}, {'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bWluZTwvQ29tcHV0ZXJOYW1lPg0KICAg\nICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1JlZ2lzdGVyZWRP\ncmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8L1JlZ2lzdGVy\nZWRPd25lcj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0i\nTWljcm9zb2Z0LVdpbmRvd3MtVW5hdHRlbmRlZEpvaW4iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0i\neDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwi\nIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29m\ndC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcv\nMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElkZW50aWZpY2F0aW9uPg0K\nICAgICAgICAgICAgICAgIDxDcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICAgICAgPERvbWFp\nbj48L0RvbWFpbj4NCiAgICAgICAgICAgICAgICAgICAgPFBhc3N3b3JkPjwvUGFzc3dvcmQ+DQog\nICAgICAgICAgICAgICAgICAgIDxVc2VybmFtZT48L1VzZXJuYW1lPg0KICAgICAgICAgICAgICAg\nIDwvQ3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgPERlYnVnSm9pbj50cnVlPC9EZWJ1Z0pv\naW4+DQogICAgICAgICAgICAgICAgPEpvaW5Eb21haW4+PC9Kb2luRG9tYWluPg0KICAgICAgICAg\nICAgPC9JZGVudGlmaWNhdGlvbj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5n\ncz4NCiAgICA8c2V0dGluZ3MgcGFzcz0ib29iZVN5c3RlbSI+DQogICAgICAgIDxjb21wb25lbnQg\nbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtSUUtQ2xpZW50TmV0d29ya1Byb3RvY29sSW1wbGVtZW50\nYXRpb24iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4\nNTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxu\nczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUi\nIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0K\nICAgICAgICAgICAgPEhLTE1Qcm94eUVuYWJsZT5mYWxzZTwvSEtMTVByb3h5RW5hYmxlPg0KICAg\nICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2lu\nZG93cy1JbnRlcm5hdGlvbmFsLUNvcmUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJs\naWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25T\nY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01J\nQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxT\nY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9j\nYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2hlbGwtU2V0\ndXAiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZh\nZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3\nY209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHht\nbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAg\nICAgICAgICAgPERpc3BsYXk+DQogICAgICAgICAgICAgICAgPENvbG9yRGVwdGg+MzI8L0NvbG9y\nRGVwdGg+DQogICAgICAgICAgICAgICAgPEhvcml6b250YWxSZXNvbHV0aW9uPjEwMjQ8L0hvcml6\nb250YWxSZXNvbHV0aW9uPg0KICAgICAgICAgICAgICAgIDxSZWZyZXNoUmF0ZT43NTwvUmVmcmVz\naFJhdGU+DQogICAgICAgICAgICAgICAgPFZlcnRpY2FsUmVzb2x1dGlvbj43Njg8L1ZlcnRpY2Fs\nUmVzb2x1dGlvbj4NCiAgICAgICAgICAgIDwvRGlzcGxheT4NCiAgICAgICAgICAgIDxPT0JFPg0K\nICAgICAgICAgICAgICAgIDxIaWRlRVVMQVBhZ2U+dHJ1ZTwvSGlkZUVVTEFQYWdlPg0KICAgICAg\nICAgICAgICAgIDxTa2lwVXNlck9PQkU+dHJ1ZTwvU2tpcFVzZXJPT0JFPg0KICAgICAgICAgICAg\nPC9PT0JFPg0KICAgICAgICAgICAgPFVzZXJBY2NvdW50cz4NCiAgICAgICAgICAgICAgICA8QWRt\naW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgICAgICAgICA8VmFsdWU+PC9WYWx1ZT4N\nCiAgICAgICAgICAgICAgICAgICAgPFBsYWluVGV4dD50cnVlPC9QbGFpblRleHQ+DQogICAgICAg\nICAgICAgICAgPC9BZG1pbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICA8L1VzZXJBY2Nv\ndW50cz4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9S\nZWdpc3RlcmVkT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2Vy\nPC9SZWdpc3RlcmVkT3duZXI+DQogICAgICAgICAgICA8VGltZVpvbmU+ODU8L1RpbWVab25lPg0K\nICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxzZXR0aW5ncyBwYXNz\nPSJ3aW5kb3dzUEUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLUludGVybmF0aW9uYWwtQ29yZS1XaW5QRSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1\nYmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lv\nblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9X\nTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hN\nTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8U2V0dXBVSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAgICAgICAgPC9T\nZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4N\nCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxvY2FsZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TZXR1cCIgcHJv\nY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1\nIiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0\ncDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNp\nPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAg\nICA8VXNlckRhdGE+DQogICAgICAgICAgICAgICAgPFByb2R1Y3RLZXk+DQogICAgICAgICAgICAg\nICAgICAgIDxLZXk+PC9LZXk+DQogICAgICAgICAgICAgICAgICAgIDxXaWxsU2hvd1VJPk5ldmVy\nPC9XaWxsU2hvd1VJPg0KICAgICAgICAgICAgICAgIDwvUHJvZHVjdEtleT4NCiAgICAgICAgICAg\nICAgICA8QWNjZXB0RXVsYT50cnVlPC9BY2NlcHRFdWxhPg0KICAgICAgICAgICAgICAgIDxPcmdh\nbml6YXRpb24+YXdheWZhci5vcmc8L09yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgICAgICA8RnVs\nbE5hbWU+VXNlcjwvRnVsbE5hbWU+DQogICAgICAgICAgICA8L1VzZXJEYXRhPg0KICAgICAgICA8\nL2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxjcGk6b2ZmbGluZUltYWdlIGNwaTpz\nb3VyY2U9ImNhdGFsb2c6Ly9jYXRhbG9ncy93aW5kb3dzMjAwOC14ODYvc291cmNlcy9pbnN0YWxs\nX3dpbmRvd3MgbG9uZ2hvcm4gc2VydmVyZW50ZXJwcmlzZS5jbGciIHhtbG5zOmNwaT0idXJuOnNj\naGVtYXMtbWljcm9zb2Z0LWNvbTpjcGkiIC8+DQo8L3VuYXR0ZW5kPg0K\n'}}}, 'readonly': 'true', 'deviceId': 'b6b4e487-cabc-487e-8122-a845ec582cbd', 'path': '/var/run/vdsm/payload/d2f76d20-1d18-4a21-b631-f32987b77d5c.9ec880a57d83e1facafbff681ef9383b.img', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': '0bd30893-8cea-47a9-9f0f-1133d41debc6', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'volumeInfo': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43', 'volumeID': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a', 'readonly': 'false', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'reqsize': '0', 'format': 'cow', 'deviceId': '1bc8999f-f8c1-4144-bc96-05d43428080a', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43', 'propagateErrors': 'off', 'optional': 'false', 'bootOrder': '1', 'volumeID': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'specParams': {}, 'volumeChain': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43', 'volumeID': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a'}]}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': 'dab686fa-b984-4c25-8c9c-9754fd2f14e7'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '6feec942-283d-44fb-ae04-5bb5ef84f5e2', 'target': 2097152}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'mine', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7ff538412690>> device:floppy deviceId:b6b4e487-cabc-487e-8122-a845ec582cbd extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7ff538412690>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7ff538412690>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7ff538412690>> hasVolumeLeases:False iface:fdc index:0 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7ff538412690>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7ff538412690>> log:<logUtils.SimpleLogAdapter instance at 0x2afeb48> name:fda networkDev:False path:/var/run/vdsm/payload/d2f76d20-1d18-4a21-b631-f32987b77d5c.9ec880a57d83e1facafbff681ef9383b.img readonly:true reqsize:0 serial: shared:false specParams:{'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bWluZTwvQ29tcHV0ZXJOYW1lPg0KICAg\nICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1JlZ2lzdGVyZWRP\ncmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8L1JlZ2lzdGVy\nZWRPd25lcj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0i\nTWljcm9zb2Z0LVdpbmRvd3MtVW5hdHRlbmRlZEpvaW4iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0i\neDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwi\nIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29m\ndC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcv\nMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElkZW50aWZpY2F0aW9uPg0K\nICAgICAgICAgICAgICAgIDxDcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICAgICAgPERvbWFp\nbj48L0RvbWFpbj4NCiAgICAgICAgICAgICAgICAgICAgPFBhc3N3b3JkPjwvUGFzc3dvcmQ+DQog\nICAgICAgICAgICAgICAgICAgIDxVc2VybmFtZT48L1VzZXJuYW1lPg0KICAgICAgICAgICAgICAg\nIDwvQ3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgPERlYnVnSm9pbj50cnVlPC9EZWJ1Z0pv\naW4+DQogICAgICAgICAgICAgICAgPEpvaW5Eb21haW4+PC9Kb2luRG9tYWluPg0KICAgICAgICAg\nICAgPC9JZGVudGlmaWNhdGlvbj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5n\ncz4NCiAgICA8c2V0dGluZ3MgcGFzcz0ib29iZVN5c3RlbSI+DQogICAgICAgIDxjb21wb25lbnQg\nbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtSUUtQ2xpZW50TmV0d29ya1Byb3RvY29sSW1wbGVtZW50\nYXRpb24iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4\nNTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxu\nczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUi\nIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0K\nICAgICAgICAgICAgPEhLTE1Qcm94eUVuYWJsZT5mYWxzZTwvSEtMTVByb3h5RW5hYmxlPg0KICAg\nICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2lu\nZG93cy1JbnRlcm5hdGlvbmFsLUNvcmUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJs\naWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25T\nY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01J\nQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxT\nY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9j\nYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2hlbGwtU2V0\ndXAiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZh\nZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3\nY209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHht\nbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAg\nICAgICAgICAgPERpc3BsYXk+DQogICAgICAgICAgICAgICAgPENvbG9yRGVwdGg+MzI8L0NvbG9y\nRGVwdGg+DQogICAgICAgICAgICAgICAgPEhvcml6b250YWxSZXNvbHV0aW9uPjEwMjQ8L0hvcml6\nb250YWxSZXNvbHV0aW9uPg0KICAgICAgICAgICAgICAgIDxSZWZyZXNoUmF0ZT43NTwvUmVmcmVz\naFJhdGU+DQogICAgICAgICAgICAgICAgPFZlcnRpY2FsUmVzb2x1dGlvbj43Njg8L1ZlcnRpY2Fs\nUmVzb2x1dGlvbj4NCiAgICAgICAgICAgIDwvRGlzcGxheT4NCiAgICAgICAgICAgIDxPT0JFPg0K\nICAgICAgICAgICAgICAgIDxIaWRlRVVMQVBhZ2U+dHJ1ZTwvSGlkZUVVTEFQYWdlPg0KICAgICAg\nICAgICAgICAgIDxTa2lwVXNlck9PQkU+dHJ1ZTwvU2tpcFVzZXJPT0JFPg0KICAgICAgICAgICAg\nPC9PT0JFPg0KICAgICAgICAgICAgPFVzZXJBY2NvdW50cz4NCiAgICAgICAgICAgICAgICA8QWRt\naW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgICAgICAgICA8VmFsdWU+PC9WYWx1ZT4N\nCiAgICAgICAgICAgICAgICAgICAgPFBsYWluVGV4dD50cnVlPC9QbGFpblRleHQ+DQogICAgICAg\nICAgICAgICAgPC9BZG1pbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICA8L1VzZXJBY2Nv\ndW50cz4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9S\nZWdpc3RlcmVkT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2Vy\nPC9SZWdpc3RlcmVkT3duZXI+DQogICAgICAgICAgICA8VGltZVpvbmU+ODU8L1RpbWVab25lPg0K\nICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxzZXR0aW5ncyBwYXNz\nPSJ3aW5kb3dzUEUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLUludGVybmF0aW9uYWwtQ29yZS1XaW5QRSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1\nYmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lv\nblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9X\nTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hN\nTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8U2V0dXBVSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAgICAgICAgPC9T\nZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4N\nCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxvY2FsZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TZXR1cCIgcHJv\nY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1\nIiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0\ncDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNp\nPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAg\nICA8VXNlckRhdGE+DQogICAgICAgICAgICAgICAgPFByb2R1Y3RLZXk+DQogICAgICAgICAgICAg\nICAgICAgIDxLZXk+PC9LZXk+DQogICAgICAgICAgICAgICAgICAgIDxXaWxsU2hvd1VJPk5ldmVy\nPC9XaWxsU2hvd1VJPg0KICAgICAgICAgICAgICAgIDwvUHJvZHVjdEtleT4NCiAgICAgICAgICAg\nICAgICA8QWNjZXB0RXVsYT50cnVlPC9BY2NlcHRFdWxhPg0KICAgICAgICAgICAgICAgIDxPcmdh\nbml6YXRpb24+YXdheWZhci5vcmc8L09yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgICAgICA8RnVs\nbE5hbWU+VXNlcjwvRnVsbE5hbWU+DQogICAgICAgICAgICA8L1VzZXJEYXRhPg0KICAgICAgICA8\nL2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxjcGk6b2ZmbGluZUltYWdlIGNwaTpz\nb3VyY2U9ImNhdGFsb2c6Ly9jYXRhbG9ncy93aW5kb3dzMjAwOC14ODYvc291cmNlcy9pbnN0YWxs\nX3dpbmRvd3MgbG9uZ2hvcm4gc2VydmVyZW50ZXJwcmlzZS5jbGciIHhtbG5zOmNwaT0idXJuOnNj\naGVtYXMtbWljcm9zb2Z0LWNvbTpjcGkiIC8+DQo8L3VuYXR0ZW5kPg0K\n'}}} transientDisk:False truesize:0 type:disk volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath > File "/usr/share/vdsm/vm.py", line 1431, in __getitem__ >KeyError: 'domainID' >Thread-55483::WARNING::2014-05-16 18:09:52,139::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7ff534342210>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7ff534342210>> _deviceXML:<disk device="cdrom" snapshot="no" type="file"><address bus="1" controller="0" target="0" type="drive" unit="0"/><source file="" startupPolicy="optional"/><target bus="ide" dev="hdc"/><readonly/><serial></serial></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7ff534342210>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7ff534342210>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7ff534342210>> address:{' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'} apparentsize:0 blockDev:False cache:none conf:{'status': 'Down', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'd2f76d20-1d18-4a21-b631-f32987b77d5c', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9ddevice_9abad8b1-cceb-474e-8e8c-2aa2bea117bedevice_df4252e7-74de-4999-a70c-8b4e9d6b1958': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=df4252e7-74de-4999-a70c-8b4e9d6b1958, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9ddevice_9abad8b1-cceb-474e-8e8c-2aa2bea117bedevice_df4252e7-74de-4999-a70c-8b4e9d6b1958device_f51f6d29-d633-4597-b32b-1f6b82866849': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=f51f6d29-d633-4597-b32b-1f6b82866849, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9d': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9d, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fbdevice_7c2f0be0-3e74-4531-bdcf-3d0cb2af3a9ddevice_9abad8b1-cceb-474e-8e8c-2aa2bea117be': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=9abad8b1-cceb-474e-8e8c-2aa2bea117be, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_4d250972-4b6a-4fd5-8d95-288bdc0da4fb': 'VmDevice {vmId=d2f76d20-1d18-4a21-b631-f32987b77d5c, deviceId=4d250972-4b6a-4fd5-8d95-288bdc0da4fb, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'exitCode': 1, 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'exitMessage': 'unsupported configuration: this QEMU binary lacks multiple smartcard support', 'transparentHugePages': 'true', 'devices': [{'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '755169fc-5ce6-4cbb-a1fe-11580258338b'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'b9e9e836-9bf1-4083-9eb3-914317abe527'}, {'specParams': {}, 'deviceId': 'b4d51202-5f3f-4774-8b0c-c40199b4ea37', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '616e04aa-693b-4e82-a20f-d14780508da8'}, {'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+bWluZTwvQ29tcHV0ZXJOYW1lPg0KICAg\nICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1JlZ2lzdGVyZWRP\ncmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8L1JlZ2lzdGVy\nZWRPd25lcj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0i\nTWljcm9zb2Z0LVdpbmRvd3MtVW5hdHRlbmRlZEpvaW4iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0i\neDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwi\nIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29m\ndC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcv\nMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElkZW50aWZpY2F0aW9uPg0K\nICAgICAgICAgICAgICAgIDxDcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICAgICAgPERvbWFp\nbj48L0RvbWFpbj4NCiAgICAgICAgICAgICAgICAgICAgPFBhc3N3b3JkPjwvUGFzc3dvcmQ+DQog\nICAgICAgICAgICAgICAgICAgIDxVc2VybmFtZT48L1VzZXJuYW1lPg0KICAgICAgICAgICAgICAg\nIDwvQ3JlZGVudGlhbHM+DQogICAgICAgICAgICAgICAgPERlYnVnSm9pbj50cnVlPC9EZWJ1Z0pv\naW4+DQogICAgICAgICAgICAgICAgPEpvaW5Eb21haW4+PC9Kb2luRG9tYWluPg0KICAgICAgICAg\nICAgPC9JZGVudGlmaWNhdGlvbj4NCiAgICAgICAgPC9jb21wb25lbnQ+DQogICAgPC9zZXR0aW5n\ncz4NCiAgICA8c2V0dGluZ3MgcGFzcz0ib29iZVN5c3RlbSI+DQogICAgICAgIDxjb21wb25lbnQg\nbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtSUUtQ2xpZW50TmV0d29ya1Byb3RvY29sSW1wbGVtZW50\nYXRpb24iIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4\nNTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxu\nczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUi\nIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0K\nICAgICAgICAgICAgPEhLTE1Qcm94eUVuYWJsZT5mYWxzZTwvSEtMTVByb3h5RW5hYmxlPg0KICAg\nICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2lu\nZG93cy1JbnRlcm5hdGlvbmFsLUNvcmUiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJs\naWNLZXlUb2tlbj0iMzFiZjM4NTZhZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25T\nY29wZT0ibm9uU3hTIiB4bWxuczp3Y209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01J\nQ29uZmlnLzIwMDIvU3RhdGUiIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxT\nY2hlbWEtaW5zdGFuY2UiPg0KICAgICAgICAgICAgPElucHV0TG9jYWxlPjA0MDk6MDAwMDA0MDk8\nL0lucHV0TG9jYWxlPg0KICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9j\nYWxlPg0KICAgICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICA8VUlMYW5ndWFnZUZhbGxiYWNrPmVuLXVzPC9VSUxhbmd1YWdlRmFsbGJhY2s+DQogICAg\nICAgICAgICA8VXNlckxvY2FsZT5lbi11czwvVXNlckxvY2FsZT4NCiAgICAgICAgPC9jb21wb25l\nbnQ+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3MtU2hlbGwtU2V0\ndXAiIHByb2Nlc3NvckFyY2hpdGVjdHVyZT0ieDg2IiBwdWJsaWNLZXlUb2tlbj0iMzFiZjM4NTZh\nZDM2NGUzNSIgbGFuZ3VhZ2U9Im5ldXRyYWwiIHZlcnNpb25TY29wZT0ibm9uU3hTIiB4bWxuczp3\nY209Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vV01JQ29uZmlnLzIwMDIvU3RhdGUiIHht\nbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiPg0KICAg\nICAgICAgICAgPERpc3BsYXk+DQogICAgICAgICAgICAgICAgPENvbG9yRGVwdGg+MzI8L0NvbG9y\nRGVwdGg+DQogICAgICAgICAgICAgICAgPEhvcml6b250YWxSZXNvbHV0aW9uPjEwMjQ8L0hvcml6\nb250YWxSZXNvbHV0aW9uPg0KICAgICAgICAgICAgICAgIDxSZWZyZXNoUmF0ZT43NTwvUmVmcmVz\naFJhdGU+DQogICAgICAgICAgICAgICAgPFZlcnRpY2FsUmVzb2x1dGlvbj43Njg8L1ZlcnRpY2Fs\nUmVzb2x1dGlvbj4NCiAgICAgICAgICAgIDwvRGlzcGxheT4NCiAgICAgICAgICAgIDxPT0JFPg0K\nICAgICAgICAgICAgICAgIDxIaWRlRVVMQVBhZ2U+dHJ1ZTwvSGlkZUVVTEFQYWdlPg0KICAgICAg\nICAgICAgICAgIDxTa2lwVXNlck9PQkU+dHJ1ZTwvU2tpcFVzZXJPT0JFPg0KICAgICAgICAgICAg\nPC9PT0JFPg0KICAgICAgICAgICAgPFVzZXJBY2NvdW50cz4NCiAgICAgICAgICAgICAgICA8QWRt\naW5pc3RyYXRvclBhc3N3b3JkPg0KICAgICAgICAgICAgICAgICAgICA8VmFsdWU+PC9WYWx1ZT4N\nCiAgICAgICAgICAgICAgICAgICAgPFBsYWluVGV4dD50cnVlPC9QbGFpblRleHQ+DQogICAgICAg\nICAgICAgICAgPC9BZG1pbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICA8L1VzZXJBY2Nv\ndW50cz4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3JnYW5pemF0aW9uPmF3YXlmYXIub3JnPC9S\nZWdpc3RlcmVkT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPd25lcj5Vc2Vy\nPC9SZWdpc3RlcmVkT3duZXI+DQogICAgICAgICAgICA8VGltZVpvbmU+ODU8L1RpbWVab25lPg0K\nICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxzZXR0aW5ncyBwYXNz\nPSJ3aW5kb3dzUEUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLUludGVybmF0aW9uYWwtQ29yZS1XaW5QRSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1\nYmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lv\nblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9X\nTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hN\nTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8U2V0dXBVSUxhbmd1YWdlPg0KICAgICAg\nICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0KICAgICAgICAgICAgPC9T\nZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4N\nCiAgICAgICAgICAgIDxTeXN0ZW1Mb2NhbGU+ZW4tdXM8L1N5c3RlbUxvY2FsZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TZXR1cCIgcHJv\nY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1\nIiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0\ncDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNp\nPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAg\nICA8VXNlckRhdGE+DQogICAgICAgICAgICAgICAgPFByb2R1Y3RLZXk+DQogICAgICAgICAgICAg\nICAgICAgIDxLZXk+PC9LZXk+DQogICAgICAgICAgICAgICAgICAgIDxXaWxsU2hvd1VJPk5ldmVy\nPC9XaWxsU2hvd1VJPg0KICAgICAgICAgICAgICAgIDwvUHJvZHVjdEtleT4NCiAgICAgICAgICAg\nICAgICA8QWNjZXB0RXVsYT50cnVlPC9BY2NlcHRFdWxhPg0KICAgICAgICAgICAgICAgIDxPcmdh\nbml6YXRpb24+YXdheWZhci5vcmc8L09yZ2FuaXphdGlvbj4NCiAgICAgICAgICAgICAgICA8RnVs\nbE5hbWU+VXNlcjwvRnVsbE5hbWU+DQogICAgICAgICAgICA8L1VzZXJEYXRhPg0KICAgICAgICA8\nL2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdzPg0KICAgIDxjcGk6b2ZmbGluZUltYWdlIGNwaTpz\nb3VyY2U9ImNhdGFsb2c6Ly9jYXRhbG9ncy93aW5kb3dzMjAwOC14ODYvc291cmNlcy9pbnN0YWxs\nX3dpbmRvd3MgbG9uZ2hvcm4gc2VydmVyZW50ZXJwcmlzZS5jbGciIHhtbG5zOmNwaT0idXJuOnNj\naGVtYXMtbWljcm9zb2Z0LWNvbTpjcGkiIC8+DQo8L3VuYXR0ZW5kPg0K\n'}}}, 'readonly': 'true', 'deviceId': 'b6b4e487-cabc-487e-8122-a845ec582cbd', 'path': '/var/run/vdsm/payload/d2f76d20-1d18-4a21-b631-f32987b77d5c.9ec880a57d83e1facafbff681ef9383b.img', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': '0bd30893-8cea-47a9-9f0f-1133d41debc6', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'volumeInfo': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43', 'volumeID': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a', 'readonly': 'false', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'reqsize': '0', 'format': 'cow', 'deviceId': '1bc8999f-f8c1-4144-bc96-05d43428080a', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43', 'propagateErrors': 'off', 'optional': 'false', 'bootOrder': '1', 'volumeID': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'specParams': {}, 'volumeChain': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43', 'volumeID': '5eb31ec3-0351-420b-bee1-03bf96920f43', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '1bc8999f-f8c1-4144-bc96-05d43428080a'}]}, {'device': 'ich6', 'specParams': {}, 'type': 'sound', 'deviceId': 'dab686fa-b984-4c25-8c9c-9754fd2f14e7'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '6feec942-283d-44fb-ae04-5bb5ef84f5e2', 'target': 2097152}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'mine', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7ff534342210>> device:cdrom deviceId:0bd30893-8cea-47a9-9f0f-1133d41debc6 extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7ff534342210>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7ff534342210>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7ff534342210>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7ff534342210>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7ff534342210>> log:<logUtils.SimpleLogAdapter instance at 0x2afeb48> name:hdc networkDev:False path: readonly:true reqsize:0 serial: shared:false specParams:{'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'} transientDisk:False truesize:0 type:disk volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath > File "/usr/share/vdsm/vm.py", line 1431, in __getitem__ >KeyError: 'domainID' >Thread-55483::DEBUG::2014-05-16 18:09:52,141::task::579::TaskManager.Task::(_updateState) Task=`0994fb16-45b0-44cb-bf81-c0a59ae60536`::moving from state init -> state preparing >Thread-55483::INFO::2014-05-16 18:09:52,141::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='1bc8999f-f8c1-4144-bc96-05d43428080a', volUUID=None) >Thread-55483::DEBUG::2014-05-16 18:09:52,141::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`f5a22e80-2de8-4571-8342-f27869b477d0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'teardownImage' >Thread-55483::DEBUG::2014-05-16 18:09:52,141::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55483::DEBUG::2014-05-16 18:09:52,142::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55483::DEBUG::2014-05-16 18:09:52,142::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`f5a22e80-2de8-4571-8342-f27869b477d0`::Granted request >Thread-55483::DEBUG::2014-05-16 18:09:52,142::task::811::TaskManager.Task::(resourceAcquired) Task=`0994fb16-45b0-44cb-bf81-c0a59ae60536`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55483::DEBUG::2014-05-16 18:09:52,142::task::974::TaskManager.Task::(_decref) Task=`0994fb16-45b0-44cb-bf81-c0a59ae60536`::ref 1 aborting False >Thread-55483::DEBUG::2014-05-16 18:09:52,142::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55483::DEBUG::2014-05-16 18:09:52,143::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55483::DEBUG::2014-05-16 18:09:52,289::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55483::DEBUG::2014-05-16 18:09:52,304::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55483::DEBUG::2014-05-16 18:09:52,305::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55483::DEBUG::2014-05-16 18:09:52,306::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/5eb31ec3-0351-420b-bee1-03bf96920f43' (cwd None) >Thread-55483::DEBUG::2014-05-16 18:09:52,471::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55483::DEBUG::2014-05-16 18:09:52,472::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55483::DEBUG::2014-05-16 18:09:52,472::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55483::INFO::2014-05-16 18:09:52,472::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-55483::DEBUG::2014-05-16 18:09:52,473::task::1168::TaskManager.Task::(prepare) Task=`0994fb16-45b0-44cb-bf81-c0a59ae60536`::finished: None >Thread-55483::DEBUG::2014-05-16 18:09:52,473::task::579::TaskManager.Task::(_updateState) Task=`0994fb16-45b0-44cb-bf81-c0a59ae60536`::moving from state preparing -> state finished >Thread-55483::DEBUG::2014-05-16 18:09:52,473::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55483::DEBUG::2014-05-16 18:09:52,473::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55483::DEBUG::2014-05-16 18:09:52,473::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55483::DEBUG::2014-05-16 18:09:52,474::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55483::DEBUG::2014-05-16 18:09:52,474::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55483::DEBUG::2014-05-16 18:09:52,474::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55483::DEBUG::2014-05-16 18:09:52,474::task::974::TaskManager.Task::(_decref) Task=`0994fb16-45b0-44cb-bf81-c0a59ae60536`::ref 0 aborting False >Thread-55483::WARNING::2014-05-16 18:09:52,475::utils::114::root::(rmFile) File: /var/lib/libvirt/qemu/channels/d2f76d20-1d18-4a21-b631-f32987b77d5c.com.redhat.rhevm.vdsm already removed >Thread-55483::WARNING::2014-05-16 18:09:52,476::utils::114::root::(rmFile) File: /var/lib/libvirt/qemu/channels/d2f76d20-1d18-4a21-b631-f32987b77d5c.org.qemu.guest_agent.0 already removed >Thread-55483::DEBUG::2014-05-16 18:09:52,476::task::579::TaskManager.Task::(_updateState) Task=`80e66acf-f78f-4f68-b1d5-344d42469610`::moving from state init -> state preparing >Thread-55483::INFO::2014-05-16 18:09:52,477::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='d2f76d20-1d18-4a21-b631-f32987b77d5c') >Thread-55483::INFO::2014-05-16 18:09:52,478::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-55483::DEBUG::2014-05-16 18:09:52,479::task::1168::TaskManager.Task::(prepare) Task=`80e66acf-f78f-4f68-b1d5-344d42469610`::finished: None >Thread-55483::DEBUG::2014-05-16 18:09:52,479::task::579::TaskManager.Task::(_updateState) Task=`80e66acf-f78f-4f68-b1d5-344d42469610`::moving from state preparing -> state finished >Thread-55483::DEBUG::2014-05-16 18:09:52,479::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55483::DEBUG::2014-05-16 18:09:52,479::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55483::DEBUG::2014-05-16 18:09:52,479::task::974::TaskManager.Task::(_decref) Task=`80e66acf-f78f-4f68-b1d5-344d42469610`::ref 0 aborting False >Thread-55483::DEBUG::2014-05-16 18:09:52,480::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd' (cwd None) >Thread-55483::DEBUG::2014-05-16 18:09:52,752::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55483::INFO::2014-05-16 18:09:52,753::hooks::100::root::(_runHooksDir) >Thread-55483::DEBUG::2014-05-16 18:09:52,753::vm::4527::vm.Vm::(deleteVm) vmId=`d2f76d20-1d18-4a21-b631-f32987b77d5c`::Total desktops after destroy of d2f76d20-1d18-4a21-b631-f32987b77d5c is 0 >Thread-55483::DEBUG::2014-05-16 18:09:52,753::BindingXMLRPC::982::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >Dummy-51::DEBUG::2014-05-16 18:09:52,884::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:52,959::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362318 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:54,971::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:55,038::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310819 s, 32.9 MB/s\n'; <rc> = 0 >Thread-55486::DEBUG::2014-05-16 18:09:56,028::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55486::DEBUG::2014-05-16 18:09:56,029::task::579::TaskManager.Task::(_updateState) Task=`0f93d192-6903-4058-9a7b-3b63240ad520`::moving from state init -> state preparing >Thread-55486::INFO::2014-05-16 18:09:56,029::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55486::INFO::2014-05-16 18:09:56,029::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55486::DEBUG::2014-05-16 18:09:56,030::task::1168::TaskManager.Task::(prepare) Task=`0f93d192-6903-4058-9a7b-3b63240ad520`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55486::DEBUG::2014-05-16 18:09:56,030::task::579::TaskManager.Task::(_updateState) Task=`0f93d192-6903-4058-9a7b-3b63240ad520`::moving from state preparing -> state finished >Thread-55486::DEBUG::2014-05-16 18:09:56,030::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55486::DEBUG::2014-05-16 18:09:56,030::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55486::DEBUG::2014-05-16 18:09:56,031::task::974::TaskManager.Task::(_decref) Task=`0f93d192-6903-4058-9a7b-3b63240ad520`::ref 0 aborting False >Thread-55487::DEBUG::2014-05-16 18:09:56,039::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55487::DEBUG::2014-05-16 18:09:56,040::task::579::TaskManager.Task::(_updateState) Task=`6f6b0c01-20f1-4b71-ab5e-aa6edc34229d`::moving from state init -> state preparing >Thread-55487::INFO::2014-05-16 18:09:56,040::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55487::DEBUG::2014-05-16 18:09:56,040::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b3d37152-4203-4440-bc5a-daf7d5576dc4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55487::DEBUG::2014-05-16 18:09:56,040::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55487::DEBUG::2014-05-16 18:09:56,041::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55487::DEBUG::2014-05-16 18:09:56,041::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b3d37152-4203-4440-bc5a-daf7d5576dc4`::Granted request >Thread-55487::DEBUG::2014-05-16 18:09:56,041::task::811::TaskManager.Task::(resourceAcquired) Task=`6f6b0c01-20f1-4b71-ab5e-aa6edc34229d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55487::DEBUG::2014-05-16 18:09:56,041::task::974::TaskManager.Task::(_decref) Task=`6f6b0c01-20f1-4b71-ab5e-aa6edc34229d`::ref 1 aborting False >Thread-55487::INFO::2014-05-16 18:09:56,042::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55487::DEBUG::2014-05-16 18:09:56,042::task::1168::TaskManager.Task::(prepare) Task=`6f6b0c01-20f1-4b71-ab5e-aa6edc34229d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55487::DEBUG::2014-05-16 18:09:56,042::task::579::TaskManager.Task::(_updateState) Task=`6f6b0c01-20f1-4b71-ab5e-aa6edc34229d`::moving from state preparing -> state finished >Thread-55487::DEBUG::2014-05-16 18:09:56,042::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55487::DEBUG::2014-05-16 18:09:56,043::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55487::DEBUG::2014-05-16 18:09:56,043::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55487::DEBUG::2014-05-16 18:09:56,043::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55487::DEBUG::2014-05-16 18:09:56,043::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55487::DEBUG::2014-05-16 18:09:56,043::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55487::DEBUG::2014-05-16 18:09:56,043::task::974::TaskManager.Task::(_decref) Task=`6f6b0c01-20f1-4b71-ab5e-aa6edc34229d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:09:57,050::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:57,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345153 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:09:59,133::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:09:59,208::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337067 s, 30.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:10:00,380::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:10:00,390::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756612 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:01,220::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:01,288::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308625 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:03,300::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:03,371::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358247 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:05,384::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:05,457::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035445 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55492::DEBUG::2014-05-16 18:10:06,107::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55492::DEBUG::2014-05-16 18:10:06,107::task::579::TaskManager.Task::(_updateState) Task=`43b916f2-30c5-4321-bb89-6f3e80408004`::moving from state init -> state preparing >Thread-55492::INFO::2014-05-16 18:10:06,107::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55492::INFO::2014-05-16 18:10:06,108::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55492::DEBUG::2014-05-16 18:10:06,108::task::1168::TaskManager.Task::(prepare) Task=`43b916f2-30c5-4321-bb89-6f3e80408004`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55492::DEBUG::2014-05-16 18:10:06,108::task::579::TaskManager.Task::(_updateState) Task=`43b916f2-30c5-4321-bb89-6f3e80408004`::moving from state preparing -> state finished >Thread-55492::DEBUG::2014-05-16 18:10:06,108::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55492::DEBUG::2014-05-16 18:10:06,108::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55492::DEBUG::2014-05-16 18:10:06,108::task::974::TaskManager.Task::(_decref) Task=`43b916f2-30c5-4321-bb89-6f3e80408004`::ref 0 aborting False >Thread-55493::DEBUG::2014-05-16 18:10:06,125::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55493::DEBUG::2014-05-16 18:10:06,125::task::579::TaskManager.Task::(_updateState) Task=`3d16d5cf-9026-4535-9970-80d9fa339f4b`::moving from state init -> state preparing >Thread-55493::INFO::2014-05-16 18:10:06,125::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55493::DEBUG::2014-05-16 18:10:06,126::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0b5d1e8d-dc69-4f62-9942-061d1b65850b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55493::DEBUG::2014-05-16 18:10:06,126::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55493::DEBUG::2014-05-16 18:10:06,126::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55493::DEBUG::2014-05-16 18:10:06,126::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0b5d1e8d-dc69-4f62-9942-061d1b65850b`::Granted request >Thread-55493::DEBUG::2014-05-16 18:10:06,127::task::811::TaskManager.Task::(resourceAcquired) Task=`3d16d5cf-9026-4535-9970-80d9fa339f4b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55493::DEBUG::2014-05-16 18:10:06,127::task::974::TaskManager.Task::(_decref) Task=`3d16d5cf-9026-4535-9970-80d9fa339f4b`::ref 1 aborting False >Thread-55493::INFO::2014-05-16 18:10:06,127::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55493::DEBUG::2014-05-16 18:10:06,128::task::1168::TaskManager.Task::(prepare) Task=`3d16d5cf-9026-4535-9970-80d9fa339f4b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55493::DEBUG::2014-05-16 18:10:06,128::task::579::TaskManager.Task::(_updateState) Task=`3d16d5cf-9026-4535-9970-80d9fa339f4b`::moving from state preparing -> state finished >Thread-55493::DEBUG::2014-05-16 18:10:06,128::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55493::DEBUG::2014-05-16 18:10:06,128::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55493::DEBUG::2014-05-16 18:10:06,128::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55493::DEBUG::2014-05-16 18:10:06,128::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55493::DEBUG::2014-05-16 18:10:06,129::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55493::DEBUG::2014-05-16 18:10:06,129::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55493::DEBUG::2014-05-16 18:10:06,129::task::974::TaskManager.Task::(_decref) Task=`3d16d5cf-9026-4535-9970-80d9fa339f4b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:10:07,469::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:07,536::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307341 s, 33.3 MB/s\n'; <rc> = 0 >Thread-55494::DEBUG::2014-05-16 18:10:08,314::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5419081.000000 / 8.015032 / 262500000.000000 = 0.257568 >Thread-55494::DEBUG::2014-05-16 18:10:08,314::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066376232977662358, 'statsAge': 0.59315204620361328, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25756751280384349, 'rxDropped': 0} >Thread-55494::DEBUG::2014-05-16 18:10:08,314::task::579::TaskManager.Task::(_updateState) Task=`143efd7c-72a5-48c1-9957-9adaba6a9c8b`::moving from state init -> state preparing >Thread-55494::INFO::2014-05-16 18:10:08,315::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55494::INFO::2014-05-16 18:10:08,315::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756612', 'lastCheck': '7.9', 'valid': True}} >Thread-55494::DEBUG::2014-05-16 18:10:08,315::task::1168::TaskManager.Task::(prepare) Task=`143efd7c-72a5-48c1-9957-9adaba6a9c8b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756612', 'lastCheck': '7.9', 'valid': True}} >Thread-55494::DEBUG::2014-05-16 18:10:08,316::task::579::TaskManager.Task::(_updateState) Task=`143efd7c-72a5-48c1-9957-9adaba6a9c8b`::moving from state preparing -> state finished >Thread-55494::DEBUG::2014-05-16 18:10:08,316::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55494::DEBUG::2014-05-16 18:10:08,316::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55494::DEBUG::2014-05-16 18:10:08,316::task::974::TaskManager.Task::(_decref) Task=`143efd7c-72a5-48c1-9957-9adaba6a9c8b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:10:09,548::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:09,619::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349613 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:10:10,424::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:10:10,434::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000771514 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:11,631::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:11,702::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345846 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:13,713::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:13,781::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317508 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:15,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:15,860::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303647 s, 33.7 MB/s\n'; <rc> = 0 >Thread-55498::DEBUG::2014-05-16 18:10:16,163::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55498::DEBUG::2014-05-16 18:10:16,163::task::579::TaskManager.Task::(_updateState) Task=`7e494dc9-30b6-4cb2-a45e-8fb56c9ceb67`::moving from state init -> state preparing >Thread-55498::INFO::2014-05-16 18:10:16,164::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55498::INFO::2014-05-16 18:10:16,164::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55498::DEBUG::2014-05-16 18:10:16,164::task::1168::TaskManager.Task::(prepare) Task=`7e494dc9-30b6-4cb2-a45e-8fb56c9ceb67`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55498::DEBUG::2014-05-16 18:10:16,164::task::579::TaskManager.Task::(_updateState) Task=`7e494dc9-30b6-4cb2-a45e-8fb56c9ceb67`::moving from state preparing -> state finished >Thread-55498::DEBUG::2014-05-16 18:10:16,165::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55498::DEBUG::2014-05-16 18:10:16,165::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55498::DEBUG::2014-05-16 18:10:16,165::task::974::TaskManager.Task::(_decref) Task=`7e494dc9-30b6-4cb2-a45e-8fb56c9ceb67`::ref 0 aborting False >Thread-55499::DEBUG::2014-05-16 18:10:16,174::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55499::DEBUG::2014-05-16 18:10:16,174::task::579::TaskManager.Task::(_updateState) Task=`3631a191-44d2-4436-8cb8-c324a58e4400`::moving from state init -> state preparing >Thread-55499::INFO::2014-05-16 18:10:16,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55499::DEBUG::2014-05-16 18:10:16,175::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1176a064-be55-4d38-bcba-6a683cecb943`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55499::DEBUG::2014-05-16 18:10:16,175::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55499::DEBUG::2014-05-16 18:10:16,175::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55499::DEBUG::2014-05-16 18:10:16,176::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1176a064-be55-4d38-bcba-6a683cecb943`::Granted request >Thread-55499::DEBUG::2014-05-16 18:10:16,176::task::811::TaskManager.Task::(resourceAcquired) Task=`3631a191-44d2-4436-8cb8-c324a58e4400`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55499::DEBUG::2014-05-16 18:10:16,176::task::974::TaskManager.Task::(_decref) Task=`3631a191-44d2-4436-8cb8-c324a58e4400`::ref 1 aborting False >Thread-55499::INFO::2014-05-16 18:10:16,177::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55499::DEBUG::2014-05-16 18:10:16,177::task::1168::TaskManager.Task::(prepare) Task=`3631a191-44d2-4436-8cb8-c324a58e4400`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55499::DEBUG::2014-05-16 18:10:16,177::task::579::TaskManager.Task::(_updateState) Task=`3631a191-44d2-4436-8cb8-c324a58e4400`::moving from state preparing -> state finished >Thread-55499::DEBUG::2014-05-16 18:10:16,177::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55499::DEBUG::2014-05-16 18:10:16,177::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55499::DEBUG::2014-05-16 18:10:16,178::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55499::DEBUG::2014-05-16 18:10:16,178::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55499::DEBUG::2014-05-16 18:10:16,178::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55499::DEBUG::2014-05-16 18:10:16,178::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55499::DEBUG::2014-05-16 18:10:16,178::task::974::TaskManager.Task::(_decref) Task=`3631a191-44d2-4436-8cb8-c324a58e4400`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:10:17,871::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:17,946::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352733 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:19,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:20,031::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358496 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:10:20,474::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:10:20,485::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000770975 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:22,044::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:22,110::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299858 s, 34.1 MB/s\n'; <rc> = 0 >Thread-55502::DEBUG::2014-05-16 18:10:23,552::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4324986.000000 / 8.017093 / 262500000.000000 = 0.205513 >Thread-55502::DEBUG::2014-05-16 18:10:23,553::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0056623301666941092, 'statsAge': 1.8081808090209961, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20551260624799386, 'rxDropped': 0} >Thread-55502::DEBUG::2014-05-16 18:10:23,553::task::579::TaskManager.Task::(_updateState) Task=`20dccbd7-7c77-46cf-98c7-d0c262c1a967`::moving from state init -> state preparing >Thread-55502::INFO::2014-05-16 18:10:23,553::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55502::INFO::2014-05-16 18:10:23,554::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770975', 'lastCheck': '3.0', 'valid': True}} >Thread-55502::DEBUG::2014-05-16 18:10:23,554::task::1168::TaskManager.Task::(prepare) Task=`20dccbd7-7c77-46cf-98c7-d0c262c1a967`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770975', 'lastCheck': '3.0', 'valid': True}} >Thread-55502::DEBUG::2014-05-16 18:10:23,554::task::579::TaskManager.Task::(_updateState) Task=`20dccbd7-7c77-46cf-98c7-d0c262c1a967`::moving from state preparing -> state finished >Thread-55502::DEBUG::2014-05-16 18:10:23,554::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55502::DEBUG::2014-05-16 18:10:23,554::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55502::DEBUG::2014-05-16 18:10:23,554::task::974::TaskManager.Task::(_decref) Task=`20dccbd7-7c77-46cf-98c7-d0c262c1a967`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:10:24,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:24,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351651 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:26,204::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55504::DEBUG::2014-05-16 18:10:26,222::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55504::DEBUG::2014-05-16 18:10:26,222::task::579::TaskManager.Task::(_updateState) Task=`47667f3a-0703-432c-a874-af8302a9f0a1`::moving from state init -> state preparing >Thread-55504::INFO::2014-05-16 18:10:26,222::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55504::INFO::2014-05-16 18:10:26,223::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55504::DEBUG::2014-05-16 18:10:26,223::task::1168::TaskManager.Task::(prepare) Task=`47667f3a-0703-432c-a874-af8302a9f0a1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55504::DEBUG::2014-05-16 18:10:26,223::task::579::TaskManager.Task::(_updateState) Task=`47667f3a-0703-432c-a874-af8302a9f0a1`::moving from state preparing -> state finished >Thread-55504::DEBUG::2014-05-16 18:10:26,223::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55504::DEBUG::2014-05-16 18:10:26,223::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55504::DEBUG::2014-05-16 18:10:26,224::task::974::TaskManager.Task::(_decref) Task=`47667f3a-0703-432c-a874-af8302a9f0a1`::ref 0 aborting False >Thread-55505::DEBUG::2014-05-16 18:10:26,248::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55505::DEBUG::2014-05-16 18:10:26,250::task::579::TaskManager.Task::(_updateState) Task=`266c5479-0c7f-4fc0-aa2e-36c259dc7d14`::moving from state init -> state preparing >Thread-55505::INFO::2014-05-16 18:10:26,251::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55505::DEBUG::2014-05-16 18:10:26,253::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4c071f4e-85f5-4dc9-b134-107992c045e4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55505::DEBUG::2014-05-16 18:10:26,254::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55505::DEBUG::2014-05-16 18:10:26,255::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55505::DEBUG::2014-05-16 18:10:26,256::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4c071f4e-85f5-4dc9-b134-107992c045e4`::Granted request >Thread-55505::DEBUG::2014-05-16 18:10:26,258::task::811::TaskManager.Task::(resourceAcquired) Task=`266c5479-0c7f-4fc0-aa2e-36c259dc7d14`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55505::DEBUG::2014-05-16 18:10:26,259::task::974::TaskManager.Task::(_decref) Task=`266c5479-0c7f-4fc0-aa2e-36c259dc7d14`::ref 1 aborting False >Thread-55505::INFO::2014-05-16 18:10:26,263::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55505::DEBUG::2014-05-16 18:10:26,263::task::1168::TaskManager.Task::(prepare) Task=`266c5479-0c7f-4fc0-aa2e-36c259dc7d14`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55505::DEBUG::2014-05-16 18:10:26,264::task::579::TaskManager.Task::(_updateState) Task=`266c5479-0c7f-4fc0-aa2e-36c259dc7d14`::moving from state preparing -> state finished >Thread-55505::DEBUG::2014-05-16 18:10:26,265::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55505::DEBUG::2014-05-16 18:10:26,266::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55505::DEBUG::2014-05-16 18:10:26,267::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55505::DEBUG::2014-05-16 18:10:26,268::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55505::DEBUG::2014-05-16 18:10:26,269::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55505::DEBUG::2014-05-16 18:10:26,270::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55505::DEBUG::2014-05-16 18:10:26,271::task::974::TaskManager.Task::(_decref) Task=`266c5479-0c7f-4fc0-aa2e-36c259dc7d14`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:10:26,301::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321825 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:28,314::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:28,382::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311151 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:30,393::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:30,465::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03498 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:10:30,531::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:10:30,542::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000790183 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:32,477::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:32,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315575 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:34,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:34,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350146 s, 29.2 MB/s\n'; <rc> = 0 >Thread-55510::DEBUG::2014-05-16 18:10:36,372::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [62fee17b] >Thread-55510::DEBUG::2014-05-16 18:10:36,372::task::579::TaskManager.Task::(_updateState) Task=`406d7320-ad50-43b2-8fd3-dd611101b7d2`::moving from state init -> state preparing >Thread-55510::INFO::2014-05-16 18:10:36,373::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55510::INFO::2014-05-16 18:10:36,373::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55510::DEBUG::2014-05-16 18:10:36,373::task::1168::TaskManager.Task::(prepare) Task=`406d7320-ad50-43b2-8fd3-dd611101b7d2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55510::DEBUG::2014-05-16 18:10:36,373::task::579::TaskManager.Task::(_updateState) Task=`406d7320-ad50-43b2-8fd3-dd611101b7d2`::moving from state preparing -> state finished >Thread-55510::DEBUG::2014-05-16 18:10:36,373::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55510::DEBUG::2014-05-16 18:10:36,374::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55510::DEBUG::2014-05-16 18:10:36,374::task::974::TaskManager.Task::(_decref) Task=`406d7320-ad50-43b2-8fd3-dd611101b7d2`::ref 0 aborting False >Thread-55511::DEBUG::2014-05-16 18:10:36,382::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [62fee17b] >Thread-55511::DEBUG::2014-05-16 18:10:36,383::task::579::TaskManager.Task::(_updateState) Task=`a2eff764-0b45-4045-a02d-b2effd4c9499`::moving from state init -> state preparing >Thread-55511::INFO::2014-05-16 18:10:36,383::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55511::DEBUG::2014-05-16 18:10:36,383::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`58179e47-7ce3-4d40-a265-4caceaea1562`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55511::DEBUG::2014-05-16 18:10:36,383::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55511::DEBUG::2014-05-16 18:10:36,384::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55511::DEBUG::2014-05-16 18:10:36,384::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`58179e47-7ce3-4d40-a265-4caceaea1562`::Granted request >Thread-55511::DEBUG::2014-05-16 18:10:36,384::task::811::TaskManager.Task::(resourceAcquired) Task=`a2eff764-0b45-4045-a02d-b2effd4c9499`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55511::DEBUG::2014-05-16 18:10:36,384::task::974::TaskManager.Task::(_decref) Task=`a2eff764-0b45-4045-a02d-b2effd4c9499`::ref 1 aborting False >Thread-55511::INFO::2014-05-16 18:10:36,385::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55511::DEBUG::2014-05-16 18:10:36,385::task::1168::TaskManager.Task::(prepare) Task=`a2eff764-0b45-4045-a02d-b2effd4c9499`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55511::DEBUG::2014-05-16 18:10:36,385::task::579::TaskManager.Task::(_updateState) Task=`a2eff764-0b45-4045-a02d-b2effd4c9499`::moving from state preparing -> state finished >Thread-55511::DEBUG::2014-05-16 18:10:36,385::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55511::DEBUG::2014-05-16 18:10:36,385::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55511::DEBUG::2014-05-16 18:10:36,386::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55511::DEBUG::2014-05-16 18:10:36,386::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55511::DEBUG::2014-05-16 18:10:36,386::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55511::DEBUG::2014-05-16 18:10:36,386::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55511::DEBUG::2014-05-16 18:10:36,386::task::974::TaskManager.Task::(_decref) Task=`a2eff764-0b45-4045-a02d-b2effd4c9499`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:10:36,645::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:36,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346416 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:38,721::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:38,790::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320473 s, 32.0 MB/s\n'; <rc> = 0 >Thread-55512::DEBUG::2014-05-16 18:10:38,816::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319604.000000 / 8.009278 / 262500000.000000 = 0.205457 >Thread-55512::DEBUG::2014-05-16 18:10:38,816::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0058037454268756797, 'statsAge': 1.053861141204834, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20545715424450001, 'rxDropped': 0} >Thread-55512::DEBUG::2014-05-16 18:10:38,816::task::579::TaskManager.Task::(_updateState) Task=`a06aa0b0-884e-43c2-90d3-e5e754a3a1fd`::moving from state init -> state preparing >Thread-55512::INFO::2014-05-16 18:10:38,817::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55512::INFO::2014-05-16 18:10:38,817::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790183', 'lastCheck': '8.3', 'valid': True}} >Thread-55512::DEBUG::2014-05-16 18:10:38,817::task::1168::TaskManager.Task::(prepare) Task=`a06aa0b0-884e-43c2-90d3-e5e754a3a1fd`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790183', 'lastCheck': '8.3', 'valid': True}} >Thread-55512::DEBUG::2014-05-16 18:10:38,817::task::579::TaskManager.Task::(_updateState) Task=`a06aa0b0-884e-43c2-90d3-e5e754a3a1fd`::moving from state preparing -> state finished >Thread-55512::DEBUG::2014-05-16 18:10:38,817::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55512::DEBUG::2014-05-16 18:10:38,817::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55512::DEBUG::2014-05-16 18:10:38,818::task::974::TaskManager.Task::(_decref) Task=`a06aa0b0-884e-43c2-90d3-e5e754a3a1fd`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:10:40,575::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:10:40,586::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000954471 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:40,802::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:40,872::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349812 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:42,884::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:42,952::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319964 s, 32.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:44,964::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:45,040::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0397235 s, 25.8 MB/s\n'; <rc> = 0 >Thread-55516::DEBUG::2014-05-16 18:10:46,427::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55516::DEBUG::2014-05-16 18:10:46,428::task::579::TaskManager.Task::(_updateState) Task=`aef107a5-33f8-4487-88a6-249481677c34`::moving from state init -> state preparing >Thread-55516::INFO::2014-05-16 18:10:46,428::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55516::INFO::2014-05-16 18:10:46,428::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55516::DEBUG::2014-05-16 18:10:46,428::task::1168::TaskManager.Task::(prepare) Task=`aef107a5-33f8-4487-88a6-249481677c34`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55516::DEBUG::2014-05-16 18:10:46,428::task::579::TaskManager.Task::(_updateState) Task=`aef107a5-33f8-4487-88a6-249481677c34`::moving from state preparing -> state finished >Thread-55516::DEBUG::2014-05-16 18:10:46,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55516::DEBUG::2014-05-16 18:10:46,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55516::DEBUG::2014-05-16 18:10:46,429::task::974::TaskManager.Task::(_decref) Task=`aef107a5-33f8-4487-88a6-249481677c34`::ref 0 aborting False >Thread-55517::DEBUG::2014-05-16 18:10:46,444::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55517::DEBUG::2014-05-16 18:10:46,444::task::579::TaskManager.Task::(_updateState) Task=`220e3a56-a366-4fee-a2fb-b212e8a25b66`::moving from state init -> state preparing >Thread-55517::INFO::2014-05-16 18:10:46,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55517::DEBUG::2014-05-16 18:10:46,445::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5f067aa4-3405-4ce3-b0a3-69bc0e0fb9b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55517::DEBUG::2014-05-16 18:10:46,445::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55517::DEBUG::2014-05-16 18:10:46,445::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55517::DEBUG::2014-05-16 18:10:46,445::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5f067aa4-3405-4ce3-b0a3-69bc0e0fb9b1`::Granted request >Thread-55517::DEBUG::2014-05-16 18:10:46,445::task::811::TaskManager.Task::(resourceAcquired) Task=`220e3a56-a366-4fee-a2fb-b212e8a25b66`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55517::DEBUG::2014-05-16 18:10:46,446::task::974::TaskManager.Task::(_decref) Task=`220e3a56-a366-4fee-a2fb-b212e8a25b66`::ref 1 aborting False >Thread-55517::INFO::2014-05-16 18:10:46,446::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55517::DEBUG::2014-05-16 18:10:46,446::task::1168::TaskManager.Task::(prepare) Task=`220e3a56-a366-4fee-a2fb-b212e8a25b66`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55517::DEBUG::2014-05-16 18:10:46,446::task::579::TaskManager.Task::(_updateState) Task=`220e3a56-a366-4fee-a2fb-b212e8a25b66`::moving from state preparing -> state finished >Thread-55517::DEBUG::2014-05-16 18:10:46,447::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55517::DEBUG::2014-05-16 18:10:46,447::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55517::DEBUG::2014-05-16 18:10:46,447::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55517::DEBUG::2014-05-16 18:10:46,447::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55517::DEBUG::2014-05-16 18:10:46,447::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55517::DEBUG::2014-05-16 18:10:46,447::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55517::DEBUG::2014-05-16 18:10:46,448::task::974::TaskManager.Task::(_decref) Task=`220e3a56-a366-4fee-a2fb-b212e8a25b66`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:10:47,052::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:47,119::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300541 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:49,130::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:49,197::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312554 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:10:50,622::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:10:50,633::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106263 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:51,209::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:51,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034271 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:53,291::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:53,360::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032494 s, 31.5 MB/s\n'; <rc> = 0 >Thread-55520::DEBUG::2014-05-16 18:10:54,027::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5425229.000000 / 8.008578 / 262500000.000000 = 0.258068 >Thread-55520::DEBUG::2014-05-16 18:10:54,027::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0074821676638723161, 'statsAge': 0.24857687950134277, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25806752319161791, 'rxDropped': 0} >Thread-55520::DEBUG::2014-05-16 18:10:54,028::task::579::TaskManager.Task::(_updateState) Task=`d3c9f3eb-9c22-4861-8b58-f903bc97d964`::moving from state init -> state preparing >Thread-55520::INFO::2014-05-16 18:10:54,028::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55520::INFO::2014-05-16 18:10:54,029::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106263', 'lastCheck': '3.4', 'valid': True}} >Thread-55520::DEBUG::2014-05-16 18:10:54,029::task::1168::TaskManager.Task::(prepare) Task=`d3c9f3eb-9c22-4861-8b58-f903bc97d964`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106263', 'lastCheck': '3.4', 'valid': True}} >Thread-55520::DEBUG::2014-05-16 18:10:54,029::task::579::TaskManager.Task::(_updateState) Task=`d3c9f3eb-9c22-4861-8b58-f903bc97d964`::moving from state preparing -> state finished >Thread-55520::DEBUG::2014-05-16 18:10:54,029::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55520::DEBUG::2014-05-16 18:10:54,029::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55520::DEBUG::2014-05-16 18:10:54,029::task::974::TaskManager.Task::(_decref) Task=`d3c9f3eb-9c22-4861-8b58-f903bc97d964`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:10:55,371::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:55,438::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303594 s, 33.7 MB/s\n'; <rc> = 0 >Thread-55522::DEBUG::2014-05-16 18:10:56,498::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55522::DEBUG::2014-05-16 18:10:56,498::task::579::TaskManager.Task::(_updateState) Task=`3690226f-78a3-4a8a-abe0-c90e662314ff`::moving from state init -> state preparing >Thread-55522::INFO::2014-05-16 18:10:56,498::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55522::INFO::2014-05-16 18:10:56,499::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55522::DEBUG::2014-05-16 18:10:56,499::task::1168::TaskManager.Task::(prepare) Task=`3690226f-78a3-4a8a-abe0-c90e662314ff`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55522::DEBUG::2014-05-16 18:10:56,499::task::579::TaskManager.Task::(_updateState) Task=`3690226f-78a3-4a8a-abe0-c90e662314ff`::moving from state preparing -> state finished >Thread-55522::DEBUG::2014-05-16 18:10:56,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55522::DEBUG::2014-05-16 18:10:56,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55522::DEBUG::2014-05-16 18:10:56,500::task::974::TaskManager.Task::(_decref) Task=`3690226f-78a3-4a8a-abe0-c90e662314ff`::ref 0 aborting False >Thread-55523::DEBUG::2014-05-16 18:10:56,508::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55523::DEBUG::2014-05-16 18:10:56,509::task::579::TaskManager.Task::(_updateState) Task=`3f030057-5e8a-4804-87fb-1609da53f151`::moving from state init -> state preparing >Thread-55523::INFO::2014-05-16 18:10:56,509::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55523::DEBUG::2014-05-16 18:10:56,509::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b1df76ac-2dd9-4f50-80f3-4872d6007953`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55523::DEBUG::2014-05-16 18:10:56,509::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55523::DEBUG::2014-05-16 18:10:56,510::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55523::DEBUG::2014-05-16 18:10:56,510::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b1df76ac-2dd9-4f50-80f3-4872d6007953`::Granted request >Thread-55523::DEBUG::2014-05-16 18:10:56,510::task::811::TaskManager.Task::(resourceAcquired) Task=`3f030057-5e8a-4804-87fb-1609da53f151`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55523::DEBUG::2014-05-16 18:10:56,510::task::974::TaskManager.Task::(_decref) Task=`3f030057-5e8a-4804-87fb-1609da53f151`::ref 1 aborting False >Thread-55523::INFO::2014-05-16 18:10:56,511::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55523::DEBUG::2014-05-16 18:10:56,511::task::1168::TaskManager.Task::(prepare) Task=`3f030057-5e8a-4804-87fb-1609da53f151`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55523::DEBUG::2014-05-16 18:10:56,511::task::579::TaskManager.Task::(_updateState) Task=`3f030057-5e8a-4804-87fb-1609da53f151`::moving from state preparing -> state finished >Thread-55523::DEBUG::2014-05-16 18:10:56,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55523::DEBUG::2014-05-16 18:10:56,512::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55523::DEBUG::2014-05-16 18:10:56,512::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55523::DEBUG::2014-05-16 18:10:56,512::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55523::DEBUG::2014-05-16 18:10:56,512::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55523::DEBUG::2014-05-16 18:10:56,512::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55523::DEBUG::2014-05-16 18:10:56,512::task::974::TaskManager.Task::(_decref) Task=`3f030057-5e8a-4804-87fb-1609da53f151`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:10:57,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:57,521::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345635 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:10:59,532::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:10:59,600::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316239 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:11:00,670::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:11:00,681::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000772773 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:01,612::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:01,679::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305724 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:03,691::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:03,756::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356149 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:05,763::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:05,842::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423115 s, 24.2 MB/s\n'; <rc> = 0 >Thread-55528::DEBUG::2014-05-16 18:11:06,722::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55528::DEBUG::2014-05-16 18:11:06,722::task::579::TaskManager.Task::(_updateState) Task=`205c1502-2455-46e6-83c9-010533ae36ae`::moving from state init -> state preparing >Thread-55528::INFO::2014-05-16 18:11:06,723::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55528::INFO::2014-05-16 18:11:06,723::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55528::DEBUG::2014-05-16 18:11:06,723::task::1168::TaskManager.Task::(prepare) Task=`205c1502-2455-46e6-83c9-010533ae36ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55528::DEBUG::2014-05-16 18:11:06,723::task::579::TaskManager.Task::(_updateState) Task=`205c1502-2455-46e6-83c9-010533ae36ae`::moving from state preparing -> state finished >Thread-55528::DEBUG::2014-05-16 18:11:06,723::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55528::DEBUG::2014-05-16 18:11:06,724::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55528::DEBUG::2014-05-16 18:11:06,724::task::974::TaskManager.Task::(_decref) Task=`205c1502-2455-46e6-83c9-010533ae36ae`::ref 0 aborting False >Thread-55529::DEBUG::2014-05-16 18:11:06,737::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55529::DEBUG::2014-05-16 18:11:06,738::task::579::TaskManager.Task::(_updateState) Task=`9f73a9f2-87c3-4cf1-b067-68bdb4ea9b15`::moving from state init -> state preparing >Thread-55529::INFO::2014-05-16 18:11:06,738::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55529::DEBUG::2014-05-16 18:11:06,738::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`44c5d3d9-c4bf-4133-a06c-1341fd03dff2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55529::DEBUG::2014-05-16 18:11:06,738::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55529::DEBUG::2014-05-16 18:11:06,739::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55529::DEBUG::2014-05-16 18:11:06,739::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`44c5d3d9-c4bf-4133-a06c-1341fd03dff2`::Granted request >Thread-55529::DEBUG::2014-05-16 18:11:06,739::task::811::TaskManager.Task::(resourceAcquired) Task=`9f73a9f2-87c3-4cf1-b067-68bdb4ea9b15`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55529::DEBUG::2014-05-16 18:11:06,739::task::974::TaskManager.Task::(_decref) Task=`9f73a9f2-87c3-4cf1-b067-68bdb4ea9b15`::ref 1 aborting False >Thread-55529::INFO::2014-05-16 18:11:06,740::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55529::DEBUG::2014-05-16 18:11:06,740::task::1168::TaskManager.Task::(prepare) Task=`9f73a9f2-87c3-4cf1-b067-68bdb4ea9b15`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55529::DEBUG::2014-05-16 18:11:06,740::task::579::TaskManager.Task::(_updateState) Task=`9f73a9f2-87c3-4cf1-b067-68bdb4ea9b15`::moving from state preparing -> state finished >Thread-55529::DEBUG::2014-05-16 18:11:06,740::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55529::DEBUG::2014-05-16 18:11:06,740::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55529::DEBUG::2014-05-16 18:11:06,741::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55529::DEBUG::2014-05-16 18:11:06,741::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55529::DEBUG::2014-05-16 18:11:06,741::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55529::DEBUG::2014-05-16 18:11:06,741::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55529::DEBUG::2014-05-16 18:11:06,741::task::974::TaskManager.Task::(_decref) Task=`9f73a9f2-87c3-4cf1-b067-68bdb4ea9b15`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:11:07,853::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:07,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296675 s, 34.5 MB/s\n'; <rc> = 0 >Thread-55530::DEBUG::2014-05-16 18:11:09,215::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4341672.000000 / 8.012908 / 262500000.000000 = 0.206413 >Thread-55530::DEBUG::2014-05-16 18:11:09,215::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054666082114663232, 'statsAge': 1.4166820049285889, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20641323842181009, 'rxDropped': 0} >Thread-55530::DEBUG::2014-05-16 18:11:09,216::task::579::TaskManager.Task::(_updateState) Task=`400b9e26-bdd4-4b32-a585-14ab5dc0e106`::moving from state init -> state preparing >Thread-55530::INFO::2014-05-16 18:11:09,216::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55530::INFO::2014-05-16 18:11:09,216::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000772773', 'lastCheck': '8.5', 'valid': True}} >Thread-55530::DEBUG::2014-05-16 18:11:09,216::task::1168::TaskManager.Task::(prepare) Task=`400b9e26-bdd4-4b32-a585-14ab5dc0e106`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000772773', 'lastCheck': '8.5', 'valid': True}} >Thread-55530::DEBUG::2014-05-16 18:11:09,216::task::579::TaskManager.Task::(_updateState) Task=`400b9e26-bdd4-4b32-a585-14ab5dc0e106`::moving from state preparing -> state finished >Thread-55530::DEBUG::2014-05-16 18:11:09,217::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55530::DEBUG::2014-05-16 18:11:09,217::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55530::DEBUG::2014-05-16 18:11:09,217::task::974::TaskManager.Task::(_decref) Task=`400b9e26-bdd4-4b32-a585-14ab5dc0e106`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:11:09,931::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:10,001::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348363 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:11:10,718::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:11:10,728::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000775034 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:12,013::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:12,084::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035562 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:14,096::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:14,163::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313965 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:16,175::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:16,242::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310469 s, 33.0 MB/s\n'; <rc> = 0 >Thread-55534::DEBUG::2014-05-16 18:11:16,773::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55534::DEBUG::2014-05-16 18:11:16,773::task::579::TaskManager.Task::(_updateState) Task=`464ea7d1-8da1-4464-8950-2b7a9326c3e9`::moving from state init -> state preparing >Thread-55534::INFO::2014-05-16 18:11:16,774::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55534::INFO::2014-05-16 18:11:16,774::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55534::DEBUG::2014-05-16 18:11:16,774::task::1168::TaskManager.Task::(prepare) Task=`464ea7d1-8da1-4464-8950-2b7a9326c3e9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55534::DEBUG::2014-05-16 18:11:16,774::task::579::TaskManager.Task::(_updateState) Task=`464ea7d1-8da1-4464-8950-2b7a9326c3e9`::moving from state preparing -> state finished >Thread-55534::DEBUG::2014-05-16 18:11:16,774::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55534::DEBUG::2014-05-16 18:11:16,775::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55534::DEBUG::2014-05-16 18:11:16,775::task::974::TaskManager.Task::(_decref) Task=`464ea7d1-8da1-4464-8950-2b7a9326c3e9`::ref 0 aborting False >Thread-55535::DEBUG::2014-05-16 18:11:16,835::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55535::DEBUG::2014-05-16 18:11:16,835::task::579::TaskManager.Task::(_updateState) Task=`08f40dd2-0042-43b4-9377-fcd3691ac61e`::moving from state init -> state preparing >Thread-55535::INFO::2014-05-16 18:11:16,835::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55535::DEBUG::2014-05-16 18:11:16,836::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3247df2c-c1b3-4d90-8813-37ce8d45f88a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55535::DEBUG::2014-05-16 18:11:16,836::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55535::DEBUG::2014-05-16 18:11:16,836::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55535::DEBUG::2014-05-16 18:11:16,836::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3247df2c-c1b3-4d90-8813-37ce8d45f88a`::Granted request >Thread-55535::DEBUG::2014-05-16 18:11:16,837::task::811::TaskManager.Task::(resourceAcquired) Task=`08f40dd2-0042-43b4-9377-fcd3691ac61e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55535::DEBUG::2014-05-16 18:11:16,837::task::974::TaskManager.Task::(_decref) Task=`08f40dd2-0042-43b4-9377-fcd3691ac61e`::ref 1 aborting False >Thread-55535::INFO::2014-05-16 18:11:16,837::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55535::DEBUG::2014-05-16 18:11:16,838::task::1168::TaskManager.Task::(prepare) Task=`08f40dd2-0042-43b4-9377-fcd3691ac61e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55535::DEBUG::2014-05-16 18:11:16,838::task::579::TaskManager.Task::(_updateState) Task=`08f40dd2-0042-43b4-9377-fcd3691ac61e`::moving from state preparing -> state finished >Thread-55535::DEBUG::2014-05-16 18:11:16,838::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55535::DEBUG::2014-05-16 18:11:16,838::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55535::DEBUG::2014-05-16 18:11:16,838::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55535::DEBUG::2014-05-16 18:11:16,838::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55535::DEBUG::2014-05-16 18:11:16,839::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55535::DEBUG::2014-05-16 18:11:16,839::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55535::DEBUG::2014-05-16 18:11:16,839::task::974::TaskManager.Task::(_decref) Task=`08f40dd2-0042-43b4-9377-fcd3691ac61e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:11:18,254::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:18,325::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355259 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:20,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:20,408::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350032 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:11:20,766::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:11:20,776::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764057 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:22,419::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:22,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305404 s, 33.5 MB/s\n'; <rc> = 0 >Thread-55538::DEBUG::2014-05-16 18:11:24,419::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318509.000000 / 8.008252 / 262500000.000000 = 0.205431 >Thread-55538::DEBUG::2014-05-16 18:11:24,420::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053869194861560334, 'statsAge': 0.60438990592956543, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20543137955211144, 'rxDropped': 0} >Thread-55538::DEBUG::2014-05-16 18:11:24,420::task::579::TaskManager.Task::(_updateState) Task=`8068d789-5cf5-434a-8fb4-243453a4696a`::moving from state init -> state preparing >Thread-55538::INFO::2014-05-16 18:11:24,420::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55538::INFO::2014-05-16 18:11:24,421::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764057', 'lastCheck': '3.6', 'valid': True}} >Thread-55538::DEBUG::2014-05-16 18:11:24,421::task::1168::TaskManager.Task::(prepare) Task=`8068d789-5cf5-434a-8fb4-243453a4696a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764057', 'lastCheck': '3.6', 'valid': True}} >Thread-55538::DEBUG::2014-05-16 18:11:24,421::task::579::TaskManager.Task::(_updateState) Task=`8068d789-5cf5-434a-8fb4-243453a4696a`::moving from state preparing -> state finished >Thread-55538::DEBUG::2014-05-16 18:11:24,421::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55538::DEBUG::2014-05-16 18:11:24,421::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55538::DEBUG::2014-05-16 18:11:24,421::task::974::TaskManager.Task::(_decref) Task=`8068d789-5cf5-434a-8fb4-243453a4696a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:11:24,498::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:24,570::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354008 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:26,582::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:26,653::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350555 s, 29.2 MB/s\n'; <rc> = 0 >Thread-55540::DEBUG::2014-05-16 18:11:26,889::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55540::DEBUG::2014-05-16 18:11:26,889::task::579::TaskManager.Task::(_updateState) Task=`cd8408b1-e0c9-4d24-96d5-ded55fab7f09`::moving from state init -> state preparing >Thread-55540::INFO::2014-05-16 18:11:26,890::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55540::INFO::2014-05-16 18:11:26,890::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55540::DEBUG::2014-05-16 18:11:26,890::task::1168::TaskManager.Task::(prepare) Task=`cd8408b1-e0c9-4d24-96d5-ded55fab7f09`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55540::DEBUG::2014-05-16 18:11:26,890::task::579::TaskManager.Task::(_updateState) Task=`cd8408b1-e0c9-4d24-96d5-ded55fab7f09`::moving from state preparing -> state finished >Thread-55540::DEBUG::2014-05-16 18:11:26,890::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55540::DEBUG::2014-05-16 18:11:26,891::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55540::DEBUG::2014-05-16 18:11:26,891::task::974::TaskManager.Task::(_decref) Task=`cd8408b1-e0c9-4d24-96d5-ded55fab7f09`::ref 0 aborting False >Thread-55541::DEBUG::2014-05-16 18:11:26,908::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55541::DEBUG::2014-05-16 18:11:26,908::task::579::TaskManager.Task::(_updateState) Task=`ccd62e71-c8cc-4478-a105-0d1ea1326be4`::moving from state init -> state preparing >Thread-55541::INFO::2014-05-16 18:11:26,908::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55541::DEBUG::2014-05-16 18:11:26,909::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7063a6c1-8f28-4e28-aa87-1f659d1140a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55541::DEBUG::2014-05-16 18:11:26,909::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55541::DEBUG::2014-05-16 18:11:26,909::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55541::DEBUG::2014-05-16 18:11:26,909::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7063a6c1-8f28-4e28-aa87-1f659d1140a9`::Granted request >Thread-55541::DEBUG::2014-05-16 18:11:26,910::task::811::TaskManager.Task::(resourceAcquired) Task=`ccd62e71-c8cc-4478-a105-0d1ea1326be4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55541::DEBUG::2014-05-16 18:11:26,910::task::974::TaskManager.Task::(_decref) Task=`ccd62e71-c8cc-4478-a105-0d1ea1326be4`::ref 1 aborting False >Thread-55541::INFO::2014-05-16 18:11:26,910::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55541::DEBUG::2014-05-16 18:11:26,911::task::1168::TaskManager.Task::(prepare) Task=`ccd62e71-c8cc-4478-a105-0d1ea1326be4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55541::DEBUG::2014-05-16 18:11:26,911::task::579::TaskManager.Task::(_updateState) Task=`ccd62e71-c8cc-4478-a105-0d1ea1326be4`::moving from state preparing -> state finished >Thread-55541::DEBUG::2014-05-16 18:11:26,911::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55541::DEBUG::2014-05-16 18:11:26,911::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55541::DEBUG::2014-05-16 18:11:26,911::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55541::DEBUG::2014-05-16 18:11:26,912::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55541::DEBUG::2014-05-16 18:11:26,912::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55541::DEBUG::2014-05-16 18:11:26,912::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55541::DEBUG::2014-05-16 18:11:26,912::task::974::TaskManager.Task::(_decref) Task=`ccd62e71-c8cc-4478-a105-0d1ea1326be4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:11:28,665::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:28,732::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301243 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:30,743::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 18:11:30,919::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:11:30,956::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000762897 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:31,017::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313053 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:33,061::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:33,132::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349511 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:35,144::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:35,214::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347201 s, 29.5 MB/s\n'; <rc> = 0 >Thread-55546::DEBUG::2014-05-16 18:11:36,989::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55546::DEBUG::2014-05-16 18:11:36,990::task::579::TaskManager.Task::(_updateState) Task=`a6f66c75-c8bd-40fa-94f6-c89639319c05`::moving from state init -> state preparing >Thread-55546::INFO::2014-05-16 18:11:36,990::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55546::INFO::2014-05-16 18:11:36,990::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55546::DEBUG::2014-05-16 18:11:36,990::task::1168::TaskManager.Task::(prepare) Task=`a6f66c75-c8bd-40fa-94f6-c89639319c05`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55546::DEBUG::2014-05-16 18:11:36,990::task::579::TaskManager.Task::(_updateState) Task=`a6f66c75-c8bd-40fa-94f6-c89639319c05`::moving from state preparing -> state finished >Thread-55546::DEBUG::2014-05-16 18:11:36,991::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55546::DEBUG::2014-05-16 18:11:36,991::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55546::DEBUG::2014-05-16 18:11:36,991::task::974::TaskManager.Task::(_decref) Task=`a6f66c75-c8bd-40fa-94f6-c89639319c05`::ref 0 aborting False >Thread-55547::DEBUG::2014-05-16 18:11:37,050::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55547::DEBUG::2014-05-16 18:11:37,050::task::579::TaskManager.Task::(_updateState) Task=`7a34e92e-11bd-48c9-b7d5-4e1e9630df52`::moving from state init -> state preparing >Thread-55547::INFO::2014-05-16 18:11:37,050::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55547::DEBUG::2014-05-16 18:11:37,051::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f56dc4b4-f172-40f7-ba50-0c78985a104b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55547::DEBUG::2014-05-16 18:11:37,051::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55547::DEBUG::2014-05-16 18:11:37,051::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55547::DEBUG::2014-05-16 18:11:37,051::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f56dc4b4-f172-40f7-ba50-0c78985a104b`::Granted request >Thread-55547::DEBUG::2014-05-16 18:11:37,051::task::811::TaskManager.Task::(resourceAcquired) Task=`7a34e92e-11bd-48c9-b7d5-4e1e9630df52`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55547::DEBUG::2014-05-16 18:11:37,051::task::974::TaskManager.Task::(_decref) Task=`7a34e92e-11bd-48c9-b7d5-4e1e9630df52`::ref 1 aborting False >Thread-55547::INFO::2014-05-16 18:11:37,052::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55547::DEBUG::2014-05-16 18:11:37,052::task::1168::TaskManager.Task::(prepare) Task=`7a34e92e-11bd-48c9-b7d5-4e1e9630df52`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55547::DEBUG::2014-05-16 18:11:37,052::task::579::TaskManager.Task::(_updateState) Task=`7a34e92e-11bd-48c9-b7d5-4e1e9630df52`::moving from state preparing -> state finished >Thread-55547::DEBUG::2014-05-16 18:11:37,052::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55547::DEBUG::2014-05-16 18:11:37,053::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55547::DEBUG::2014-05-16 18:11:37,053::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55547::DEBUG::2014-05-16 18:11:37,053::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55547::DEBUG::2014-05-16 18:11:37,053::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55547::DEBUG::2014-05-16 18:11:37,053::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55547::DEBUG::2014-05-16 18:11:37,053::task::974::TaskManager.Task::(_decref) Task=`7a34e92e-11bd-48c9-b7d5-4e1e9630df52`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:11:37,226::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:37,292::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303864 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:39,303::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:39,375::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356552 s, 28.7 MB/s\n'; <rc> = 0 >Thread-55548::DEBUG::2014-05-16 18:11:39,608::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316919.000000 / 8.009292 / 262500000.000000 = 0.205329 >Thread-55548::DEBUG::2014-05-16 18:11:39,608::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053994427481223123, 'statsAge': 1.773360013961792, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20532907847763762, 'rxDropped': 0} >Thread-55548::DEBUG::2014-05-16 18:11:39,609::task::579::TaskManager.Task::(_updateState) Task=`26031dfc-7b87-4fe5-b592-354f6df009aa`::moving from state init -> state preparing >Thread-55548::INFO::2014-05-16 18:11:39,609::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55548::INFO::2014-05-16 18:11:39,609::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000762897', 'lastCheck': '8.6', 'valid': True}} >Thread-55548::DEBUG::2014-05-16 18:11:39,609::task::1168::TaskManager.Task::(prepare) Task=`26031dfc-7b87-4fe5-b592-354f6df009aa`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000762897', 'lastCheck': '8.6', 'valid': True}} >Thread-55548::DEBUG::2014-05-16 18:11:39,610::task::579::TaskManager.Task::(_updateState) Task=`26031dfc-7b87-4fe5-b592-354f6df009aa`::moving from state preparing -> state finished >Thread-55548::DEBUG::2014-05-16 18:11:39,610::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55548::DEBUG::2014-05-16 18:11:39,610::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55548::DEBUG::2014-05-16 18:11:39,610::task::974::TaskManager.Task::(_decref) Task=`26031dfc-7b87-4fe5-b592-354f6df009aa`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:11:41,051::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 18:11:41,052::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:11:41,070::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:11:41,079::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000719595 s, 2.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:11:41,079::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000719595 s, 2.8 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 18:11:41,079::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 18:11:41,080::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 18:11:41,080::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:11:41,080::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:11:41,080::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:11:41,081::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:11:41,081::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:11:41,081::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:11:41,082::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:41,387::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 18:11:41,400::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:11:41,403::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:11:41,403::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 18:11:41,405::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 18:11:41,405::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 18:11:41,405::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 18:11:41,406::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:41,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0404141 s, 25.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:11:41,553::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:11:41,573::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:11:41,584::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694879 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:43,479::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:43,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298779 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:45,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:45,627::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348826 s, 29.4 MB/s\n'; <rc> = 0 >Thread-55552::DEBUG::2014-05-16 18:11:47,084::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55552::DEBUG::2014-05-16 18:11:47,084::task::579::TaskManager.Task::(_updateState) Task=`13f39153-84a4-4b81-a839-56d61744b836`::moving from state init -> state preparing >Thread-55552::INFO::2014-05-16 18:11:47,084::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55552::INFO::2014-05-16 18:11:47,085::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55552::DEBUG::2014-05-16 18:11:47,085::task::1168::TaskManager.Task::(prepare) Task=`13f39153-84a4-4b81-a839-56d61744b836`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55552::DEBUG::2014-05-16 18:11:47,085::task::579::TaskManager.Task::(_updateState) Task=`13f39153-84a4-4b81-a839-56d61744b836`::moving from state preparing -> state finished >Thread-55552::DEBUG::2014-05-16 18:11:47,085::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55552::DEBUG::2014-05-16 18:11:47,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55552::DEBUG::2014-05-16 18:11:47,085::task::974::TaskManager.Task::(_decref) Task=`13f39153-84a4-4b81-a839-56d61744b836`::ref 0 aborting False >Thread-55553::DEBUG::2014-05-16 18:11:47,093::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55553::DEBUG::2014-05-16 18:11:47,094::task::579::TaskManager.Task::(_updateState) Task=`a0866aa4-e7a8-413b-9953-78ab1651fd9e`::moving from state init -> state preparing >Thread-55553::INFO::2014-05-16 18:11:47,094::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55553::DEBUG::2014-05-16 18:11:47,094::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`028e999e-322f-44c0-8ba8-6ca33515c4ac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55553::DEBUG::2014-05-16 18:11:47,094::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55553::DEBUG::2014-05-16 18:11:47,094::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55553::DEBUG::2014-05-16 18:11:47,095::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`028e999e-322f-44c0-8ba8-6ca33515c4ac`::Granted request >Thread-55553::DEBUG::2014-05-16 18:11:47,095::task::811::TaskManager.Task::(resourceAcquired) Task=`a0866aa4-e7a8-413b-9953-78ab1651fd9e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55553::DEBUG::2014-05-16 18:11:47,095::task::974::TaskManager.Task::(_decref) Task=`a0866aa4-e7a8-413b-9953-78ab1651fd9e`::ref 1 aborting False >Thread-55553::INFO::2014-05-16 18:11:47,096::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55553::DEBUG::2014-05-16 18:11:47,096::task::1168::TaskManager.Task::(prepare) Task=`a0866aa4-e7a8-413b-9953-78ab1651fd9e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55553::DEBUG::2014-05-16 18:11:47,096::task::579::TaskManager.Task::(_updateState) Task=`a0866aa4-e7a8-413b-9953-78ab1651fd9e`::moving from state preparing -> state finished >Thread-55553::DEBUG::2014-05-16 18:11:47,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55553::DEBUG::2014-05-16 18:11:47,096::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55553::DEBUG::2014-05-16 18:11:47,096::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55553::DEBUG::2014-05-16 18:11:47,097::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55553::DEBUG::2014-05-16 18:11:47,097::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55553::DEBUG::2014-05-16 18:11:47,097::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55553::DEBUG::2014-05-16 18:11:47,097::task::974::TaskManager.Task::(_decref) Task=`a0866aa4-e7a8-413b-9953-78ab1651fd9e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:11:47,639::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:47,706::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309707 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:49,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:49,785::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310758 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:11:51,622::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:11:51,633::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100761 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:51,796::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:51,868::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306756 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:11:53,879::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:53,952::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357784 s, 28.6 MB/s\n'; <rc> = 0 >Thread-55556::DEBUG::2014-05-16 18:11:54,762::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4342029.000000 / 8.011499 / 262500000.000000 = 0.206467 >Thread-55556::DEBUG::2014-05-16 18:11:54,763::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0060073650386577998, 'statsAge': 0.90796279907226562, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20646651161536128, 'rxDropped': 0} >Thread-55556::DEBUG::2014-05-16 18:11:54,763::task::579::TaskManager.Task::(_updateState) Task=`010a1d87-30a1-440d-adc7-fab022b8ef49`::moving from state init -> state preparing >Thread-55556::INFO::2014-05-16 18:11:54,763::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55556::INFO::2014-05-16 18:11:54,764::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100761', 'lastCheck': '3.1', 'valid': True}} >Thread-55556::DEBUG::2014-05-16 18:11:54,764::task::1168::TaskManager.Task::(prepare) Task=`010a1d87-30a1-440d-adc7-fab022b8ef49`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100761', 'lastCheck': '3.1', 'valid': True}} >Thread-55556::DEBUG::2014-05-16 18:11:54,764::task::579::TaskManager.Task::(_updateState) Task=`010a1d87-30a1-440d-adc7-fab022b8ef49`::moving from state preparing -> state finished >Thread-55556::DEBUG::2014-05-16 18:11:54,764::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55556::DEBUG::2014-05-16 18:11:54,764::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55556::DEBUG::2014-05-16 18:11:54,765::task::974::TaskManager.Task::(_decref) Task=`010a1d87-30a1-440d-adc7-fab022b8ef49`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:11:55,964::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:56,037::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356878 s, 28.7 MB/s\n'; <rc> = 0 >Thread-55558::DEBUG::2014-05-16 18:11:57,277::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55558::DEBUG::2014-05-16 18:11:57,277::task::579::TaskManager.Task::(_updateState) Task=`60686c9f-c270-4836-bff5-f85c8fe2edd0`::moving from state init -> state preparing >Thread-55558::INFO::2014-05-16 18:11:57,277::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55558::INFO::2014-05-16 18:11:57,278::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55558::DEBUG::2014-05-16 18:11:57,278::task::1168::TaskManager.Task::(prepare) Task=`60686c9f-c270-4836-bff5-f85c8fe2edd0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55558::DEBUG::2014-05-16 18:11:57,278::task::579::TaskManager.Task::(_updateState) Task=`60686c9f-c270-4836-bff5-f85c8fe2edd0`::moving from state preparing -> state finished >Thread-55558::DEBUG::2014-05-16 18:11:57,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55558::DEBUG::2014-05-16 18:11:57,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55558::DEBUG::2014-05-16 18:11:57,278::task::974::TaskManager.Task::(_decref) Task=`60686c9f-c270-4836-bff5-f85c8fe2edd0`::ref 0 aborting False >Thread-55559::DEBUG::2014-05-16 18:11:57,288::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55559::DEBUG::2014-05-16 18:11:57,288::task::579::TaskManager.Task::(_updateState) Task=`10bf23bc-1dac-4fb4-9fe2-4b02e46d9c27`::moving from state init -> state preparing >Thread-55559::INFO::2014-05-16 18:11:57,288::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55559::DEBUG::2014-05-16 18:11:57,289::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a24b89f5-e38e-427c-860a-c7181e78af13`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55559::DEBUG::2014-05-16 18:11:57,289::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55559::DEBUG::2014-05-16 18:11:57,289::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55559::DEBUG::2014-05-16 18:11:57,289::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a24b89f5-e38e-427c-860a-c7181e78af13`::Granted request >Thread-55559::DEBUG::2014-05-16 18:11:57,290::task::811::TaskManager.Task::(resourceAcquired) Task=`10bf23bc-1dac-4fb4-9fe2-4b02e46d9c27`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55559::DEBUG::2014-05-16 18:11:57,290::task::974::TaskManager.Task::(_decref) Task=`10bf23bc-1dac-4fb4-9fe2-4b02e46d9c27`::ref 1 aborting False >Thread-55559::INFO::2014-05-16 18:11:57,291::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55559::DEBUG::2014-05-16 18:11:57,291::task::1168::TaskManager.Task::(prepare) Task=`10bf23bc-1dac-4fb4-9fe2-4b02e46d9c27`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55559::DEBUG::2014-05-16 18:11:57,291::task::579::TaskManager.Task::(_updateState) Task=`10bf23bc-1dac-4fb4-9fe2-4b02e46d9c27`::moving from state preparing -> state finished >Thread-55559::DEBUG::2014-05-16 18:11:57,291::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55559::DEBUG::2014-05-16 18:11:57,291::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55559::DEBUG::2014-05-16 18:11:57,291::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55559::DEBUG::2014-05-16 18:11:57,292::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55559::DEBUG::2014-05-16 18:11:57,292::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55559::DEBUG::2014-05-16 18:11:57,292::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55559::DEBUG::2014-05-16 18:11:57,292::task::974::TaskManager.Task::(_decref) Task=`10bf23bc-1dac-4fb4-9fe2-4b02e46d9c27`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:11:58,049::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:11:58,117::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316516 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:00,129::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:00,200::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350764 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:12:01,667::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:12:01,678::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103444 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:02,211::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:02,282::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034833 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:04,294::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:04,361::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312604 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:06,373::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:06,445::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034852 s, 29.4 MB/s\n'; <rc> = 0 >Thread-55564::DEBUG::2014-05-16 18:12:07,361::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55564::DEBUG::2014-05-16 18:12:07,361::task::579::TaskManager.Task::(_updateState) Task=`7f178eb4-245c-4133-9ad1-27ddf02ebabc`::moving from state init -> state preparing >Thread-55564::INFO::2014-05-16 18:12:07,362::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55564::INFO::2014-05-16 18:12:07,362::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55564::DEBUG::2014-05-16 18:12:07,362::task::1168::TaskManager.Task::(prepare) Task=`7f178eb4-245c-4133-9ad1-27ddf02ebabc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55564::DEBUG::2014-05-16 18:12:07,362::task::579::TaskManager.Task::(_updateState) Task=`7f178eb4-245c-4133-9ad1-27ddf02ebabc`::moving from state preparing -> state finished >Thread-55564::DEBUG::2014-05-16 18:12:07,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55564::DEBUG::2014-05-16 18:12:07,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55564::DEBUG::2014-05-16 18:12:07,362::task::974::TaskManager.Task::(_decref) Task=`7f178eb4-245c-4133-9ad1-27ddf02ebabc`::ref 0 aborting False >Thread-55565::DEBUG::2014-05-16 18:12:07,381::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55565::DEBUG::2014-05-16 18:12:07,381::task::579::TaskManager.Task::(_updateState) Task=`f6d87192-9315-4ce8-923e-81909d4aa702`::moving from state init -> state preparing >Thread-55565::INFO::2014-05-16 18:12:07,381::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55565::DEBUG::2014-05-16 18:12:07,381::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`82b8ca81-de65-4e0b-9c24-2ac95f56bc9e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55565::DEBUG::2014-05-16 18:12:07,382::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55565::DEBUG::2014-05-16 18:12:07,382::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55565::DEBUG::2014-05-16 18:12:07,382::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`82b8ca81-de65-4e0b-9c24-2ac95f56bc9e`::Granted request >Thread-55565::DEBUG::2014-05-16 18:12:07,382::task::811::TaskManager.Task::(resourceAcquired) Task=`f6d87192-9315-4ce8-923e-81909d4aa702`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55565::DEBUG::2014-05-16 18:12:07,382::task::974::TaskManager.Task::(_decref) Task=`f6d87192-9315-4ce8-923e-81909d4aa702`::ref 1 aborting False >Thread-55565::INFO::2014-05-16 18:12:07,383::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55565::DEBUG::2014-05-16 18:12:07,383::task::1168::TaskManager.Task::(prepare) Task=`f6d87192-9315-4ce8-923e-81909d4aa702`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55565::DEBUG::2014-05-16 18:12:07,383::task::579::TaskManager.Task::(_updateState) Task=`f6d87192-9315-4ce8-923e-81909d4aa702`::moving from state preparing -> state finished >Thread-55565::DEBUG::2014-05-16 18:12:07,383::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55565::DEBUG::2014-05-16 18:12:07,384::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55565::DEBUG::2014-05-16 18:12:07,384::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55565::DEBUG::2014-05-16 18:12:07,384::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55565::DEBUG::2014-05-16 18:12:07,384::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55565::DEBUG::2014-05-16 18:12:07,384::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55565::DEBUG::2014-05-16 18:12:07,384::task::974::TaskManager.Task::(_decref) Task=`f6d87192-9315-4ce8-923e-81909d4aa702`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:12:08,457::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:08,525::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311142 s, 32.9 MB/s\n'; <rc> = 0 >Thread-55566::DEBUG::2014-05-16 18:12:09,983::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5422209.000000 / 8.014650 / 262500000.000000 = 0.257728 >Thread-55566::DEBUG::2014-05-16 18:12:09,983::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.012591322924763082, 'statsAge': 0.10556197166442871, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2577284599004791, 'rxDropped': 0} >Thread-55566::DEBUG::2014-05-16 18:12:09,984::task::579::TaskManager.Task::(_updateState) Task=`bd578bc3-5a4a-42f2-899f-c10b280bf186`::moving from state init -> state preparing >Thread-55566::INFO::2014-05-16 18:12:09,985::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55566::INFO::2014-05-16 18:12:09,985::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103444', 'lastCheck': '8.3', 'valid': True}} >Thread-55566::DEBUG::2014-05-16 18:12:09,985::task::1168::TaskManager.Task::(prepare) Task=`bd578bc3-5a4a-42f2-899f-c10b280bf186`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103444', 'lastCheck': '8.3', 'valid': True}} >Thread-55566::DEBUG::2014-05-16 18:12:09,985::task::579::TaskManager.Task::(_updateState) Task=`bd578bc3-5a4a-42f2-899f-c10b280bf186`::moving from state preparing -> state finished >Thread-55566::DEBUG::2014-05-16 18:12:09,985::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55566::DEBUG::2014-05-16 18:12:09,985::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55566::DEBUG::2014-05-16 18:12:09,985::task::974::TaskManager.Task::(_decref) Task=`bd578bc3-5a4a-42f2-899f-c10b280bf186`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:12:10,536::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:10,609::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365002 s, 28.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:12:11,716::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:12:11,727::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718586 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:12,622::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:12,693::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352992 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:14,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:14,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030715 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:16,784::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:16,850::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030723 s, 33.3 MB/s\n'; <rc> = 0 >Thread-55570::DEBUG::2014-05-16 18:12:17,420::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55570::DEBUG::2014-05-16 18:12:17,421::task::579::TaskManager.Task::(_updateState) Task=`a8db6fda-a4a8-4fb4-af79-da6da19ec623`::moving from state init -> state preparing >Thread-55570::INFO::2014-05-16 18:12:17,421::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55570::INFO::2014-05-16 18:12:17,421::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55570::DEBUG::2014-05-16 18:12:17,422::task::1168::TaskManager.Task::(prepare) Task=`a8db6fda-a4a8-4fb4-af79-da6da19ec623`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55570::DEBUG::2014-05-16 18:12:17,422::task::579::TaskManager.Task::(_updateState) Task=`a8db6fda-a4a8-4fb4-af79-da6da19ec623`::moving from state preparing -> state finished >Thread-55570::DEBUG::2014-05-16 18:12:17,422::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55570::DEBUG::2014-05-16 18:12:17,422::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55570::DEBUG::2014-05-16 18:12:17,422::task::974::TaskManager.Task::(_decref) Task=`a8db6fda-a4a8-4fb4-af79-da6da19ec623`::ref 0 aborting False >Thread-55571::DEBUG::2014-05-16 18:12:17,431::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55571::DEBUG::2014-05-16 18:12:17,431::task::579::TaskManager.Task::(_updateState) Task=`2afd88c8-a32f-4449-8a6a-e51e48e5adac`::moving from state init -> state preparing >Thread-55571::INFO::2014-05-16 18:12:17,431::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55571::DEBUG::2014-05-16 18:12:17,432::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`83f5aa9b-2992-4987-92c9-045d3315d23a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55571::DEBUG::2014-05-16 18:12:17,432::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55571::DEBUG::2014-05-16 18:12:17,432::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55571::DEBUG::2014-05-16 18:12:17,432::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`83f5aa9b-2992-4987-92c9-045d3315d23a`::Granted request >Thread-55571::DEBUG::2014-05-16 18:12:17,433::task::811::TaskManager.Task::(resourceAcquired) Task=`2afd88c8-a32f-4449-8a6a-e51e48e5adac`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55571::DEBUG::2014-05-16 18:12:17,433::task::974::TaskManager.Task::(_decref) Task=`2afd88c8-a32f-4449-8a6a-e51e48e5adac`::ref 1 aborting False >Thread-55571::INFO::2014-05-16 18:12:17,434::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55571::DEBUG::2014-05-16 18:12:17,434::task::1168::TaskManager.Task::(prepare) Task=`2afd88c8-a32f-4449-8a6a-e51e48e5adac`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55571::DEBUG::2014-05-16 18:12:17,434::task::579::TaskManager.Task::(_updateState) Task=`2afd88c8-a32f-4449-8a6a-e51e48e5adac`::moving from state preparing -> state finished >Thread-55571::DEBUG::2014-05-16 18:12:17,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55571::DEBUG::2014-05-16 18:12:17,435::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55571::DEBUG::2014-05-16 18:12:17,435::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55571::DEBUG::2014-05-16 18:12:17,435::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55571::DEBUG::2014-05-16 18:12:17,435::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55571::DEBUG::2014-05-16 18:12:17,435::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55571::DEBUG::2014-05-16 18:12:17,435::task::974::TaskManager.Task::(_decref) Task=`2afd88c8-a32f-4449-8a6a-e51e48e5adac`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:12:18,862::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:19,019::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307566 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:21,067::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:21,138::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347909 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:12:21,764::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:12:21,774::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718892 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:23,149::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:23,216::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308408 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:25,228::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55574::DEBUG::2014-05-16 18:12:25,238::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317238.000000 / 8.008349 / 262500000.000000 = 0.205368 >Thread-55574::DEBUG::2014-05-16 18:12:25,239::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0070641515357663682, 'statsAge': 1.3459911346435547, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20536843576496561, 'rxDropped': 0} >Thread-55574::DEBUG::2014-05-16 18:12:25,239::task::579::TaskManager.Task::(_updateState) Task=`d9a191f4-10a3-43ae-8032-d3c96aca2d29`::moving from state init -> state preparing >Thread-55574::INFO::2014-05-16 18:12:25,239::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55574::INFO::2014-05-16 18:12:25,240::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718892', 'lastCheck': '3.4', 'valid': True}} >Thread-55574::DEBUG::2014-05-16 18:12:25,240::task::1168::TaskManager.Task::(prepare) Task=`d9a191f4-10a3-43ae-8032-d3c96aca2d29`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718892', 'lastCheck': '3.4', 'valid': True}} >Thread-55574::DEBUG::2014-05-16 18:12:25,240::task::579::TaskManager.Task::(_updateState) Task=`d9a191f4-10a3-43ae-8032-d3c96aca2d29`::moving from state preparing -> state finished >Thread-55574::DEBUG::2014-05-16 18:12:25,240::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55574::DEBUG::2014-05-16 18:12:25,240::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55574::DEBUG::2014-05-16 18:12:25,240::task::974::TaskManager.Task::(_decref) Task=`d9a191f4-10a3-43ae-8032-d3c96aca2d29`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:12:25,308::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036221 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:27,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:27,390::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350104 s, 29.2 MB/s\n'; <rc> = 0 >Thread-55576::DEBUG::2014-05-16 18:12:27,499::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55576::DEBUG::2014-05-16 18:12:27,499::task::579::TaskManager.Task::(_updateState) Task=`cf2c56f4-2371-4136-ad1d-0cada45b552a`::moving from state init -> state preparing >Thread-55576::INFO::2014-05-16 18:12:27,499::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55576::INFO::2014-05-16 18:12:27,500::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55576::DEBUG::2014-05-16 18:12:27,500::task::1168::TaskManager.Task::(prepare) Task=`cf2c56f4-2371-4136-ad1d-0cada45b552a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55576::DEBUG::2014-05-16 18:12:27,500::task::579::TaskManager.Task::(_updateState) Task=`cf2c56f4-2371-4136-ad1d-0cada45b552a`::moving from state preparing -> state finished >Thread-55576::DEBUG::2014-05-16 18:12:27,500::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55576::DEBUG::2014-05-16 18:12:27,500::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55576::DEBUG::2014-05-16 18:12:27,500::task::974::TaskManager.Task::(_decref) Task=`cf2c56f4-2371-4136-ad1d-0cada45b552a`::ref 0 aborting False >Thread-55577::DEBUG::2014-05-16 18:12:27,510::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55577::DEBUG::2014-05-16 18:12:27,510::task::579::TaskManager.Task::(_updateState) Task=`bd44eaf6-5149-4cfb-9c34-ec6b99a76727`::moving from state init -> state preparing >Thread-55577::INFO::2014-05-16 18:12:27,510::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55577::DEBUG::2014-05-16 18:12:27,511::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`632258f2-589d-457f-9ce3-6f5e6f2b77a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55577::DEBUG::2014-05-16 18:12:27,511::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55577::DEBUG::2014-05-16 18:12:27,511::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55577::DEBUG::2014-05-16 18:12:27,511::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`632258f2-589d-457f-9ce3-6f5e6f2b77a2`::Granted request >Thread-55577::DEBUG::2014-05-16 18:12:27,512::task::811::TaskManager.Task::(resourceAcquired) Task=`bd44eaf6-5149-4cfb-9c34-ec6b99a76727`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55577::DEBUG::2014-05-16 18:12:27,512::task::974::TaskManager.Task::(_decref) Task=`bd44eaf6-5149-4cfb-9c34-ec6b99a76727`::ref 1 aborting False >Thread-55577::INFO::2014-05-16 18:12:27,513::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55577::DEBUG::2014-05-16 18:12:27,513::task::1168::TaskManager.Task::(prepare) Task=`bd44eaf6-5149-4cfb-9c34-ec6b99a76727`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55577::DEBUG::2014-05-16 18:12:27,513::task::579::TaskManager.Task::(_updateState) Task=`bd44eaf6-5149-4cfb-9c34-ec6b99a76727`::moving from state preparing -> state finished >Thread-55577::DEBUG::2014-05-16 18:12:27,513::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55577::DEBUG::2014-05-16 18:12:27,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55577::DEBUG::2014-05-16 18:12:27,513::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55577::DEBUG::2014-05-16 18:12:27,514::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55577::DEBUG::2014-05-16 18:12:27,514::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55577::DEBUG::2014-05-16 18:12:27,514::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55577::DEBUG::2014-05-16 18:12:27,514::task::974::TaskManager.Task::(_decref) Task=`bd44eaf6-5149-4cfb-9c34-ec6b99a76727`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:12:29,402::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:29,474::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314182 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:31,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:31,553::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305427 s, 33.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:12:31,813::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:12:31,823::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066973 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:33,565::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:33,637::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356029 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:35,649::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:35,719::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344712 s, 29.7 MB/s\n'; <rc> = 0 >Thread-55582::DEBUG::2014-05-16 18:12:37,547::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55582::DEBUG::2014-05-16 18:12:37,548::task::579::TaskManager.Task::(_updateState) Task=`e48db40d-6fd7-413e-8aa4-68739d1395fe`::moving from state init -> state preparing >Thread-55582::INFO::2014-05-16 18:12:37,548::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55582::INFO::2014-05-16 18:12:37,548::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55582::DEBUG::2014-05-16 18:12:37,548::task::1168::TaskManager.Task::(prepare) Task=`e48db40d-6fd7-413e-8aa4-68739d1395fe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55582::DEBUG::2014-05-16 18:12:37,548::task::579::TaskManager.Task::(_updateState) Task=`e48db40d-6fd7-413e-8aa4-68739d1395fe`::moving from state preparing -> state finished >Thread-55582::DEBUG::2014-05-16 18:12:37,549::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55582::DEBUG::2014-05-16 18:12:37,549::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55582::DEBUG::2014-05-16 18:12:37,549::task::974::TaskManager.Task::(_decref) Task=`e48db40d-6fd7-413e-8aa4-68739d1395fe`::ref 0 aborting False >Thread-55583::DEBUG::2014-05-16 18:12:37,557::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55583::DEBUG::2014-05-16 18:12:37,558::task::579::TaskManager.Task::(_updateState) Task=`fd4d5aa2-1f9a-4c33-bb2b-311845166bf4`::moving from state init -> state preparing >Thread-55583::INFO::2014-05-16 18:12:37,558::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55583::DEBUG::2014-05-16 18:12:37,558::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cd9d32f9-7d99-4924-8d3f-825fc6c322b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55583::DEBUG::2014-05-16 18:12:37,558::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55583::DEBUG::2014-05-16 18:12:37,558::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55583::DEBUG::2014-05-16 18:12:37,559::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`cd9d32f9-7d99-4924-8d3f-825fc6c322b0`::Granted request >Thread-55583::DEBUG::2014-05-16 18:12:37,559::task::811::TaskManager.Task::(resourceAcquired) Task=`fd4d5aa2-1f9a-4c33-bb2b-311845166bf4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55583::DEBUG::2014-05-16 18:12:37,559::task::974::TaskManager.Task::(_decref) Task=`fd4d5aa2-1f9a-4c33-bb2b-311845166bf4`::ref 1 aborting False >Thread-55583::INFO::2014-05-16 18:12:37,560::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55583::DEBUG::2014-05-16 18:12:37,560::task::1168::TaskManager.Task::(prepare) Task=`fd4d5aa2-1f9a-4c33-bb2b-311845166bf4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55583::DEBUG::2014-05-16 18:12:37,560::task::579::TaskManager.Task::(_updateState) Task=`fd4d5aa2-1f9a-4c33-bb2b-311845166bf4`::moving from state preparing -> state finished >Thread-55583::DEBUG::2014-05-16 18:12:37,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55583::DEBUG::2014-05-16 18:12:37,560::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55583::DEBUG::2014-05-16 18:12:37,560::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55583::DEBUG::2014-05-16 18:12:37,560::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55583::DEBUG::2014-05-16 18:12:37,561::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55583::DEBUG::2014-05-16 18:12:37,561::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55583::DEBUG::2014-05-16 18:12:37,561::task::974::TaskManager.Task::(_decref) Task=`fd4d5aa2-1f9a-4c33-bb2b-311845166bf4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:12:37,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:37,798::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310831 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:39,810::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:39,879::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330994 s, 30.9 MB/s\n'; <rc> = 0 >Thread-55584::DEBUG::2014-05-16 18:12:40,425::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3247840.000000 / 8.008789 / 262500000.000000 = 0.154489 >Thread-55584::DEBUG::2014-05-16 18:12:40,425::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0068841513363336708, 'statsAge': 0.51518702507019043, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15448932518136305, 'rxDropped': 0} >Thread-55584::DEBUG::2014-05-16 18:12:40,426::task::579::TaskManager.Task::(_updateState) Task=`79155fc0-82f5-4806-b2f2-c1dd6720043d`::moving from state init -> state preparing >Thread-55584::INFO::2014-05-16 18:12:40,426::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55584::INFO::2014-05-16 18:12:40,426::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066973', 'lastCheck': '8.6', 'valid': True}} >Thread-55584::DEBUG::2014-05-16 18:12:40,426::task::1168::TaskManager.Task::(prepare) Task=`79155fc0-82f5-4806-b2f2-c1dd6720043d`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066973', 'lastCheck': '8.6', 'valid': True}} >Thread-55584::DEBUG::2014-05-16 18:12:40,426::task::579::TaskManager.Task::(_updateState) Task=`79155fc0-82f5-4806-b2f2-c1dd6720043d`::moving from state preparing -> state finished >Thread-55584::DEBUG::2014-05-16 18:12:40,427::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55584::DEBUG::2014-05-16 18:12:40,427::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55584::DEBUG::2014-05-16 18:12:40,427::task::974::TaskManager.Task::(_decref) Task=`79155fc0-82f5-4806-b2f2-c1dd6720043d`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:12:41,861::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:12:41,872::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105233 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:41,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:41,969::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0393335 s, 26.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:43,981::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:44,051::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032179 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:46,063::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:46,130::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305533 s, 33.5 MB/s\n'; <rc> = 0 >Thread-55588::DEBUG::2014-05-16 18:12:47,608::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55588::DEBUG::2014-05-16 18:12:47,608::task::579::TaskManager.Task::(_updateState) Task=`a9431474-6cab-459e-a840-031e10ecb554`::moving from state init -> state preparing >Thread-55588::INFO::2014-05-16 18:12:47,608::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55588::INFO::2014-05-16 18:12:47,609::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55588::DEBUG::2014-05-16 18:12:47,609::task::1168::TaskManager.Task::(prepare) Task=`a9431474-6cab-459e-a840-031e10ecb554`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55588::DEBUG::2014-05-16 18:12:47,609::task::579::TaskManager.Task::(_updateState) Task=`a9431474-6cab-459e-a840-031e10ecb554`::moving from state preparing -> state finished >Thread-55588::DEBUG::2014-05-16 18:12:47,609::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55588::DEBUG::2014-05-16 18:12:47,609::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55588::DEBUG::2014-05-16 18:12:47,609::task::974::TaskManager.Task::(_decref) Task=`a9431474-6cab-459e-a840-031e10ecb554`::ref 0 aborting False >Thread-55589::DEBUG::2014-05-16 18:12:47,618::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55589::DEBUG::2014-05-16 18:12:47,618::task::579::TaskManager.Task::(_updateState) Task=`dc28199d-46b7-43e8-82c8-a76c2d915bae`::moving from state init -> state preparing >Thread-55589::INFO::2014-05-16 18:12:47,618::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55589::DEBUG::2014-05-16 18:12:47,619::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a0488068-8d93-450b-b945-59bbfef40b15`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55589::DEBUG::2014-05-16 18:12:47,619::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55589::DEBUG::2014-05-16 18:12:47,619::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55589::DEBUG::2014-05-16 18:12:47,619::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a0488068-8d93-450b-b945-59bbfef40b15`::Granted request >Thread-55589::DEBUG::2014-05-16 18:12:47,620::task::811::TaskManager.Task::(resourceAcquired) Task=`dc28199d-46b7-43e8-82c8-a76c2d915bae`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55589::DEBUG::2014-05-16 18:12:47,620::task::974::TaskManager.Task::(_decref) Task=`dc28199d-46b7-43e8-82c8-a76c2d915bae`::ref 1 aborting False >Thread-55589::INFO::2014-05-16 18:12:47,621::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55589::DEBUG::2014-05-16 18:12:47,621::task::1168::TaskManager.Task::(prepare) Task=`dc28199d-46b7-43e8-82c8-a76c2d915bae`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55589::DEBUG::2014-05-16 18:12:47,621::task::579::TaskManager.Task::(_updateState) Task=`dc28199d-46b7-43e8-82c8-a76c2d915bae`::moving from state preparing -> state finished >Thread-55589::DEBUG::2014-05-16 18:12:47,621::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55589::DEBUG::2014-05-16 18:12:47,621::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55589::DEBUG::2014-05-16 18:12:47,621::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55589::DEBUG::2014-05-16 18:12:47,622::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55589::DEBUG::2014-05-16 18:12:47,622::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55589::DEBUG::2014-05-16 18:12:47,622::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55589::DEBUG::2014-05-16 18:12:47,622::task::974::TaskManager.Task::(_decref) Task=`dc28199d-46b7-43e8-82c8-a76c2d915bae`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:12:48,141::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:48,214::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365704 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:50,225::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:50,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342037 s, 29.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:12:51,914::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:12:51,928::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104515 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:52,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:52,390::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353805 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:12:54,402::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:54,473::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353668 s, 29.0 MB/s\n'; <rc> = 0 >Thread-55592::DEBUG::2014-05-16 18:12:55,567::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5426701.000000 / 8.011755 / 262500000.000000 = 0.258035 >Thread-55592::DEBUG::2014-05-16 18:12:55,567::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0074950821614653343, 'statsAge': 1.6363739967346191, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25803518322065938, 'rxDropped': 0} >Thread-55592::DEBUG::2014-05-16 18:12:55,568::task::579::TaskManager.Task::(_updateState) Task=`89b189aa-a5bb-4c14-8708-8ad2c02e6c6e`::moving from state init -> state preparing >Thread-55592::INFO::2014-05-16 18:12:55,568::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55592::INFO::2014-05-16 18:12:55,568::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104515', 'lastCheck': '3.6', 'valid': True}} >Thread-55592::DEBUG::2014-05-16 18:12:55,568::task::1168::TaskManager.Task::(prepare) Task=`89b189aa-a5bb-4c14-8708-8ad2c02e6c6e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104515', 'lastCheck': '3.6', 'valid': True}} >Thread-55592::DEBUG::2014-05-16 18:12:55,568::task::579::TaskManager.Task::(_updateState) Task=`89b189aa-a5bb-4c14-8708-8ad2c02e6c6e`::moving from state preparing -> state finished >Thread-55592::DEBUG::2014-05-16 18:12:55,568::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55592::DEBUG::2014-05-16 18:12:55,569::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55592::DEBUG::2014-05-16 18:12:55,569::task::974::TaskManager.Task::(_decref) Task=`89b189aa-a5bb-4c14-8708-8ad2c02e6c6e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:12:56,484::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:56,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357712 s, 28.6 MB/s\n'; <rc> = 0 >Thread-55594::DEBUG::2014-05-16 18:12:57,708::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55594::DEBUG::2014-05-16 18:12:57,708::task::579::TaskManager.Task::(_updateState) Task=`c623bacc-1df1-442b-b288-1465e6a32e13`::moving from state init -> state preparing >Thread-55594::INFO::2014-05-16 18:12:57,708::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55594::INFO::2014-05-16 18:12:57,709::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55594::DEBUG::2014-05-16 18:12:57,709::task::1168::TaskManager.Task::(prepare) Task=`c623bacc-1df1-442b-b288-1465e6a32e13`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55594::DEBUG::2014-05-16 18:12:57,709::task::579::TaskManager.Task::(_updateState) Task=`c623bacc-1df1-442b-b288-1465e6a32e13`::moving from state preparing -> state finished >Thread-55594::DEBUG::2014-05-16 18:12:57,709::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55594::DEBUG::2014-05-16 18:12:57,709::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55594::DEBUG::2014-05-16 18:12:57,709::task::974::TaskManager.Task::(_decref) Task=`c623bacc-1df1-442b-b288-1465e6a32e13`::ref 0 aborting False >Thread-55595::DEBUG::2014-05-16 18:12:57,727::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55595::DEBUG::2014-05-16 18:12:57,727::task::579::TaskManager.Task::(_updateState) Task=`485aef0b-09f4-4b4a-9b4d-a01e659251ec`::moving from state init -> state preparing >Thread-55595::INFO::2014-05-16 18:12:57,727::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55595::DEBUG::2014-05-16 18:12:57,728::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`84c8eda1-d445-4d89-8de0-a153a3a134d0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55595::DEBUG::2014-05-16 18:12:57,728::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55595::DEBUG::2014-05-16 18:12:57,728::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55595::DEBUG::2014-05-16 18:12:57,728::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`84c8eda1-d445-4d89-8de0-a153a3a134d0`::Granted request >Thread-55595::DEBUG::2014-05-16 18:12:57,729::task::811::TaskManager.Task::(resourceAcquired) Task=`485aef0b-09f4-4b4a-9b4d-a01e659251ec`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55595::DEBUG::2014-05-16 18:12:57,729::task::974::TaskManager.Task::(_decref) Task=`485aef0b-09f4-4b4a-9b4d-a01e659251ec`::ref 1 aborting False >Thread-55595::INFO::2014-05-16 18:12:57,729::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55595::DEBUG::2014-05-16 18:12:57,730::task::1168::TaskManager.Task::(prepare) Task=`485aef0b-09f4-4b4a-9b4d-a01e659251ec`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55595::DEBUG::2014-05-16 18:12:57,730::task::579::TaskManager.Task::(_updateState) Task=`485aef0b-09f4-4b4a-9b4d-a01e659251ec`::moving from state preparing -> state finished >Thread-55595::DEBUG::2014-05-16 18:12:57,730::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55595::DEBUG::2014-05-16 18:12:57,730::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55595::DEBUG::2014-05-16 18:12:57,730::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55595::DEBUG::2014-05-16 18:12:57,730::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55595::DEBUG::2014-05-16 18:12:57,731::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55595::DEBUG::2014-05-16 18:12:57,731::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55595::DEBUG::2014-05-16 18:12:57,731::task::974::TaskManager.Task::(_decref) Task=`485aef0b-09f4-4b4a-9b4d-a01e659251ec`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:12:58,567::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:12:58,635::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313844 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:00,646::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:00,718::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353592 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:13:01,962::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:13:01,973::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102908 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:02,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:02,801::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353599 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:04,813::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:04,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306895 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:06,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:06,965::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304359 s, 33.6 MB/s\n'; <rc> = 0 >Thread-55599::DEBUG::2014-05-16 18:13:07,783::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55599::DEBUG::2014-05-16 18:13:07,783::task::579::TaskManager.Task::(_updateState) Task=`ca9e7a68-8315-45bb-9368-05e1926cc5fd`::moving from state init -> state preparing >Thread-55599::INFO::2014-05-16 18:13:07,784::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55599::INFO::2014-05-16 18:13:07,784::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55599::DEBUG::2014-05-16 18:13:07,784::task::1168::TaskManager.Task::(prepare) Task=`ca9e7a68-8315-45bb-9368-05e1926cc5fd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55599::DEBUG::2014-05-16 18:13:07,784::task::579::TaskManager.Task::(_updateState) Task=`ca9e7a68-8315-45bb-9368-05e1926cc5fd`::moving from state preparing -> state finished >Thread-55599::DEBUG::2014-05-16 18:13:07,784::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55599::DEBUG::2014-05-16 18:13:07,785::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55599::DEBUG::2014-05-16 18:13:07,785::task::974::TaskManager.Task::(_decref) Task=`ca9e7a68-8315-45bb-9368-05e1926cc5fd`::ref 0 aborting False >Thread-55600::DEBUG::2014-05-16 18:13:07,794::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55600::DEBUG::2014-05-16 18:13:07,795::task::579::TaskManager.Task::(_updateState) Task=`bbc1ffd5-1420-4bfc-b72c-41cba868d362`::moving from state init -> state preparing >Thread-55600::INFO::2014-05-16 18:13:07,795::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55600::DEBUG::2014-05-16 18:13:07,795::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6ef60db0-ade9-4f04-a6b7-fd227fcf61de`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55600::DEBUG::2014-05-16 18:13:07,795::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55600::DEBUG::2014-05-16 18:13:07,796::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55600::DEBUG::2014-05-16 18:13:07,796::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6ef60db0-ade9-4f04-a6b7-fd227fcf61de`::Granted request >Thread-55600::DEBUG::2014-05-16 18:13:07,796::task::811::TaskManager.Task::(resourceAcquired) Task=`bbc1ffd5-1420-4bfc-b72c-41cba868d362`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55600::DEBUG::2014-05-16 18:13:07,796::task::974::TaskManager.Task::(_decref) Task=`bbc1ffd5-1420-4bfc-b72c-41cba868d362`::ref 1 aborting False >Thread-55600::INFO::2014-05-16 18:13:07,797::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55600::DEBUG::2014-05-16 18:13:07,797::task::1168::TaskManager.Task::(prepare) Task=`bbc1ffd5-1420-4bfc-b72c-41cba868d362`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55600::DEBUG::2014-05-16 18:13:07,797::task::579::TaskManager.Task::(_updateState) Task=`bbc1ffd5-1420-4bfc-b72c-41cba868d362`::moving from state preparing -> state finished >Thread-55600::DEBUG::2014-05-16 18:13:07,797::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55600::DEBUG::2014-05-16 18:13:07,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55600::DEBUG::2014-05-16 18:13:07,798::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55600::DEBUG::2014-05-16 18:13:07,798::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55600::DEBUG::2014-05-16 18:13:07,798::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55600::DEBUG::2014-05-16 18:13:07,798::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55600::DEBUG::2014-05-16 18:13:07,798::task::974::TaskManager.Task::(_decref) Task=`bbc1ffd5-1420-4bfc-b72c-41cba868d362`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:13:08,976::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:09,049::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356198 s, 28.7 MB/s\n'; <rc> = 0 >Thread-55602::DEBUG::2014-05-16 18:13:10,908::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318494.000000 / 8.008443 / 262500000.000000 = 0.205426 >Thread-55602::DEBUG::2014-05-16 18:13:10,908::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0064005784199136703, 'statsAge': 0.96067714691162109, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20542577331723075, 'rxDropped': 0} >Thread-55602::DEBUG::2014-05-16 18:13:10,909::task::579::TaskManager.Task::(_updateState) Task=`50ddd62c-1ee8-4622-bbfc-d344529b3d88`::moving from state init -> state preparing >Thread-55602::INFO::2014-05-16 18:13:10,910::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55602::INFO::2014-05-16 18:13:10,910::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102908', 'lastCheck': '8.9', 'valid': True}} >Thread-55602::DEBUG::2014-05-16 18:13:10,910::task::1168::TaskManager.Task::(prepare) Task=`50ddd62c-1ee8-4622-bbfc-d344529b3d88`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102908', 'lastCheck': '8.9', 'valid': True}} >Thread-55602::DEBUG::2014-05-16 18:13:10,910::task::579::TaskManager.Task::(_updateState) Task=`50ddd62c-1ee8-4622-bbfc-d344529b3d88`::moving from state preparing -> state finished >Thread-55602::DEBUG::2014-05-16 18:13:10,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55602::DEBUG::2014-05-16 18:13:10,911::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55602::DEBUG::2014-05-16 18:13:10,911::task::974::TaskManager.Task::(_decref) Task=`50ddd62c-1ee8-4622-bbfc-d344529b3d88`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:13:11,061::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:11,132::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348216 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:13:12,011::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:13:12,021::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683279 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:13,143::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:13,211::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311989 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:15,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:15,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349123 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:17,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:17,373::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031632 s, 32.4 MB/s\n'; <rc> = 0 >Thread-55606::DEBUG::2014-05-16 18:13:17,834::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55606::DEBUG::2014-05-16 18:13:17,834::task::579::TaskManager.Task::(_updateState) Task=`d0dd8571-144b-4ae8-b52b-5d7e5ea52cd5`::moving from state init -> state preparing >Thread-55606::INFO::2014-05-16 18:13:17,834::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55606::INFO::2014-05-16 18:13:17,835::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55606::DEBUG::2014-05-16 18:13:17,835::task::1168::TaskManager.Task::(prepare) Task=`d0dd8571-144b-4ae8-b52b-5d7e5ea52cd5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55606::DEBUG::2014-05-16 18:13:17,835::task::579::TaskManager.Task::(_updateState) Task=`d0dd8571-144b-4ae8-b52b-5d7e5ea52cd5`::moving from state preparing -> state finished >Thread-55606::DEBUG::2014-05-16 18:13:17,835::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55606::DEBUG::2014-05-16 18:13:17,835::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55606::DEBUG::2014-05-16 18:13:17,835::task::974::TaskManager.Task::(_decref) Task=`d0dd8571-144b-4ae8-b52b-5d7e5ea52cd5`::ref 0 aborting False >Thread-55607::DEBUG::2014-05-16 18:13:17,881::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55607::DEBUG::2014-05-16 18:13:17,881::task::579::TaskManager.Task::(_updateState) Task=`2fde1391-5065-4962-a17d-2e5b83f5463d`::moving from state init -> state preparing >Thread-55607::INFO::2014-05-16 18:13:17,881::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55607::DEBUG::2014-05-16 18:13:17,882::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1cdc7f20-d7d2-4af1-ab23-2db7c53f2f88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55607::DEBUG::2014-05-16 18:13:17,882::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55607::DEBUG::2014-05-16 18:13:17,882::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55607::DEBUG::2014-05-16 18:13:17,882::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1cdc7f20-d7d2-4af1-ab23-2db7c53f2f88`::Granted request >Thread-55607::DEBUG::2014-05-16 18:13:17,883::task::811::TaskManager.Task::(resourceAcquired) Task=`2fde1391-5065-4962-a17d-2e5b83f5463d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55607::DEBUG::2014-05-16 18:13:17,883::task::974::TaskManager.Task::(_decref) Task=`2fde1391-5065-4962-a17d-2e5b83f5463d`::ref 1 aborting False >Thread-55607::INFO::2014-05-16 18:13:17,883::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55607::DEBUG::2014-05-16 18:13:17,884::task::1168::TaskManager.Task::(prepare) Task=`2fde1391-5065-4962-a17d-2e5b83f5463d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55607::DEBUG::2014-05-16 18:13:17,884::task::579::TaskManager.Task::(_updateState) Task=`2fde1391-5065-4962-a17d-2e5b83f5463d`::moving from state preparing -> state finished >Thread-55607::DEBUG::2014-05-16 18:13:17,884::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55607::DEBUG::2014-05-16 18:13:17,884::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55607::DEBUG::2014-05-16 18:13:17,884::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55607::DEBUG::2014-05-16 18:13:17,884::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55607::DEBUG::2014-05-16 18:13:17,885::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55607::DEBUG::2014-05-16 18:13:17,885::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55607::DEBUG::2014-05-16 18:13:17,885::task::974::TaskManager.Task::(_decref) Task=`2fde1391-5065-4962-a17d-2e5b83f5463d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:13:19,385::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:19,452::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031366 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:21,464::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:21,535::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351788 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:13:22,057::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:13:22,067::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764619 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:23,547::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:23,618::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035425 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:25,630::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:25,703::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358507 s, 28.6 MB/s\n'; <rc> = 0 >Thread-55610::DEBUG::2014-05-16 18:13:26,283::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318206.000000 / 8.008588 / 262500000.000000 = 0.205408 >Thread-55610::DEBUG::2014-05-16 18:13:26,283::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053145804619119429, 'statsAge': 0.31846785545349121, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20540834933776317, 'rxDropped': 0} >Thread-55610::DEBUG::2014-05-16 18:13:26,284::task::579::TaskManager.Task::(_updateState) Task=`291f7d14-0ba5-41bc-8be3-bd8369532475`::moving from state init -> state preparing >Thread-55610::INFO::2014-05-16 18:13:26,284::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55610::INFO::2014-05-16 18:13:26,284::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764619', 'lastCheck': '4.2', 'valid': True}} >Thread-55610::DEBUG::2014-05-16 18:13:26,284::task::1168::TaskManager.Task::(prepare) Task=`291f7d14-0ba5-41bc-8be3-bd8369532475`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764619', 'lastCheck': '4.2', 'valid': True}} >Thread-55610::DEBUG::2014-05-16 18:13:26,284::task::579::TaskManager.Task::(_updateState) Task=`291f7d14-0ba5-41bc-8be3-bd8369532475`::moving from state preparing -> state finished >Thread-55610::DEBUG::2014-05-16 18:13:26,285::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55610::DEBUG::2014-05-16 18:13:26,285::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55610::DEBUG::2014-05-16 18:13:26,285::task::974::TaskManager.Task::(_decref) Task=`291f7d14-0ba5-41bc-8be3-bd8369532475`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:13:27,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:27,787::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337119 s, 30.4 MB/s\n'; <rc> = 0 >Thread-55612::DEBUG::2014-05-16 18:13:27,961::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55612::DEBUG::2014-05-16 18:13:27,961::task::579::TaskManager.Task::(_updateState) Task=`92c92426-ff11-42db-bb22-cb7e5f3af63a`::moving from state init -> state preparing >Thread-55612::INFO::2014-05-16 18:13:27,962::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55612::INFO::2014-05-16 18:13:27,962::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55612::DEBUG::2014-05-16 18:13:27,962::task::1168::TaskManager.Task::(prepare) Task=`92c92426-ff11-42db-bb22-cb7e5f3af63a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55612::DEBUG::2014-05-16 18:13:27,962::task::579::TaskManager.Task::(_updateState) Task=`92c92426-ff11-42db-bb22-cb7e5f3af63a`::moving from state preparing -> state finished >Thread-55612::DEBUG::2014-05-16 18:13:27,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55612::DEBUG::2014-05-16 18:13:27,962::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55612::DEBUG::2014-05-16 18:13:27,963::task::974::TaskManager.Task::(_decref) Task=`92c92426-ff11-42db-bb22-cb7e5f3af63a`::ref 0 aborting False >Thread-55613::DEBUG::2014-05-16 18:13:28,043::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55613::DEBUG::2014-05-16 18:13:28,043::task::579::TaskManager.Task::(_updateState) Task=`7b0e35eb-bf0b-4dde-9980-e049c9ca1f2d`::moving from state init -> state preparing >Thread-55613::INFO::2014-05-16 18:13:28,044::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55613::DEBUG::2014-05-16 18:13:28,044::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`49a77c3b-1c13-45b8-95d6-eeb8cda24f8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55613::DEBUG::2014-05-16 18:13:28,044::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55613::DEBUG::2014-05-16 18:13:28,044::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55613::DEBUG::2014-05-16 18:13:28,045::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`49a77c3b-1c13-45b8-95d6-eeb8cda24f8a`::Granted request >Thread-55613::DEBUG::2014-05-16 18:13:28,045::task::811::TaskManager.Task::(resourceAcquired) Task=`7b0e35eb-bf0b-4dde-9980-e049c9ca1f2d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55613::DEBUG::2014-05-16 18:13:28,045::task::974::TaskManager.Task::(_decref) Task=`7b0e35eb-bf0b-4dde-9980-e049c9ca1f2d`::ref 1 aborting False >Thread-55613::INFO::2014-05-16 18:13:28,046::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55613::DEBUG::2014-05-16 18:13:28,046::task::1168::TaskManager.Task::(prepare) Task=`7b0e35eb-bf0b-4dde-9980-e049c9ca1f2d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55613::DEBUG::2014-05-16 18:13:28,046::task::579::TaskManager.Task::(_updateState) Task=`7b0e35eb-bf0b-4dde-9980-e049c9ca1f2d`::moving from state preparing -> state finished >Thread-55613::DEBUG::2014-05-16 18:13:28,046::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55613::DEBUG::2014-05-16 18:13:28,046::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55613::DEBUG::2014-05-16 18:13:28,046::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55613::DEBUG::2014-05-16 18:13:28,046::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55613::DEBUG::2014-05-16 18:13:28,047::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55613::DEBUG::2014-05-16 18:13:28,047::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55613::DEBUG::2014-05-16 18:13:28,047::task::974::TaskManager.Task::(_decref) Task=`7b0e35eb-bf0b-4dde-9980-e049c9ca1f2d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:13:29,799::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:29,866::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314102 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:31,878::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:31,949::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312582 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:13:32,114::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:13:32,128::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00146312 s, 2.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:33,965::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:34,035::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316733 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:36,047::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:36,120::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355576 s, 28.8 MB/s\n'; <rc> = 0 >Thread-55617::DEBUG::2014-05-16 18:13:38,129::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55617::DEBUG::2014-05-16 18:13:38,130::task::579::TaskManager.Task::(_updateState) Task=`f3d7150f-c0a2-48ef-b519-2ccd3e9a6f76`::moving from state init -> state preparing >Thread-55617::INFO::2014-05-16 18:13:38,130::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55617::INFO::2014-05-16 18:13:38,130::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55617::DEBUG::2014-05-16 18:13:38,131::task::1168::TaskManager.Task::(prepare) Task=`f3d7150f-c0a2-48ef-b519-2ccd3e9a6f76`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55617::DEBUG::2014-05-16 18:13:38,131::task::579::TaskManager.Task::(_updateState) Task=`f3d7150f-c0a2-48ef-b519-2ccd3e9a6f76`::moving from state preparing -> state finished >Thread-55617::DEBUG::2014-05-16 18:13:38,131::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55617::DEBUG::2014-05-16 18:13:38,131::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55617::DEBUG::2014-05-16 18:13:38,131::task::974::TaskManager.Task::(_decref) Task=`f3d7150f-c0a2-48ef-b519-2ccd3e9a6f76`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:13:38,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55618::DEBUG::2014-05-16 18:13:38,148::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55618::DEBUG::2014-05-16 18:13:38,149::task::579::TaskManager.Task::(_updateState) Task=`33a4e06f-8a60-4fe0-ab36-44a0ca18f98b`::moving from state init -> state preparing >Thread-55618::INFO::2014-05-16 18:13:38,149::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55618::DEBUG::2014-05-16 18:13:38,149::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`940377d1-7eff-4b47-8d39-a1d650516676`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55618::DEBUG::2014-05-16 18:13:38,149::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55618::DEBUG::2014-05-16 18:13:38,150::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55618::DEBUG::2014-05-16 18:13:38,150::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`940377d1-7eff-4b47-8d39-a1d650516676`::Granted request >Thread-55618::DEBUG::2014-05-16 18:13:38,150::task::811::TaskManager.Task::(resourceAcquired) Task=`33a4e06f-8a60-4fe0-ab36-44a0ca18f98b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55618::DEBUG::2014-05-16 18:13:38,150::task::974::TaskManager.Task::(_decref) Task=`33a4e06f-8a60-4fe0-ab36-44a0ca18f98b`::ref 1 aborting False >Thread-55618::INFO::2014-05-16 18:13:38,151::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55618::DEBUG::2014-05-16 18:13:38,151::task::1168::TaskManager.Task::(prepare) Task=`33a4e06f-8a60-4fe0-ab36-44a0ca18f98b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55618::DEBUG::2014-05-16 18:13:38,151::task::579::TaskManager.Task::(_updateState) Task=`33a4e06f-8a60-4fe0-ab36-44a0ca18f98b`::moving from state preparing -> state finished >Thread-55618::DEBUG::2014-05-16 18:13:38,151::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55618::DEBUG::2014-05-16 18:13:38,152::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55618::DEBUG::2014-05-16 18:13:38,152::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55618::DEBUG::2014-05-16 18:13:38,152::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55618::DEBUG::2014-05-16 18:13:38,152::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55618::DEBUG::2014-05-16 18:13:38,153::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55618::DEBUG::2014-05-16 18:13:38,153::task::974::TaskManager.Task::(_decref) Task=`33a4e06f-8a60-4fe0-ab36-44a0ca18f98b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:13:38,202::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337873 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:40,214::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:40,280::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303546 s, 33.7 MB/s\n'; <rc> = 0 >Thread-55620::DEBUG::2014-05-16 18:13:41,835::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4337697.000000 / 8.017585 / 262500000.000000 = 0.206104 >Thread-55620::DEBUG::2014-05-16 18:13:41,835::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.030463988577021043, 'statsAge': 1.8460328578948975, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20610395673177642, 'rxDropped': 0} >Thread-55620::DEBUG::2014-05-16 18:13:41,836::task::579::TaskManager.Task::(_updateState) Task=`8ec9a8a6-b9c2-45a7-83bb-5434dbf7e185`::moving from state init -> state preparing >Thread-55620::INFO::2014-05-16 18:13:41,836::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55620::INFO::2014-05-16 18:13:41,837::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146312', 'lastCheck': '9.7', 'valid': True}} >Thread-55620::DEBUG::2014-05-16 18:13:41,837::task::1168::TaskManager.Task::(prepare) Task=`8ec9a8a6-b9c2-45a7-83bb-5434dbf7e185`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146312', 'lastCheck': '9.7', 'valid': True}} >Thread-55620::DEBUG::2014-05-16 18:13:41,837::task::579::TaskManager.Task::(_updateState) Task=`8ec9a8a6-b9c2-45a7-83bb-5434dbf7e185`::moving from state preparing -> state finished >Thread-55620::DEBUG::2014-05-16 18:13:41,837::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55620::DEBUG::2014-05-16 18:13:41,837::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55620::DEBUG::2014-05-16 18:13:41,837::task::974::TaskManager.Task::(_decref) Task=`8ec9a8a6-b9c2-45a7-83bb-5434dbf7e185`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:13:42,170::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:13:42,181::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000858379 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:42,292::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:42,362::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347173 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:44,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:44,442::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315613 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:46,455::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:46,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306662 s, 33.4 MB/s\n'; <rc> = 0 >Thread-55624::DEBUG::2014-05-16 18:13:48,195::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55624::DEBUG::2014-05-16 18:13:48,195::task::579::TaskManager.Task::(_updateState) Task=`33e21df9-90b8-4877-9a35-7243a489bc2f`::moving from state init -> state preparing >Thread-55624::INFO::2014-05-16 18:13:48,195::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55624::INFO::2014-05-16 18:13:48,196::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55624::DEBUG::2014-05-16 18:13:48,196::task::1168::TaskManager.Task::(prepare) Task=`33e21df9-90b8-4877-9a35-7243a489bc2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55624::DEBUG::2014-05-16 18:13:48,196::task::579::TaskManager.Task::(_updateState) Task=`33e21df9-90b8-4877-9a35-7243a489bc2f`::moving from state preparing -> state finished >Thread-55624::DEBUG::2014-05-16 18:13:48,196::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55624::DEBUG::2014-05-16 18:13:48,196::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55624::DEBUG::2014-05-16 18:13:48,196::task::974::TaskManager.Task::(_decref) Task=`33e21df9-90b8-4877-9a35-7243a489bc2f`::ref 0 aborting False >Thread-55625::DEBUG::2014-05-16 18:13:48,204::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55625::DEBUG::2014-05-16 18:13:48,205::task::579::TaskManager.Task::(_updateState) Task=`2ee211ce-e4de-4584-9a7c-fa7081bc9858`::moving from state init -> state preparing >Thread-55625::INFO::2014-05-16 18:13:48,205::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55625::DEBUG::2014-05-16 18:13:48,205::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3489a743-e874-460d-9d39-7f680ce7aeec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55625::DEBUG::2014-05-16 18:13:48,205::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55625::DEBUG::2014-05-16 18:13:48,206::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55625::DEBUG::2014-05-16 18:13:48,206::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3489a743-e874-460d-9d39-7f680ce7aeec`::Granted request >Thread-55625::DEBUG::2014-05-16 18:13:48,206::task::811::TaskManager.Task::(resourceAcquired) Task=`2ee211ce-e4de-4584-9a7c-fa7081bc9858`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55625::DEBUG::2014-05-16 18:13:48,206::task::974::TaskManager.Task::(_decref) Task=`2ee211ce-e4de-4584-9a7c-fa7081bc9858`::ref 1 aborting False >Thread-55625::INFO::2014-05-16 18:13:48,207::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55625::DEBUG::2014-05-16 18:13:48,207::task::1168::TaskManager.Task::(prepare) Task=`2ee211ce-e4de-4584-9a7c-fa7081bc9858`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55625::DEBUG::2014-05-16 18:13:48,207::task::579::TaskManager.Task::(_updateState) Task=`2ee211ce-e4de-4584-9a7c-fa7081bc9858`::moving from state preparing -> state finished >Thread-55625::DEBUG::2014-05-16 18:13:48,208::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55625::DEBUG::2014-05-16 18:13:48,208::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55625::DEBUG::2014-05-16 18:13:48,208::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55625::DEBUG::2014-05-16 18:13:48,208::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55625::DEBUG::2014-05-16 18:13:48,208::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55625::DEBUG::2014-05-16 18:13:48,208::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55625::DEBUG::2014-05-16 18:13:48,209::task::974::TaskManager.Task::(_decref) Task=`2ee211ce-e4de-4584-9a7c-fa7081bc9858`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:13:48,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:48,605::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357529 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:50,617::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:50,689::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352845 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:13:52,216::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:13:52,227::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057641 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:52,701::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:52,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343249 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:54,784::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:54,856::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359444 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:13:56,867::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:56,939::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353264 s, 29.0 MB/s\n'; <rc> = 0 >Thread-55628::DEBUG::2014-05-16 18:13:57,274::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5414297.000000 / 8.008280 / 262500000.000000 = 0.257557 >Thread-55628::DEBUG::2014-05-16 18:13:57,275::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066400798660587188, 'statsAge': 1.2691750526428223, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25755709382432429, 'rxDropped': 0} >Thread-55628::DEBUG::2014-05-16 18:13:57,275::task::579::TaskManager.Task::(_updateState) Task=`7da44580-6dc1-4e6f-9998-2b8dcafa4065`::moving from state init -> state preparing >Thread-55628::INFO::2014-05-16 18:13:57,276::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55628::INFO::2014-05-16 18:13:57,276::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057641', 'lastCheck': '5.0', 'valid': True}} >Thread-55628::DEBUG::2014-05-16 18:13:57,276::task::1168::TaskManager.Task::(prepare) Task=`7da44580-6dc1-4e6f-9998-2b8dcafa4065`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057641', 'lastCheck': '5.0', 'valid': True}} >Thread-55628::DEBUG::2014-05-16 18:13:57,276::task::579::TaskManager.Task::(_updateState) Task=`7da44580-6dc1-4e6f-9998-2b8dcafa4065`::moving from state preparing -> state finished >Thread-55628::DEBUG::2014-05-16 18:13:57,276::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55628::DEBUG::2014-05-16 18:13:57,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55628::DEBUG::2014-05-16 18:13:57,277::task::974::TaskManager.Task::(_decref) Task=`7da44580-6dc1-4e6f-9998-2b8dcafa4065`::ref 0 aborting False >Thread-55630::DEBUG::2014-05-16 18:13:58,349::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55630::DEBUG::2014-05-16 18:13:58,349::task::579::TaskManager.Task::(_updateState) Task=`38121ee8-6302-4507-b04c-cee5bee068a8`::moving from state init -> state preparing >Thread-55630::INFO::2014-05-16 18:13:58,349::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55630::INFO::2014-05-16 18:13:58,350::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55630::DEBUG::2014-05-16 18:13:58,350::task::1168::TaskManager.Task::(prepare) Task=`38121ee8-6302-4507-b04c-cee5bee068a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55630::DEBUG::2014-05-16 18:13:58,350::task::579::TaskManager.Task::(_updateState) Task=`38121ee8-6302-4507-b04c-cee5bee068a8`::moving from state preparing -> state finished >Thread-55630::DEBUG::2014-05-16 18:13:58,350::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55630::DEBUG::2014-05-16 18:13:58,350::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55630::DEBUG::2014-05-16 18:13:58,350::task::974::TaskManager.Task::(_decref) Task=`38121ee8-6302-4507-b04c-cee5bee068a8`::ref 0 aborting False >Thread-55631::DEBUG::2014-05-16 18:13:58,380::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55631::DEBUG::2014-05-16 18:13:58,380::task::579::TaskManager.Task::(_updateState) Task=`6952e14c-d3ed-4bed-b546-f740f9b9d3b5`::moving from state init -> state preparing >Thread-55631::INFO::2014-05-16 18:13:58,380::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55631::DEBUG::2014-05-16 18:13:58,380::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dc14c308-4ce4-446a-a5d3-986544e44cd1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55631::DEBUG::2014-05-16 18:13:58,381::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55631::DEBUG::2014-05-16 18:13:58,381::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55631::DEBUG::2014-05-16 18:13:58,381::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dc14c308-4ce4-446a-a5d3-986544e44cd1`::Granted request >Thread-55631::DEBUG::2014-05-16 18:13:58,381::task::811::TaskManager.Task::(resourceAcquired) Task=`6952e14c-d3ed-4bed-b546-f740f9b9d3b5`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55631::DEBUG::2014-05-16 18:13:58,381::task::974::TaskManager.Task::(_decref) Task=`6952e14c-d3ed-4bed-b546-f740f9b9d3b5`::ref 1 aborting False >Thread-55631::INFO::2014-05-16 18:13:58,382::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55631::DEBUG::2014-05-16 18:13:58,382::task::1168::TaskManager.Task::(prepare) Task=`6952e14c-d3ed-4bed-b546-f740f9b9d3b5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55631::DEBUG::2014-05-16 18:13:58,382::task::579::TaskManager.Task::(_updateState) Task=`6952e14c-d3ed-4bed-b546-f740f9b9d3b5`::moving from state preparing -> state finished >Thread-55631::DEBUG::2014-05-16 18:13:58,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55631::DEBUG::2014-05-16 18:13:58,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55631::DEBUG::2014-05-16 18:13:58,383::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55631::DEBUG::2014-05-16 18:13:58,383::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55631::DEBUG::2014-05-16 18:13:58,383::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55631::DEBUG::2014-05-16 18:13:58,383::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55631::DEBUG::2014-05-16 18:13:58,383::task::974::TaskManager.Task::(_decref) Task=`6952e14c-d3ed-4bed-b546-f740f9b9d3b5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:13:58,951::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:13:59,019::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314457 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:01,031::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:01,098::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305153 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:14:02,264::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:14:02,275::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000785417 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:03,109::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:03,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356908 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:05,193::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:05,261::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310931 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:07,272::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:07,340::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315185 s, 32.5 MB/s\n'; <rc> = 0 >Thread-55635::DEBUG::2014-05-16 18:14:08,417::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55635::DEBUG::2014-05-16 18:14:08,418::task::579::TaskManager.Task::(_updateState) Task=`bf9ad218-0c29-4642-bc89-eba0dd2ba586`::moving from state init -> state preparing >Thread-55635::INFO::2014-05-16 18:14:08,419::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55635::INFO::2014-05-16 18:14:08,419::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55635::DEBUG::2014-05-16 18:14:08,419::task::1168::TaskManager.Task::(prepare) Task=`bf9ad218-0c29-4642-bc89-eba0dd2ba586`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55635::DEBUG::2014-05-16 18:14:08,419::task::579::TaskManager.Task::(_updateState) Task=`bf9ad218-0c29-4642-bc89-eba0dd2ba586`::moving from state preparing -> state finished >Thread-55635::DEBUG::2014-05-16 18:14:08,419::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55635::DEBUG::2014-05-16 18:14:08,419::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55635::DEBUG::2014-05-16 18:14:08,420::task::974::TaskManager.Task::(_decref) Task=`bf9ad218-0c29-4642-bc89-eba0dd2ba586`::ref 0 aborting False >Thread-55636::DEBUG::2014-05-16 18:14:08,428::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55636::DEBUG::2014-05-16 18:14:08,429::task::579::TaskManager.Task::(_updateState) Task=`659904cf-d101-4827-8ffc-b144c495fc18`::moving from state init -> state preparing >Thread-55636::INFO::2014-05-16 18:14:08,429::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55636::DEBUG::2014-05-16 18:14:08,429::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`eabef3b4-d96a-4307-897a-7d507b0c0223`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55636::DEBUG::2014-05-16 18:14:08,429::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55636::DEBUG::2014-05-16 18:14:08,430::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55636::DEBUG::2014-05-16 18:14:08,430::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`eabef3b4-d96a-4307-897a-7d507b0c0223`::Granted request >Thread-55636::DEBUG::2014-05-16 18:14:08,430::task::811::TaskManager.Task::(resourceAcquired) Task=`659904cf-d101-4827-8ffc-b144c495fc18`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55636::DEBUG::2014-05-16 18:14:08,430::task::974::TaskManager.Task::(_decref) Task=`659904cf-d101-4827-8ffc-b144c495fc18`::ref 1 aborting False >Thread-55636::INFO::2014-05-16 18:14:08,431::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55636::DEBUG::2014-05-16 18:14:08,431::task::1168::TaskManager.Task::(prepare) Task=`659904cf-d101-4827-8ffc-b144c495fc18`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55636::DEBUG::2014-05-16 18:14:08,431::task::579::TaskManager.Task::(_updateState) Task=`659904cf-d101-4827-8ffc-b144c495fc18`::moving from state preparing -> state finished >Thread-55636::DEBUG::2014-05-16 18:14:08,431::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55636::DEBUG::2014-05-16 18:14:08,432::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55636::DEBUG::2014-05-16 18:14:08,432::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55636::DEBUG::2014-05-16 18:14:08,432::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55636::DEBUG::2014-05-16 18:14:08,432::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55636::DEBUG::2014-05-16 18:14:08,432::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55636::DEBUG::2014-05-16 18:14:08,432::task::974::TaskManager.Task::(_decref) Task=`659904cf-d101-4827-8ffc-b144c495fc18`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:14:09,352::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:09,424::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356058 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:11,437::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:11,509::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352018 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:14:12,313::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:14:12,323::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000576642 s, 7.1 MB/s\n'; <rc> = 0 >Thread-55638::DEBUG::2014-05-16 18:14:12,704::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4311337.000000 / 8.008285 / 262500000.000000 = 0.205089 >Thread-55638::DEBUG::2014-05-16 18:14:12,705::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052927091840575622, 'statsAge': 0.68197512626647949, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20508936506145115, 'rxDropped': 0} >Thread-55638::DEBUG::2014-05-16 18:14:12,705::task::579::TaskManager.Task::(_updateState) Task=`b28dbccd-c773-4cf5-b0c8-08f3603251b1`::moving from state init -> state preparing >Thread-55638::INFO::2014-05-16 18:14:12,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55638::INFO::2014-05-16 18:14:12,706::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576642', 'lastCheck': '0.4', 'valid': True}} >Thread-55638::DEBUG::2014-05-16 18:14:12,706::task::1168::TaskManager.Task::(prepare) Task=`b28dbccd-c773-4cf5-b0c8-08f3603251b1`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576642', 'lastCheck': '0.4', 'valid': True}} >Thread-55638::DEBUG::2014-05-16 18:14:12,706::task::579::TaskManager.Task::(_updateState) Task=`b28dbccd-c773-4cf5-b0c8-08f3603251b1`::moving from state preparing -> state finished >Thread-55638::DEBUG::2014-05-16 18:14:12,706::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55638::DEBUG::2014-05-16 18:14:12,706::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55638::DEBUG::2014-05-16 18:14:12,706::task::974::TaskManager.Task::(_decref) Task=`b28dbccd-c773-4cf5-b0c8-08f3603251b1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:14:13,521::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:13,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311608 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:15,600::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:15,683::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415782 s, 24.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:17,694::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:17,761::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307657 s, 33.3 MB/s\n'; <rc> = 0 >Thread-55641::DEBUG::2014-05-16 18:14:18,463::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55641::DEBUG::2014-05-16 18:14:18,464::task::579::TaskManager.Task::(_updateState) Task=`57c91fb0-ef95-4978-9b4e-f77a6d4226ab`::moving from state init -> state preparing >Thread-55641::INFO::2014-05-16 18:14:18,464::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55641::INFO::2014-05-16 18:14:18,464::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55641::DEBUG::2014-05-16 18:14:18,465::task::1168::TaskManager.Task::(prepare) Task=`57c91fb0-ef95-4978-9b4e-f77a6d4226ab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55641::DEBUG::2014-05-16 18:14:18,465::task::579::TaskManager.Task::(_updateState) Task=`57c91fb0-ef95-4978-9b4e-f77a6d4226ab`::moving from state preparing -> state finished >Thread-55641::DEBUG::2014-05-16 18:14:18,465::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55641::DEBUG::2014-05-16 18:14:18,465::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55641::DEBUG::2014-05-16 18:14:18,465::task::974::TaskManager.Task::(_decref) Task=`57c91fb0-ef95-4978-9b4e-f77a6d4226ab`::ref 0 aborting False >Thread-55642::DEBUG::2014-05-16 18:14:18,478::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55642::DEBUG::2014-05-16 18:14:18,478::task::579::TaskManager.Task::(_updateState) Task=`81f89613-52ff-4f5f-b44d-aa5281ff7d41`::moving from state init -> state preparing >Thread-55642::INFO::2014-05-16 18:14:18,478::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55642::DEBUG::2014-05-16 18:14:18,479::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2cb130d4-1e6c-42f9-90d5-502623ebd1a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55642::DEBUG::2014-05-16 18:14:18,479::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55642::DEBUG::2014-05-16 18:14:18,479::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55642::DEBUG::2014-05-16 18:14:18,479::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2cb130d4-1e6c-42f9-90d5-502623ebd1a6`::Granted request >Thread-55642::DEBUG::2014-05-16 18:14:18,480::task::811::TaskManager.Task::(resourceAcquired) Task=`81f89613-52ff-4f5f-b44d-aa5281ff7d41`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55642::DEBUG::2014-05-16 18:14:18,480::task::974::TaskManager.Task::(_decref) Task=`81f89613-52ff-4f5f-b44d-aa5281ff7d41`::ref 1 aborting False >Thread-55642::INFO::2014-05-16 18:14:18,481::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55642::DEBUG::2014-05-16 18:14:18,481::task::1168::TaskManager.Task::(prepare) Task=`81f89613-52ff-4f5f-b44d-aa5281ff7d41`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55642::DEBUG::2014-05-16 18:14:18,481::task::579::TaskManager.Task::(_updateState) Task=`81f89613-52ff-4f5f-b44d-aa5281ff7d41`::moving from state preparing -> state finished >Thread-55642::DEBUG::2014-05-16 18:14:18,481::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55642::DEBUG::2014-05-16 18:14:18,481::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55642::DEBUG::2014-05-16 18:14:18,481::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55642::DEBUG::2014-05-16 18:14:18,482::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55642::DEBUG::2014-05-16 18:14:18,482::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55642::DEBUG::2014-05-16 18:14:18,482::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55642::DEBUG::2014-05-16 18:14:18,482::task::974::TaskManager.Task::(_decref) Task=`81f89613-52ff-4f5f-b44d-aa5281ff7d41`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:14:19,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:19,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317541 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:21,855::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:21,926::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353035 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:14:22,355::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:14:22,365::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739102 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:23,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:24,010::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356156 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:26,022::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:26,094::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358742 s, 28.5 MB/s\n'; <rc> = 0 >Thread-55646::DEBUG::2014-05-16 18:14:27,948::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3244057.000000 / 8.008588 / 262500000.000000 = 0.154313 >Thread-55646::DEBUG::2014-05-16 18:14:27,949::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041592492922744619, 'statsAge': 1.9110939502716064, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15431324803115365, 'rxDropped': 0} >Thread-55646::DEBUG::2014-05-16 18:14:27,949::task::579::TaskManager.Task::(_updateState) Task=`ae8c51f6-26bb-432a-a305-b27242711d58`::moving from state init -> state preparing >Thread-55646::INFO::2014-05-16 18:14:27,949::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55646::INFO::2014-05-16 18:14:27,950::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739102', 'lastCheck': '5.6', 'valid': True}} >Thread-55646::DEBUG::2014-05-16 18:14:27,950::task::1168::TaskManager.Task::(prepare) Task=`ae8c51f6-26bb-432a-a305-b27242711d58`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739102', 'lastCheck': '5.6', 'valid': True}} >Thread-55646::DEBUG::2014-05-16 18:14:27,950::task::579::TaskManager.Task::(_updateState) Task=`ae8c51f6-26bb-432a-a305-b27242711d58`::moving from state preparing -> state finished >Thread-55646::DEBUG::2014-05-16 18:14:27,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55646::DEBUG::2014-05-16 18:14:27,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55646::DEBUG::2014-05-16 18:14:27,950::task::974::TaskManager.Task::(_decref) Task=`ae8c51f6-26bb-432a-a305-b27242711d58`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:14:28,106::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:28,173::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311281 s, 32.9 MB/s\n'; <rc> = 0 >Thread-55648::DEBUG::2014-05-16 18:14:28,549::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55648::DEBUG::2014-05-16 18:14:28,549::task::579::TaskManager.Task::(_updateState) Task=`09f02265-b52c-4d90-bc51-1f2aaf8053d0`::moving from state init -> state preparing >Thread-55648::INFO::2014-05-16 18:14:28,550::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55648::INFO::2014-05-16 18:14:28,550::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55648::DEBUG::2014-05-16 18:14:28,550::task::1168::TaskManager.Task::(prepare) Task=`09f02265-b52c-4d90-bc51-1f2aaf8053d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55648::DEBUG::2014-05-16 18:14:28,550::task::579::TaskManager.Task::(_updateState) Task=`09f02265-b52c-4d90-bc51-1f2aaf8053d0`::moving from state preparing -> state finished >Thread-55648::DEBUG::2014-05-16 18:14:28,550::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55648::DEBUG::2014-05-16 18:14:28,551::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55648::DEBUG::2014-05-16 18:14:28,551::task::974::TaskManager.Task::(_decref) Task=`09f02265-b52c-4d90-bc51-1f2aaf8053d0`::ref 0 aborting False >Thread-55649::DEBUG::2014-05-16 18:14:28,591::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55649::DEBUG::2014-05-16 18:14:28,592::task::579::TaskManager.Task::(_updateState) Task=`aebc9d62-2b56-45a8-808a-11648dda3eb3`::moving from state init -> state preparing >Thread-55649::INFO::2014-05-16 18:14:28,592::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55649::DEBUG::2014-05-16 18:14:28,592::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3dc6eb9d-51e9-4479-9ff1-c4d1b448ca9b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55649::DEBUG::2014-05-16 18:14:28,592::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55649::DEBUG::2014-05-16 18:14:28,593::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55649::DEBUG::2014-05-16 18:14:28,593::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3dc6eb9d-51e9-4479-9ff1-c4d1b448ca9b`::Granted request >Thread-55649::DEBUG::2014-05-16 18:14:28,593::task::811::TaskManager.Task::(resourceAcquired) Task=`aebc9d62-2b56-45a8-808a-11648dda3eb3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55649::DEBUG::2014-05-16 18:14:28,593::task::974::TaskManager.Task::(_decref) Task=`aebc9d62-2b56-45a8-808a-11648dda3eb3`::ref 1 aborting False >Thread-55649::INFO::2014-05-16 18:14:28,594::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55649::DEBUG::2014-05-16 18:14:28,594::task::1168::TaskManager.Task::(prepare) Task=`aebc9d62-2b56-45a8-808a-11648dda3eb3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55649::DEBUG::2014-05-16 18:14:28,594::task::579::TaskManager.Task::(_updateState) Task=`aebc9d62-2b56-45a8-808a-11648dda3eb3`::moving from state preparing -> state finished >Thread-55649::DEBUG::2014-05-16 18:14:28,594::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55649::DEBUG::2014-05-16 18:14:28,595::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55649::DEBUG::2014-05-16 18:14:28,595::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55649::DEBUG::2014-05-16 18:14:28,595::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55649::DEBUG::2014-05-16 18:14:28,595::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55649::DEBUG::2014-05-16 18:14:28,595::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55649::DEBUG::2014-05-16 18:14:28,595::task::974::TaskManager.Task::(_decref) Task=`aebc9d62-2b56-45a8-808a-11648dda3eb3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:14:30,185::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:30,257::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356944 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:32,268::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:32,335::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306237 s, 33.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:14:32,402::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:14:32,412::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000761503 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:34,347::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:34,414::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312298 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:36,426::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:36,498::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357603 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:38,509::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:38,577::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318527 s, 32.1 MB/s\n'; <rc> = 0 >Thread-55653::DEBUG::2014-05-16 18:14:38,662::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55653::DEBUG::2014-05-16 18:14:38,663::task::579::TaskManager.Task::(_updateState) Task=`fc2ca70c-f7f5-46e1-a8fe-0036135ce207`::moving from state init -> state preparing >Thread-55653::INFO::2014-05-16 18:14:38,663::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55653::INFO::2014-05-16 18:14:38,663::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55653::DEBUG::2014-05-16 18:14:38,663::task::1168::TaskManager.Task::(prepare) Task=`fc2ca70c-f7f5-46e1-a8fe-0036135ce207`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55653::DEBUG::2014-05-16 18:14:38,664::task::579::TaskManager.Task::(_updateState) Task=`fc2ca70c-f7f5-46e1-a8fe-0036135ce207`::moving from state preparing -> state finished >Thread-55653::DEBUG::2014-05-16 18:14:38,664::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55653::DEBUG::2014-05-16 18:14:38,664::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55653::DEBUG::2014-05-16 18:14:38,664::task::974::TaskManager.Task::(_decref) Task=`fc2ca70c-f7f5-46e1-a8fe-0036135ce207`::ref 0 aborting False >Thread-55654::DEBUG::2014-05-16 18:14:38,693::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55654::DEBUG::2014-05-16 18:14:38,693::task::579::TaskManager.Task::(_updateState) Task=`72d09483-0cc9-4168-b5aa-53c730d9a3f2`::moving from state init -> state preparing >Thread-55654::INFO::2014-05-16 18:14:38,693::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55654::DEBUG::2014-05-16 18:14:38,694::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5e64fa2a-fda8-47dd-b42b-bafa57861f7c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55654::DEBUG::2014-05-16 18:14:38,694::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55654::DEBUG::2014-05-16 18:14:38,694::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55654::DEBUG::2014-05-16 18:14:38,694::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5e64fa2a-fda8-47dd-b42b-bafa57861f7c`::Granted request >Thread-55654::DEBUG::2014-05-16 18:14:38,695::task::811::TaskManager.Task::(resourceAcquired) Task=`72d09483-0cc9-4168-b5aa-53c730d9a3f2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55654::DEBUG::2014-05-16 18:14:38,695::task::974::TaskManager.Task::(_decref) Task=`72d09483-0cc9-4168-b5aa-53c730d9a3f2`::ref 1 aborting False >Thread-55654::INFO::2014-05-16 18:14:38,695::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55654::DEBUG::2014-05-16 18:14:38,696::task::1168::TaskManager.Task::(prepare) Task=`72d09483-0cc9-4168-b5aa-53c730d9a3f2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55654::DEBUG::2014-05-16 18:14:38,696::task::579::TaskManager.Task::(_updateState) Task=`72d09483-0cc9-4168-b5aa-53c730d9a3f2`::moving from state preparing -> state finished >Thread-55654::DEBUG::2014-05-16 18:14:38,696::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55654::DEBUG::2014-05-16 18:14:38,696::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55654::DEBUG::2014-05-16 18:14:38,696::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55654::DEBUG::2014-05-16 18:14:38,696::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55654::DEBUG::2014-05-16 18:14:38,697::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55654::DEBUG::2014-05-16 18:14:38,697::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55654::DEBUG::2014-05-16 18:14:38,697::task::974::TaskManager.Task::(_decref) Task=`72d09483-0cc9-4168-b5aa-53c730d9a3f2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:14:40,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:40,656::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307782 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:14:42,450::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:14:42,460::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000935862 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:42,668::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:42,740::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352174 s, 29.1 MB/s\n'; <rc> = 0 >Thread-55656::DEBUG::2014-05-16 18:14:43,644::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313289.000000 / 8.008158 / 262500000.000000 = 0.205185 >Thread-55656::DEBUG::2014-05-16 18:14:43,644::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005299072482163613, 'statsAge': 1.5899150371551514, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20518547720271302, 'rxDropped': 0} >Thread-55656::DEBUG::2014-05-16 18:14:43,644::task::579::TaskManager.Task::(_updateState) Task=`876114f6-ff38-415a-a380-8400b67925bf`::moving from state init -> state preparing >Thread-55656::INFO::2014-05-16 18:14:43,644::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55656::INFO::2014-05-16 18:14:43,645::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000935862', 'lastCheck': '1.2', 'valid': True}} >Thread-55656::DEBUG::2014-05-16 18:14:43,645::task::1168::TaskManager.Task::(prepare) Task=`876114f6-ff38-415a-a380-8400b67925bf`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000935862', 'lastCheck': '1.2', 'valid': True}} >Thread-55656::DEBUG::2014-05-16 18:14:43,645::task::579::TaskManager.Task::(_updateState) Task=`876114f6-ff38-415a-a380-8400b67925bf`::moving from state preparing -> state finished >Thread-55656::DEBUG::2014-05-16 18:14:43,645::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55656::DEBUG::2014-05-16 18:14:43,645::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55656::DEBUG::2014-05-16 18:14:43,645::task::974::TaskManager.Task::(_decref) Task=`876114f6-ff38-415a-a380-8400b67925bf`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:14:44,751::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:44,819::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311525 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:46,831::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:46,899::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03097 s, 33.1 MB/s\n'; <rc> = 0 >Thread-55659::DEBUG::2014-05-16 18:14:48,748::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55659::DEBUG::2014-05-16 18:14:48,749::task::579::TaskManager.Task::(_updateState) Task=`80f89580-ce0e-4a23-938d-56f1d3ade9dd`::moving from state init -> state preparing >Thread-55659::INFO::2014-05-16 18:14:48,749::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55659::INFO::2014-05-16 18:14:48,749::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55659::DEBUG::2014-05-16 18:14:48,750::task::1168::TaskManager.Task::(prepare) Task=`80f89580-ce0e-4a23-938d-56f1d3ade9dd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55659::DEBUG::2014-05-16 18:14:48,750::task::579::TaskManager.Task::(_updateState) Task=`80f89580-ce0e-4a23-938d-56f1d3ade9dd`::moving from state preparing -> state finished >Thread-55659::DEBUG::2014-05-16 18:14:48,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55659::DEBUG::2014-05-16 18:14:48,750::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55659::DEBUG::2014-05-16 18:14:48,750::task::974::TaskManager.Task::(_decref) Task=`80f89580-ce0e-4a23-938d-56f1d3ade9dd`::ref 0 aborting False >Thread-55660::DEBUG::2014-05-16 18:14:48,760::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55660::DEBUG::2014-05-16 18:14:48,760::task::579::TaskManager.Task::(_updateState) Task=`e2a3c899-b6b6-43e5-9bbf-2d130f3771c7`::moving from state init -> state preparing >Thread-55660::INFO::2014-05-16 18:14:48,760::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55660::DEBUG::2014-05-16 18:14:48,761::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`94f4080d-93de-4114-b436-8563c1bd29c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55660::DEBUG::2014-05-16 18:14:48,761::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55660::DEBUG::2014-05-16 18:14:48,761::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55660::DEBUG::2014-05-16 18:14:48,761::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`94f4080d-93de-4114-b436-8563c1bd29c6`::Granted request >Thread-55660::DEBUG::2014-05-16 18:14:48,762::task::811::TaskManager.Task::(resourceAcquired) Task=`e2a3c899-b6b6-43e5-9bbf-2d130f3771c7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55660::DEBUG::2014-05-16 18:14:48,762::task::974::TaskManager.Task::(_decref) Task=`e2a3c899-b6b6-43e5-9bbf-2d130f3771c7`::ref 1 aborting False >Thread-55660::INFO::2014-05-16 18:14:48,762::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55660::DEBUG::2014-05-16 18:14:48,763::task::1168::TaskManager.Task::(prepare) Task=`e2a3c899-b6b6-43e5-9bbf-2d130f3771c7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55660::DEBUG::2014-05-16 18:14:48,763::task::579::TaskManager.Task::(_updateState) Task=`e2a3c899-b6b6-43e5-9bbf-2d130f3771c7`::moving from state preparing -> state finished >Thread-55660::DEBUG::2014-05-16 18:14:48,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55660::DEBUG::2014-05-16 18:14:48,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55660::DEBUG::2014-05-16 18:14:48,763::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55660::DEBUG::2014-05-16 18:14:48,764::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55660::DEBUG::2014-05-16 18:14:48,764::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55660::DEBUG::2014-05-16 18:14:48,764::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55660::DEBUG::2014-05-16 18:14:48,764::task::974::TaskManager.Task::(_decref) Task=`e2a3c899-b6b6-43e5-9bbf-2d130f3771c7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:14:48,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:48,981::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355559 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:50,988::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:51,060::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353104 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:14:52,493::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:14:52,503::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107215 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:53,072::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:53,142::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344368 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:55,154::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:55,220::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304152 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:14:57,231::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:57,303::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351189 s, 29.2 MB/s\n'; <rc> = 0 >Thread-55664::DEBUG::2014-05-16 18:14:58,811::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55664::DEBUG::2014-05-16 18:14:58,811::task::579::TaskManager.Task::(_updateState) Task=`70ebe525-9e25-45c0-b549-926c2b02cb09`::moving from state init -> state preparing >Thread-55664::INFO::2014-05-16 18:14:58,811::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55664::INFO::2014-05-16 18:14:58,812::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55664::DEBUG::2014-05-16 18:14:58,812::task::1168::TaskManager.Task::(prepare) Task=`70ebe525-9e25-45c0-b549-926c2b02cb09`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55664::DEBUG::2014-05-16 18:14:58,812::task::579::TaskManager.Task::(_updateState) Task=`70ebe525-9e25-45c0-b549-926c2b02cb09`::moving from state preparing -> state finished >Thread-55664::DEBUG::2014-05-16 18:14:58,812::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55664::DEBUG::2014-05-16 18:14:58,812::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55664::DEBUG::2014-05-16 18:14:58,812::task::974::TaskManager.Task::(_decref) Task=`70ebe525-9e25-45c0-b549-926c2b02cb09`::ref 0 aborting False >Thread-55665::DEBUG::2014-05-16 18:14:58,846::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55665::DEBUG::2014-05-16 18:14:58,847::task::579::TaskManager.Task::(_updateState) Task=`44db3f49-2d4d-43e5-8c2d-a57fb13b2c86`::moving from state init -> state preparing >Thread-55665::INFO::2014-05-16 18:14:58,847::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55665::DEBUG::2014-05-16 18:14:58,848::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3a309434-93c3-4bbf-a4d9-ae40dbbbe8d2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55665::DEBUG::2014-05-16 18:14:58,848::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55665::DEBUG::2014-05-16 18:14:58,848::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55665::DEBUG::2014-05-16 18:14:58,848::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3a309434-93c3-4bbf-a4d9-ae40dbbbe8d2`::Granted request >Thread-55665::DEBUG::2014-05-16 18:14:58,849::task::811::TaskManager.Task::(resourceAcquired) Task=`44db3f49-2d4d-43e5-8c2d-a57fb13b2c86`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55665::DEBUG::2014-05-16 18:14:58,849::task::974::TaskManager.Task::(_decref) Task=`44db3f49-2d4d-43e5-8c2d-a57fb13b2c86`::ref 1 aborting False >Thread-55665::INFO::2014-05-16 18:14:58,849::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55665::DEBUG::2014-05-16 18:14:58,849::task::1168::TaskManager.Task::(prepare) Task=`44db3f49-2d4d-43e5-8c2d-a57fb13b2c86`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55665::DEBUG::2014-05-16 18:14:58,850::task::579::TaskManager.Task::(_updateState) Task=`44db3f49-2d4d-43e5-8c2d-a57fb13b2c86`::moving from state preparing -> state finished >Thread-55665::DEBUG::2014-05-16 18:14:58,850::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55665::DEBUG::2014-05-16 18:14:58,850::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55665::DEBUG::2014-05-16 18:14:58,850::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55665::DEBUG::2014-05-16 18:14:58,850::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55665::DEBUG::2014-05-16 18:14:58,850::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55665::DEBUG::2014-05-16 18:14:58,850::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55665::DEBUG::2014-05-16 18:14:58,851::task::974::TaskManager.Task::(_decref) Task=`44db3f49-2d4d-43e5-8c2d-a57fb13b2c86`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:14:59,315::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:14:59,383::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314175 s, 32.6 MB/s\n'; <rc> = 0 >Thread-55666::DEBUG::2014-05-16 18:14:59,629::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413194.000000 / 8.008563 / 262500000.000000 = 0.257496 >Thread-55666::DEBUG::2014-05-16 18:14:59,629::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065242546621570039, 'statsAge': 1.5581338405609131, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25749552474306864, 'rxDropped': 0} >Thread-55666::DEBUG::2014-05-16 18:14:59,629::task::579::TaskManager.Task::(_updateState) Task=`80047d08-8557-4120-9f39-e128be7bf1a1`::moving from state init -> state preparing >Thread-55666::INFO::2014-05-16 18:14:59,630::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55666::INFO::2014-05-16 18:14:59,630::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107215', 'lastCheck': '7.1', 'valid': True}} >Thread-55666::DEBUG::2014-05-16 18:14:59,630::task::1168::TaskManager.Task::(prepare) Task=`80047d08-8557-4120-9f39-e128be7bf1a1`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107215', 'lastCheck': '7.1', 'valid': True}} >Thread-55666::DEBUG::2014-05-16 18:14:59,630::task::579::TaskManager.Task::(_updateState) Task=`80047d08-8557-4120-9f39-e128be7bf1a1`::moving from state preparing -> state finished >Thread-55666::DEBUG::2014-05-16 18:14:59,630::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55666::DEBUG::2014-05-16 18:14:59,631::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55666::DEBUG::2014-05-16 18:14:59,631::task::974::TaskManager.Task::(_decref) Task=`80047d08-8557-4120-9f39-e128be7bf1a1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:15:01,395::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:01,461::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305612 s, 33.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:15:02,541::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:15:02,552::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00083417 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:03,473::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:03,546::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360566 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:05,557::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:05,624::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310198 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:07,636::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:07,704::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315729 s, 32.4 MB/s\n'; <rc> = 0 >Thread-55671::DEBUG::2014-05-16 18:15:08,883::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55671::DEBUG::2014-05-16 18:15:08,884::task::579::TaskManager.Task::(_updateState) Task=`25bb9b7c-9ee5-4e1e-a27c-08f74b0d38c6`::moving from state init -> state preparing >Thread-55671::INFO::2014-05-16 18:15:08,884::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55671::INFO::2014-05-16 18:15:08,884::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55671::DEBUG::2014-05-16 18:15:08,884::task::1168::TaskManager.Task::(prepare) Task=`25bb9b7c-9ee5-4e1e-a27c-08f74b0d38c6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55671::DEBUG::2014-05-16 18:15:08,884::task::579::TaskManager.Task::(_updateState) Task=`25bb9b7c-9ee5-4e1e-a27c-08f74b0d38c6`::moving from state preparing -> state finished >Thread-55671::DEBUG::2014-05-16 18:15:08,885::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55671::DEBUG::2014-05-16 18:15:08,885::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55671::DEBUG::2014-05-16 18:15:08,885::task::974::TaskManager.Task::(_decref) Task=`25bb9b7c-9ee5-4e1e-a27c-08f74b0d38c6`::ref 0 aborting False >Thread-55672::DEBUG::2014-05-16 18:15:08,923::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55672::DEBUG::2014-05-16 18:15:08,923::task::579::TaskManager.Task::(_updateState) Task=`5a54080f-760a-49d2-8b93-70df69bd7824`::moving from state init -> state preparing >Thread-55672::INFO::2014-05-16 18:15:08,923::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55672::DEBUG::2014-05-16 18:15:08,924::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5a2478ad-f140-4cc8-8f3b-e42c116bcd45`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55672::DEBUG::2014-05-16 18:15:08,924::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55672::DEBUG::2014-05-16 18:15:08,924::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55672::DEBUG::2014-05-16 18:15:08,924::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`5a2478ad-f140-4cc8-8f3b-e42c116bcd45`::Granted request >Thread-55672::DEBUG::2014-05-16 18:15:08,925::task::811::TaskManager.Task::(resourceAcquired) Task=`5a54080f-760a-49d2-8b93-70df69bd7824`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55672::DEBUG::2014-05-16 18:15:08,925::task::974::TaskManager.Task::(_decref) Task=`5a54080f-760a-49d2-8b93-70df69bd7824`::ref 1 aborting False >Thread-55672::INFO::2014-05-16 18:15:08,925::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55672::DEBUG::2014-05-16 18:15:08,926::task::1168::TaskManager.Task::(prepare) Task=`5a54080f-760a-49d2-8b93-70df69bd7824`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55672::DEBUG::2014-05-16 18:15:08,926::task::579::TaskManager.Task::(_updateState) Task=`5a54080f-760a-49d2-8b93-70df69bd7824`::moving from state preparing -> state finished >Thread-55672::DEBUG::2014-05-16 18:15:08,926::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55672::DEBUG::2014-05-16 18:15:08,926::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55672::DEBUG::2014-05-16 18:15:08,926::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55672::DEBUG::2014-05-16 18:15:08,926::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55672::DEBUG::2014-05-16 18:15:08,927::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55672::DEBUG::2014-05-16 18:15:08,927::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55672::DEBUG::2014-05-16 18:15:08,927::task::974::TaskManager.Task::(_decref) Task=`5a54080f-760a-49d2-8b93-70df69bd7824`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:15:09,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:09,788::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357118 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:11,799::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:11,872::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356557 s, 28.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:15:12,590::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:15:12,600::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000787521 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:13,884::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:13,951::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301463 s, 34.0 MB/s\n'; <rc> = 0 >Thread-55674::DEBUG::2014-05-16 18:15:15,020::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4347994.000000 / 8.008485 / 262500000.000000 = 0.206828 >Thread-55674::DEBUG::2014-05-16 18:15:15,020::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054059805143744496, 'statsAge': 0.93265700340270996, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20682796438604986, 'rxDropped': 0} >Thread-55674::DEBUG::2014-05-16 18:15:15,021::task::579::TaskManager.Task::(_updateState) Task=`b7c08a9d-e256-4bea-952d-c3cd6d2fdc98`::moving from state init -> state preparing >Thread-55674::INFO::2014-05-16 18:15:15,021::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55674::INFO::2014-05-16 18:15:15,021::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787521', 'lastCheck': '2.4', 'valid': True}} >Thread-55674::DEBUG::2014-05-16 18:15:15,021::task::1168::TaskManager.Task::(prepare) Task=`b7c08a9d-e256-4bea-952d-c3cd6d2fdc98`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787521', 'lastCheck': '2.4', 'valid': True}} >Thread-55674::DEBUG::2014-05-16 18:15:15,022::task::579::TaskManager.Task::(_updateState) Task=`b7c08a9d-e256-4bea-952d-c3cd6d2fdc98`::moving from state preparing -> state finished >Thread-55674::DEBUG::2014-05-16 18:15:15,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55674::DEBUG::2014-05-16 18:15:15,022::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55674::DEBUG::2014-05-16 18:15:15,022::task::974::TaskManager.Task::(_decref) Task=`b7c08a9d-e256-4bea-952d-c3cd6d2fdc98`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:15:15,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:16,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352871 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:18,034::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:18,107::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031535 s, 32.5 MB/s\n'; <rc> = 0 >Thread-55677::DEBUG::2014-05-16 18:15:18,963::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55677::DEBUG::2014-05-16 18:15:18,964::task::579::TaskManager.Task::(_updateState) Task=`9dcb3e95-477d-4b67-a5c9-199af4002ec8`::moving from state init -> state preparing >Thread-55677::INFO::2014-05-16 18:15:18,964::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55677::INFO::2014-05-16 18:15:18,964::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55677::DEBUG::2014-05-16 18:15:18,964::task::1168::TaskManager.Task::(prepare) Task=`9dcb3e95-477d-4b67-a5c9-199af4002ec8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55677::DEBUG::2014-05-16 18:15:18,964::task::579::TaskManager.Task::(_updateState) Task=`9dcb3e95-477d-4b67-a5c9-199af4002ec8`::moving from state preparing -> state finished >Thread-55677::DEBUG::2014-05-16 18:15:18,965::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55677::DEBUG::2014-05-16 18:15:18,965::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55677::DEBUG::2014-05-16 18:15:18,965::task::974::TaskManager.Task::(_decref) Task=`9dcb3e95-477d-4b67-a5c9-199af4002ec8`::ref 0 aborting False >Thread-55678::DEBUG::2014-05-16 18:15:18,977::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55678::DEBUG::2014-05-16 18:15:18,977::task::579::TaskManager.Task::(_updateState) Task=`ed836815-67ca-41c1-8b04-974a692a02d8`::moving from state init -> state preparing >Thread-55678::INFO::2014-05-16 18:15:18,977::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55678::DEBUG::2014-05-16 18:15:18,978::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b16c27ce-7dda-45e6-bbe2-cb45ba16a291`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55678::DEBUG::2014-05-16 18:15:18,978::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55678::DEBUG::2014-05-16 18:15:18,978::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55678::DEBUG::2014-05-16 18:15:18,978::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b16c27ce-7dda-45e6-bbe2-cb45ba16a291`::Granted request >Thread-55678::DEBUG::2014-05-16 18:15:18,979::task::811::TaskManager.Task::(resourceAcquired) Task=`ed836815-67ca-41c1-8b04-974a692a02d8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55678::DEBUG::2014-05-16 18:15:18,979::task::974::TaskManager.Task::(_decref) Task=`ed836815-67ca-41c1-8b04-974a692a02d8`::ref 1 aborting False >Thread-55678::INFO::2014-05-16 18:15:18,979::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55678::DEBUG::2014-05-16 18:15:18,980::task::1168::TaskManager.Task::(prepare) Task=`ed836815-67ca-41c1-8b04-974a692a02d8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55678::DEBUG::2014-05-16 18:15:18,980::task::579::TaskManager.Task::(_updateState) Task=`ed836815-67ca-41c1-8b04-974a692a02d8`::moving from state preparing -> state finished >Thread-55678::DEBUG::2014-05-16 18:15:18,980::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55678::DEBUG::2014-05-16 18:15:18,980::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55678::DEBUG::2014-05-16 18:15:18,980::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55678::DEBUG::2014-05-16 18:15:18,981::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55678::DEBUG::2014-05-16 18:15:18,981::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55678::DEBUG::2014-05-16 18:15:18,981::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55678::DEBUG::2014-05-16 18:15:18,981::task::974::TaskManager.Task::(_decref) Task=`ed836815-67ca-41c1-8b04-974a692a02d8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:15:20,119::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:20,185::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304365 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:22,197::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:22,263::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304291 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:15:22,637::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:15:22,647::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000839931 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:24,275::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:24,346::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358461 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:26,358::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:26,430::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351803 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:28,442::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:28,510::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311042 s, 32.9 MB/s\n'; <rc> = 0 >Thread-55682::DEBUG::2014-05-16 18:15:29,025::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55682::DEBUG::2014-05-16 18:15:29,026::task::579::TaskManager.Task::(_updateState) Task=`427bd931-b9d1-495b-a08f-118eee078dc7`::moving from state init -> state preparing >Thread-55682::INFO::2014-05-16 18:15:29,026::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55682::INFO::2014-05-16 18:15:29,026::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55682::DEBUG::2014-05-16 18:15:29,027::task::1168::TaskManager.Task::(prepare) Task=`427bd931-b9d1-495b-a08f-118eee078dc7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55682::DEBUG::2014-05-16 18:15:29,027::task::579::TaskManager.Task::(_updateState) Task=`427bd931-b9d1-495b-a08f-118eee078dc7`::moving from state preparing -> state finished >Thread-55682::DEBUG::2014-05-16 18:15:29,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55682::DEBUG::2014-05-16 18:15:29,027::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55682::DEBUG::2014-05-16 18:15:29,027::task::974::TaskManager.Task::(_decref) Task=`427bd931-b9d1-495b-a08f-118eee078dc7`::ref 0 aborting False >Thread-55683::DEBUG::2014-05-16 18:15:29,036::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55683::DEBUG::2014-05-16 18:15:29,036::task::579::TaskManager.Task::(_updateState) Task=`c75088b2-bf88-4f9b-993f-de7b6a85e367`::moving from state init -> state preparing >Thread-55683::INFO::2014-05-16 18:15:29,036::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55683::DEBUG::2014-05-16 18:15:29,037::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`04d96ed9-2efc-464a-8b89-acda27ecfecd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55683::DEBUG::2014-05-16 18:15:29,037::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55683::DEBUG::2014-05-16 18:15:29,037::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55683::DEBUG::2014-05-16 18:15:29,037::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`04d96ed9-2efc-464a-8b89-acda27ecfecd`::Granted request >Thread-55683::DEBUG::2014-05-16 18:15:29,037::task::811::TaskManager.Task::(resourceAcquired) Task=`c75088b2-bf88-4f9b-993f-de7b6a85e367`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55683::DEBUG::2014-05-16 18:15:29,038::task::974::TaskManager.Task::(_decref) Task=`c75088b2-bf88-4f9b-993f-de7b6a85e367`::ref 1 aborting False >Thread-55683::INFO::2014-05-16 18:15:29,038::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55683::DEBUG::2014-05-16 18:15:29,038::task::1168::TaskManager.Task::(prepare) Task=`c75088b2-bf88-4f9b-993f-de7b6a85e367`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55683::DEBUG::2014-05-16 18:15:29,039::task::579::TaskManager.Task::(_updateState) Task=`c75088b2-bf88-4f9b-993f-de7b6a85e367`::moving from state preparing -> state finished >Thread-55683::DEBUG::2014-05-16 18:15:29,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55683::DEBUG::2014-05-16 18:15:29,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55683::DEBUG::2014-05-16 18:15:29,039::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55683::DEBUG::2014-05-16 18:15:29,039::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55683::DEBUG::2014-05-16 18:15:29,039::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55683::DEBUG::2014-05-16 18:15:29,040::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55683::DEBUG::2014-05-16 18:15:29,040::task::974::TaskManager.Task::(_decref) Task=`c75088b2-bf88-4f9b-993f-de7b6a85e367`::ref 0 aborting False >Thread-55684::DEBUG::2014-05-16 18:15:30,231::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317549.000000 / 8.008244 / 262500000.000000 = 0.205386 >Thread-55684::DEBUG::2014-05-16 18:15:30,231::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053149039188937668, 'statsAge': 0.12413907051086426, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20538592027169433, 'rxDropped': 0} >Thread-55684::DEBUG::2014-05-16 18:15:30,232::task::579::TaskManager.Task::(_updateState) Task=`9eb87157-1dcd-4417-85e6-1b95060775d1`::moving from state init -> state preparing >Thread-55684::INFO::2014-05-16 18:15:30,232::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55684::INFO::2014-05-16 18:15:30,232::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000839931', 'lastCheck': '7.6', 'valid': True}} >Thread-55684::DEBUG::2014-05-16 18:15:30,232::task::1168::TaskManager.Task::(prepare) Task=`9eb87157-1dcd-4417-85e6-1b95060775d1`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000839931', 'lastCheck': '7.6', 'valid': True}} >Thread-55684::DEBUG::2014-05-16 18:15:30,232::task::579::TaskManager.Task::(_updateState) Task=`9eb87157-1dcd-4417-85e6-1b95060775d1`::moving from state preparing -> state finished >Thread-55684::DEBUG::2014-05-16 18:15:30,232::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55684::DEBUG::2014-05-16 18:15:30,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55684::DEBUG::2014-05-16 18:15:30,233::task::974::TaskManager.Task::(_decref) Task=`9eb87157-1dcd-4417-85e6-1b95060775d1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:15:30,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:30,594::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360946 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:32,605::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:32,734::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306091 s, 33.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:15:32,822::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:15:32,850::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704898 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:34,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:35,003::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309594 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:37,014::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:37,082::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316679 s, 32.3 MB/s\n'; <rc> = 0 >Thread-55688::DEBUG::2014-05-16 18:15:39,085::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55688::DEBUG::2014-05-16 18:15:39,085::task::579::TaskManager.Task::(_updateState) Task=`ab82a35b-80ef-403d-8750-d00b26dde8bd`::moving from state init -> state preparing >Thread-55688::INFO::2014-05-16 18:15:39,086::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55688::INFO::2014-05-16 18:15:39,086::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55688::DEBUG::2014-05-16 18:15:39,086::task::1168::TaskManager.Task::(prepare) Task=`ab82a35b-80ef-403d-8750-d00b26dde8bd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55688::DEBUG::2014-05-16 18:15:39,086::task::579::TaskManager.Task::(_updateState) Task=`ab82a35b-80ef-403d-8750-d00b26dde8bd`::moving from state preparing -> state finished >Thread-55688::DEBUG::2014-05-16 18:15:39,086::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55688::DEBUG::2014-05-16 18:15:39,087::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55688::DEBUG::2014-05-16 18:15:39,087::task::974::TaskManager.Task::(_decref) Task=`ab82a35b-80ef-403d-8750-d00b26dde8bd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:15:39,093::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55689::DEBUG::2014-05-16 18:15:39,103::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55689::DEBUG::2014-05-16 18:15:39,103::task::579::TaskManager.Task::(_updateState) Task=`fc764a65-08ac-42ea-a9d8-af1adef6bf4d`::moving from state init -> state preparing >Thread-55689::INFO::2014-05-16 18:15:39,103::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55689::DEBUG::2014-05-16 18:15:39,104::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`26d9e9fa-9682-48a2-97ed-53691c2657bc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55689::DEBUG::2014-05-16 18:15:39,104::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55689::DEBUG::2014-05-16 18:15:39,104::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55689::DEBUG::2014-05-16 18:15:39,104::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`26d9e9fa-9682-48a2-97ed-53691c2657bc`::Granted request >Thread-55689::DEBUG::2014-05-16 18:15:39,105::task::811::TaskManager.Task::(resourceAcquired) Task=`fc764a65-08ac-42ea-a9d8-af1adef6bf4d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55689::DEBUG::2014-05-16 18:15:39,105::task::974::TaskManager.Task::(_decref) Task=`fc764a65-08ac-42ea-a9d8-af1adef6bf4d`::ref 1 aborting False >Thread-55689::INFO::2014-05-16 18:15:39,106::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55689::DEBUG::2014-05-16 18:15:39,106::task::1168::TaskManager.Task::(prepare) Task=`fc764a65-08ac-42ea-a9d8-af1adef6bf4d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55689::DEBUG::2014-05-16 18:15:39,106::task::579::TaskManager.Task::(_updateState) Task=`fc764a65-08ac-42ea-a9d8-af1adef6bf4d`::moving from state preparing -> state finished >Thread-55689::DEBUG::2014-05-16 18:15:39,106::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55689::DEBUG::2014-05-16 18:15:39,106::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55689::DEBUG::2014-05-16 18:15:39,107::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55689::DEBUG::2014-05-16 18:15:39,107::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55689::DEBUG::2014-05-16 18:15:39,107::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55689::DEBUG::2014-05-16 18:15:39,107::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55689::DEBUG::2014-05-16 18:15:39,107::task::974::TaskManager.Task::(_decref) Task=`fc764a65-08ac-42ea-a9d8-af1adef6bf4d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:15:39,165::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356743 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:41,177::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:41,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353062 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:15:42,953::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:15:42,963::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000689352 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:43,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:43,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311153 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:45,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:45,410::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349066 s, 29.3 MB/s\n'; <rc> = 0 >Thread-55692::DEBUG::2014-05-16 18:15:45,498::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318759.000000 / 8.008323 / 262500000.000000 = 0.205441 >Thread-55692::DEBUG::2014-05-16 18:15:45,498::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053451057828533561, 'statsAge': 1.3769750595092773, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20544145549864706, 'rxDropped': 0} >Thread-55692::DEBUG::2014-05-16 18:15:45,499::task::579::TaskManager.Task::(_updateState) Task=`790c68a3-f18f-469f-8eab-919f8ae0693e`::moving from state init -> state preparing >Thread-55692::INFO::2014-05-16 18:15:45,499::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55692::INFO::2014-05-16 18:15:45,499::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689352', 'lastCheck': '2.5', 'valid': True}} >Thread-55692::DEBUG::2014-05-16 18:15:45,499::task::1168::TaskManager.Task::(prepare) Task=`790c68a3-f18f-469f-8eab-919f8ae0693e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689352', 'lastCheck': '2.5', 'valid': True}} >Thread-55692::DEBUG::2014-05-16 18:15:45,499::task::579::TaskManager.Task::(_updateState) Task=`790c68a3-f18f-469f-8eab-919f8ae0693e`::moving from state preparing -> state finished >Thread-55692::DEBUG::2014-05-16 18:15:45,500::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55692::DEBUG::2014-05-16 18:15:45,500::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55692::DEBUG::2014-05-16 18:15:45,500::task::974::TaskManager.Task::(_decref) Task=`790c68a3-f18f-469f-8eab-919f8ae0693e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:15:47,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:47,492::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035472 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55695::DEBUG::2014-05-16 18:15:49,152::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55695::DEBUG::2014-05-16 18:15:49,152::task::579::TaskManager.Task::(_updateState) Task=`e3c46305-7bdd-47c6-bb86-a7f075740751`::moving from state init -> state preparing >Thread-55695::INFO::2014-05-16 18:15:49,152::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55695::INFO::2014-05-16 18:15:49,153::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55695::DEBUG::2014-05-16 18:15:49,153::task::1168::TaskManager.Task::(prepare) Task=`e3c46305-7bdd-47c6-bb86-a7f075740751`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55695::DEBUG::2014-05-16 18:15:49,153::task::579::TaskManager.Task::(_updateState) Task=`e3c46305-7bdd-47c6-bb86-a7f075740751`::moving from state preparing -> state finished >Thread-55695::DEBUG::2014-05-16 18:15:49,153::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55695::DEBUG::2014-05-16 18:15:49,153::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55695::DEBUG::2014-05-16 18:15:49,153::task::974::TaskManager.Task::(_decref) Task=`e3c46305-7bdd-47c6-bb86-a7f075740751`::ref 0 aborting False >Thread-55696::DEBUG::2014-05-16 18:15:49,162::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55696::DEBUG::2014-05-16 18:15:49,162::task::579::TaskManager.Task::(_updateState) Task=`e9a6cb3e-1957-4dc6-8a11-cad8458fb53d`::moving from state init -> state preparing >Thread-55696::INFO::2014-05-16 18:15:49,162::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55696::DEBUG::2014-05-16 18:15:49,162::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c2217e9d-bcce-4c00-898c-dec9cadf6fd7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55696::DEBUG::2014-05-16 18:15:49,162::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55696::DEBUG::2014-05-16 18:15:49,163::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55696::DEBUG::2014-05-16 18:15:49,163::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c2217e9d-bcce-4c00-898c-dec9cadf6fd7`::Granted request >Thread-55696::DEBUG::2014-05-16 18:15:49,163::task::811::TaskManager.Task::(resourceAcquired) Task=`e9a6cb3e-1957-4dc6-8a11-cad8458fb53d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55696::DEBUG::2014-05-16 18:15:49,163::task::974::TaskManager.Task::(_decref) Task=`e9a6cb3e-1957-4dc6-8a11-cad8458fb53d`::ref 1 aborting False >Thread-55696::INFO::2014-05-16 18:15:49,164::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55696::DEBUG::2014-05-16 18:15:49,164::task::1168::TaskManager.Task::(prepare) Task=`e9a6cb3e-1957-4dc6-8a11-cad8458fb53d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55696::DEBUG::2014-05-16 18:15:49,164::task::579::TaskManager.Task::(_updateState) Task=`e9a6cb3e-1957-4dc6-8a11-cad8458fb53d`::moving from state preparing -> state finished >Thread-55696::DEBUG::2014-05-16 18:15:49,164::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55696::DEBUG::2014-05-16 18:15:49,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55696::DEBUG::2014-05-16 18:15:49,165::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55696::DEBUG::2014-05-16 18:15:49,165::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55696::DEBUG::2014-05-16 18:15:49,165::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55696::DEBUG::2014-05-16 18:15:49,165::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55696::DEBUG::2014-05-16 18:15:49,165::task::974::TaskManager.Task::(_decref) Task=`e9a6cb3e-1957-4dc6-8a11-cad8458fb53d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:15:49,504::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:49,571::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316346 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:51,583::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:51,661::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395382 s, 25.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:15:52,997::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:15:53,007::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000790286 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:53,673::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:53,744::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354872 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:55,756::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:55,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305507 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:15:57,835::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:57,907::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350619 s, 29.2 MB/s\n'; <rc> = 0 >Thread-55700::DEBUG::2014-05-16 18:15:59,217::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55700::DEBUG::2014-05-16 18:15:59,217::task::579::TaskManager.Task::(_updateState) Task=`907c4c46-0598-4e17-8433-ad6743a0478b`::moving from state init -> state preparing >Thread-55700::INFO::2014-05-16 18:15:59,217::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55700::INFO::2014-05-16 18:15:59,218::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55700::DEBUG::2014-05-16 18:15:59,218::task::1168::TaskManager.Task::(prepare) Task=`907c4c46-0598-4e17-8433-ad6743a0478b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55700::DEBUG::2014-05-16 18:15:59,218::task::579::TaskManager.Task::(_updateState) Task=`907c4c46-0598-4e17-8433-ad6743a0478b`::moving from state preparing -> state finished >Thread-55700::DEBUG::2014-05-16 18:15:59,218::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55700::DEBUG::2014-05-16 18:15:59,218::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55700::DEBUG::2014-05-16 18:15:59,218::task::974::TaskManager.Task::(_decref) Task=`907c4c46-0598-4e17-8433-ad6743a0478b`::ref 0 aborting False >Thread-55701::DEBUG::2014-05-16 18:15:59,226::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55701::DEBUG::2014-05-16 18:15:59,226::task::579::TaskManager.Task::(_updateState) Task=`0c09aec5-606e-4f1c-9b86-f6bb108a06a6`::moving from state init -> state preparing >Thread-55701::INFO::2014-05-16 18:15:59,226::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55701::DEBUG::2014-05-16 18:15:59,227::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`302c55a6-1569-4f86-895a-2193afc3f046`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55701::DEBUG::2014-05-16 18:15:59,227::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55701::DEBUG::2014-05-16 18:15:59,227::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55701::DEBUG::2014-05-16 18:15:59,227::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`302c55a6-1569-4f86-895a-2193afc3f046`::Granted request >Thread-55701::DEBUG::2014-05-16 18:15:59,228::task::811::TaskManager.Task::(resourceAcquired) Task=`0c09aec5-606e-4f1c-9b86-f6bb108a06a6`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55701::DEBUG::2014-05-16 18:15:59,228::task::974::TaskManager.Task::(_decref) Task=`0c09aec5-606e-4f1c-9b86-f6bb108a06a6`::ref 1 aborting False >Thread-55701::INFO::2014-05-16 18:15:59,228::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55701::DEBUG::2014-05-16 18:15:59,228::task::1168::TaskManager.Task::(prepare) Task=`0c09aec5-606e-4f1c-9b86-f6bb108a06a6`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55701::DEBUG::2014-05-16 18:15:59,229::task::579::TaskManager.Task::(_updateState) Task=`0c09aec5-606e-4f1c-9b86-f6bb108a06a6`::moving from state preparing -> state finished >Thread-55701::DEBUG::2014-05-16 18:15:59,229::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55701::DEBUG::2014-05-16 18:15:59,229::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55701::DEBUG::2014-05-16 18:15:59,229::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55701::DEBUG::2014-05-16 18:15:59,229::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55701::DEBUG::2014-05-16 18:15:59,229::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55701::DEBUG::2014-05-16 18:15:59,229::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55701::DEBUG::2014-05-16 18:15:59,230::task::974::TaskManager.Task::(_decref) Task=`0c09aec5-606e-4f1c-9b86-f6bb108a06a6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:15:59,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:15:59,987::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312387 s, 32.8 MB/s\n'; <rc> = 0 >Thread-55702::DEBUG::2014-05-16 18:16:00,700::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4338361.000000 / 8.008225 / 262500000.000000 = 0.206376 >Thread-55702::DEBUG::2014-05-16 18:16:00,700::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053826564566475015, 'statsAge': 0.5617680549621582, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20637643919610532, 'rxDropped': 0} >Thread-55702::DEBUG::2014-05-16 18:16:00,700::task::579::TaskManager.Task::(_updateState) Task=`2a99cabb-26df-4e62-9216-82cd27f1e587`::moving from state init -> state preparing >Thread-55702::INFO::2014-05-16 18:16:00,700::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55702::INFO::2014-05-16 18:16:00,701::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790286', 'lastCheck': '7.7', 'valid': True}} >Thread-55702::DEBUG::2014-05-16 18:16:00,701::task::1168::TaskManager.Task::(prepare) Task=`2a99cabb-26df-4e62-9216-82cd27f1e587`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790286', 'lastCheck': '7.7', 'valid': True}} >Thread-55702::DEBUG::2014-05-16 18:16:00,701::task::579::TaskManager.Task::(_updateState) Task=`2a99cabb-26df-4e62-9216-82cd27f1e587`::moving from state preparing -> state finished >Thread-55702::DEBUG::2014-05-16 18:16:00,701::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55702::DEBUG::2014-05-16 18:16:00,701::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55702::DEBUG::2014-05-16 18:16:00,701::task::974::TaskManager.Task::(_decref) Task=`2a99cabb-26df-4e62-9216-82cd27f1e587`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:16:01,999::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:02,072::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361989 s, 28.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:16:03,045::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:16:03,055::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000826781 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:04,084::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:04,156::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316475 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:06,169::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:06,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351508 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:08,251::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:08,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309019 s, 33.1 MB/s\n'; <rc> = 0 >Thread-55706::DEBUG::2014-05-16 18:16:09,262::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55706::DEBUG::2014-05-16 18:16:09,262::task::579::TaskManager.Task::(_updateState) Task=`71733332-6ceb-4e9e-b921-183819ccd29b`::moving from state init -> state preparing >Thread-55706::INFO::2014-05-16 18:16:09,262::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55706::INFO::2014-05-16 18:16:09,263::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55706::DEBUG::2014-05-16 18:16:09,263::task::1168::TaskManager.Task::(prepare) Task=`71733332-6ceb-4e9e-b921-183819ccd29b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55706::DEBUG::2014-05-16 18:16:09,263::task::579::TaskManager.Task::(_updateState) Task=`71733332-6ceb-4e9e-b921-183819ccd29b`::moving from state preparing -> state finished >Thread-55706::DEBUG::2014-05-16 18:16:09,263::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55706::DEBUG::2014-05-16 18:16:09,263::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55706::DEBUG::2014-05-16 18:16:09,264::task::974::TaskManager.Task::(_decref) Task=`71733332-6ceb-4e9e-b921-183819ccd29b`::ref 0 aborting False >Thread-55707::DEBUG::2014-05-16 18:16:09,272::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55707::DEBUG::2014-05-16 18:16:09,272::task::579::TaskManager.Task::(_updateState) Task=`2c7bc6f1-1b50-493b-8d60-718687ab3851`::moving from state init -> state preparing >Thread-55707::INFO::2014-05-16 18:16:09,272::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55707::DEBUG::2014-05-16 18:16:09,273::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e570d218-0a7e-41f6-8aa9-ad33f6789d1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55707::DEBUG::2014-05-16 18:16:09,273::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55707::DEBUG::2014-05-16 18:16:09,273::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55707::DEBUG::2014-05-16 18:16:09,273::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e570d218-0a7e-41f6-8aa9-ad33f6789d1c`::Granted request >Thread-55707::DEBUG::2014-05-16 18:16:09,274::task::811::TaskManager.Task::(resourceAcquired) Task=`2c7bc6f1-1b50-493b-8d60-718687ab3851`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55707::DEBUG::2014-05-16 18:16:09,274::task::974::TaskManager.Task::(_decref) Task=`2c7bc6f1-1b50-493b-8d60-718687ab3851`::ref 1 aborting False >Thread-55707::INFO::2014-05-16 18:16:09,274::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55707::DEBUG::2014-05-16 18:16:09,275::task::1168::TaskManager.Task::(prepare) Task=`2c7bc6f1-1b50-493b-8d60-718687ab3851`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55707::DEBUG::2014-05-16 18:16:09,275::task::579::TaskManager.Task::(_updateState) Task=`2c7bc6f1-1b50-493b-8d60-718687ab3851`::moving from state preparing -> state finished >Thread-55707::DEBUG::2014-05-16 18:16:09,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55707::DEBUG::2014-05-16 18:16:09,275::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55707::DEBUG::2014-05-16 18:16:09,275::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55707::DEBUG::2014-05-16 18:16:09,276::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55707::DEBUG::2014-05-16 18:16:09,276::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55707::DEBUG::2014-05-16 18:16:09,276::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55707::DEBUG::2014-05-16 18:16:09,276::task::974::TaskManager.Task::(_decref) Task=`2c7bc6f1-1b50-493b-8d60-718687ab3851`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:16:10,330::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:10,405::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388281 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:12,417::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:12,488::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351498 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:16:13,088::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:16:13,098::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000820816 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:14,500::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:14,571::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356668 s, 28.7 MB/s\n'; <rc> = 0 >Thread-55710::DEBUG::2014-05-16 18:16:15,917::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319789.000000 / 8.008295 / 262500000.000000 = 0.205491 >Thread-55710::DEBUG::2014-05-16 18:16:15,917::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053713828885688089, 'statsAge': 1.7617518901824951, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20549116791976127, 'rxDropped': 0} >Thread-55710::DEBUG::2014-05-16 18:16:15,918::task::579::TaskManager.Task::(_updateState) Task=`f307d7e4-5dbd-4c4e-a4d1-248f10e2ac03`::moving from state init -> state preparing >Thread-55710::INFO::2014-05-16 18:16:15,918::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55710::INFO::2014-05-16 18:16:15,918::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000820816', 'lastCheck': '2.8', 'valid': True}} >Thread-55710::DEBUG::2014-05-16 18:16:15,918::task::1168::TaskManager.Task::(prepare) Task=`f307d7e4-5dbd-4c4e-a4d1-248f10e2ac03`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000820816', 'lastCheck': '2.8', 'valid': True}} >Thread-55710::DEBUG::2014-05-16 18:16:15,919::task::579::TaskManager.Task::(_updateState) Task=`f307d7e4-5dbd-4c4e-a4d1-248f10e2ac03`::moving from state preparing -> state finished >Thread-55710::DEBUG::2014-05-16 18:16:15,919::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55710::DEBUG::2014-05-16 18:16:15,919::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55710::DEBUG::2014-05-16 18:16:15,919::task::974::TaskManager.Task::(_decref) Task=`f307d7e4-5dbd-4c4e-a4d1-248f10e2ac03`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:16:16,583::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:16,655::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354495 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55712::DEBUG::2014-05-16 18:16:17,771::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [70870f] >Thread-55712::DEBUG::2014-05-16 18:16:17,772::task::579::TaskManager.Task::(_updateState) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::moving from state init -> state preparing >Thread-55712::INFO::2014-05-16 18:16:17,772::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='1bc8999f-f8c1-4144-bc96-05d43428080a', postZero='false', force='false') >Thread-55712::DEBUG::2014-05-16 18:16:17,773::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.1bc8999f-f8c1-4144-bc96-05d43428080a`ReqID=`61a3f8b0-2597-4a43-8be8-c6596c120543`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1526' at 'deleteImage' >Thread-55712::DEBUG::2014-05-16 18:16:17,773::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.1bc8999f-f8c1-4144-bc96-05d43428080a' for lock type 'exclusive' >Thread-55712::DEBUG::2014-05-16 18:16:17,773::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.1bc8999f-f8c1-4144-bc96-05d43428080a' is free. Now locking as 'exclusive' (1 active user) >Thread-55712::DEBUG::2014-05-16 18:16:17,773::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.1bc8999f-f8c1-4144-bc96-05d43428080a`ReqID=`61a3f8b0-2597-4a43-8be8-c6596c120543`::Granted request >Thread-55712::DEBUG::2014-05-16 18:16:17,774::task::811::TaskManager.Task::(resourceAcquired) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::_resourcesAcquired: Storage.1bc8999f-f8c1-4144-bc96-05d43428080a (exclusive) >Thread-55712::DEBUG::2014-05-16 18:16:17,774::task::974::TaskManager.Task::(_decref) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::ref 1 aborting False >Thread-55712::DEBUG::2014-05-16 18:16:17,774::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`4deeeb3d-ba65-440f-9c3c-3b2076b3350a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1527' at 'deleteImage' >Thread-55712::DEBUG::2014-05-16 18:16:17,774::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55712::DEBUG::2014-05-16 18:16:17,774::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55712::DEBUG::2014-05-16 18:16:17,775::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`4deeeb3d-ba65-440f-9c3c-3b2076b3350a`::Granted request >Thread-55712::DEBUG::2014-05-16 18:16:17,776::task::811::TaskManager.Task::(resourceAcquired) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55712::DEBUG::2014-05-16 18:16:17,776::task::974::TaskManager.Task::(_decref) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::ref 1 aborting False >Thread-55712::DEBUG::2014-05-16 18:16:17,776::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55712::DEBUG::2014-05-16 18:16:17,777::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55712::DEBUG::2014-05-16 18:16:17,978::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55712::DEBUG::2014-05-16 18:16:17,993::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55712::DEBUG::2014-05-16 18:16:17,993::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55712::DEBUG::2014-05-16 18:16:17,994::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n -a y --deltag IU_1bc8999f-f8c1-4144-bc96-05d43428080a --addtag IU__remove_me_1bc8999f-f8c1-4144-bc96-05d43428080a f79908bf-a757-4a71-9ab5-3a12ede5f65c/5eb31ec3-0351-420b-bee1-03bf96920f43' (cwd None) >Thread-55712::DEBUG::2014-05-16 18:16:18,298::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-55712::DEBUG::2014-05-16 18:16:18,299::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55712::DEBUG::2014-05-16 18:16:18,299::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55712::WARNING::2014-05-16 18:16:18,299::lvm::1108::Storage.LVM::(removeLVs) Removing active volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/5eb31ec3-0351-420b-bee1-03bf96920f43 >Thread-55712::DEBUG::2014-05-16 18:16:18,300::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n f79908bf-a757-4a71-9ab5-3a12ede5f65c/5eb31ec3-0351-420b-bee1-03bf96920f43' (cwd None) >Thread-55712::DEBUG::2014-05-16 18:16:18,510::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-55712::DEBUG::2014-05-16 18:16:18,510::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55712::DEBUG::2014-05-16 18:16:18,511::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55712::DEBUG::2014-05-16 18:16:18,511::blockSD::935::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a/5eb31ec3-0351-420b-bee1-03bf96920f43'] >Thread-55712::DEBUG::2014-05-16 18:16:18,511::blockSD::946::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/1bc8999f-f8c1-4144-bc96-05d43428080a >Thread-55712::DEBUG::2014-05-16 18:16:18,512::task::736::TaskManager.Task::(_save) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c4dffe87-3182-4d94-ba47-0850149f1701 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c4dffe87-3182-4d94-ba47-0850149f1701.temp >Thread-55712::DEBUG::2014-05-16 18:16:18,518::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_1bc8999f-f8c1-4144-bc96-05d43428080a for task c4dffe87-3182-4d94-ba47-0850149f1701 >Thread-55712::INFO::2014-05-16 18:16:18,518::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-55712::DEBUG::2014-05-16 18:16:18,518::task::1163::TaskManager.Task::(prepare) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::Prepare: 1 jobs exist, move to acquiring >Thread-55712::DEBUG::2014-05-16 18:16:18,518::task::579::TaskManager.Task::(_updateState) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::moving from state preparing -> state acquiring >Thread-55712::DEBUG::2014-05-16 18:16:18,519::task::736::TaskManager.Task::(_save) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c4dffe87-3182-4d94-ba47-0850149f1701 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c4dffe87-3182-4d94-ba47-0850149f1701.temp >Thread-55712::DEBUG::2014-05-16 18:16:18,524::task::579::TaskManager.Task::(_updateState) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::moving from state acquiring -> state queued >Thread-55712::DEBUG::2014-05-16 18:16:18,525::task::736::TaskManager.Task::(_save) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c4dffe87-3182-4d94-ba47-0850149f1701 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c4dffe87-3182-4d94-ba47-0850149f1701.temp >Thread-55712::DEBUG::2014-05-16 18:16:18,530::taskManager::50::TaskManager::(_queueTask) queuing task: c4dffe87-3182-4d94-ba47-0850149f1701 >Thread-55712::DEBUG::2014-05-16 18:16:18,531::taskManager::56::TaskManager::(_queueTask) task queued: c4dffe87-3182-4d94-ba47-0850149f1701 >3f15a681-112c-4f3c-9bff-cb8773f02b1a::DEBUG::2014-05-16 18:16:18,531::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-55712::DEBUG::2014-05-16 18:16:18,532::task::1165::TaskManager.Task::(prepare) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::returning >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,532::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: c4dffe87-3182-4d94-ba47-0850149f1701 running: <bound method Task.commit of <storage.task.Task instance at 0x7ff534444758>> with: None >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,534::task::1176::TaskManager.Task::(commit) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::committing task: c4dffe87-3182-4d94-ba47-0850149f1701 >Thread-55712::DEBUG::2014-05-16 18:16:18,534::task::974::TaskManager.Task::(_decref) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::ref 0 aborting False >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,535::task::579::TaskManager.Task::(_updateState) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::moving from state queued -> state running >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,536::task::736::TaskManager.Task::(_save) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c4dffe87-3182-4d94-ba47-0850149f1701 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c4dffe87-3182-4d94-ba47-0850149f1701.temp >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,542::task::889::TaskManager.Task::(_runJobs) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::Task.run: running job 0: deleteImage_1bc8999f-f8c1-4144-bc96-05d43428080a: <function <lambda> at 0x7ff54052a938> (args: () kwargs: {}) >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,542::task::315::TaskManager.Task::(run) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::Job.run: running deleteImage_1bc8999f-f8c1-4144-bc96-05d43428080a: <function <lambda> at 0x7ff54052a938> (args: () kwargs: {}) callback None >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,542::task::579::TaskManager.Task::(_updateState) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::moving from state running -> state finished >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,543::task::736::TaskManager.Task::(_save) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c4dffe87-3182-4d94-ba47-0850149f1701 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c4dffe87-3182-4d94-ba47-0850149f1701.temp >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,549::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1bc8999f-f8c1-4144-bc96-05d43428080a': < ResourceRef 'Storage.1bc8999f-f8c1-4144-bc96-05d43428080a', isValid: 'True' obj: 'None'>, 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,549::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,549::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.1bc8999f-f8c1-4144-bc96-05d43428080a' >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,549::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.1bc8999f-f8c1-4144-bc96-05d43428080a' (0 active users) >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,550::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.1bc8999f-f8c1-4144-bc96-05d43428080a' is free, finding out if anyone is waiting for it. >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,550::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1bc8999f-f8c1-4144-bc96-05d43428080a', Clearing records. >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,550::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,550::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,550::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,550::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,551::task::897::TaskManager.Task::(_runJobs) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::Task.run: exit - success: result True >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,551::task::974::TaskManager.Task::(_decref) Task=`c4dffe87-3182-4d94-ba47-0850149f1701`::ref 0 aborting False >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:16:18,551::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-51::DEBUG::2014-05-16 18:16:18,667::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:18,738::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349297 s, 29.3 MB/s\n'; <rc> = 0 >Thread-55714::DEBUG::2014-05-16 18:16:19,314::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55714::DEBUG::2014-05-16 18:16:19,314::task::579::TaskManager.Task::(_updateState) Task=`86ceee19-59e9-431f-ae0d-cffc7289799b`::moving from state init -> state preparing >Thread-55714::INFO::2014-05-16 18:16:19,314::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55714::INFO::2014-05-16 18:16:19,314::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55714::DEBUG::2014-05-16 18:16:19,315::task::1168::TaskManager.Task::(prepare) Task=`86ceee19-59e9-431f-ae0d-cffc7289799b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55714::DEBUG::2014-05-16 18:16:19,315::task::579::TaskManager.Task::(_updateState) Task=`86ceee19-59e9-431f-ae0d-cffc7289799b`::moving from state preparing -> state finished >Thread-55714::DEBUG::2014-05-16 18:16:19,315::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55714::DEBUG::2014-05-16 18:16:19,315::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55714::DEBUG::2014-05-16 18:16:19,315::task::974::TaskManager.Task::(_decref) Task=`86ceee19-59e9-431f-ae0d-cffc7289799b`::ref 0 aborting False >Thread-55715::DEBUG::2014-05-16 18:16:19,326::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55715::DEBUG::2014-05-16 18:16:19,326::task::579::TaskManager.Task::(_updateState) Task=`f1d2db8b-351f-428c-bcbd-c9a7c6055028`::moving from state init -> state preparing >Thread-55715::INFO::2014-05-16 18:16:19,326::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55715::DEBUG::2014-05-16 18:16:19,327::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`433deef5-5b3d-453c-9659-8ca8ecda185e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55715::DEBUG::2014-05-16 18:16:19,327::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55715::DEBUG::2014-05-16 18:16:19,327::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55715::DEBUG::2014-05-16 18:16:19,327::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`433deef5-5b3d-453c-9659-8ca8ecda185e`::Granted request >Thread-55715::DEBUG::2014-05-16 18:16:19,327::task::811::TaskManager.Task::(resourceAcquired) Task=`f1d2db8b-351f-428c-bcbd-c9a7c6055028`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55715::DEBUG::2014-05-16 18:16:19,328::task::974::TaskManager.Task::(_decref) Task=`f1d2db8b-351f-428c-bcbd-c9a7c6055028`::ref 1 aborting False >Thread-55715::DEBUG::2014-05-16 18:16:19,328::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-55715::DEBUG::2014-05-16 18:16:19,328::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55715::DEBUG::2014-05-16 18:16:19,579::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55715::DEBUG::2014-05-16 18:16:19,580::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-55715::INFO::2014-05-16 18:16:19,581::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55715::DEBUG::2014-05-16 18:16:19,581::task::1168::TaskManager.Task::(prepare) Task=`f1d2db8b-351f-428c-bcbd-c9a7c6055028`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55715::DEBUG::2014-05-16 18:16:19,581::task::579::TaskManager.Task::(_updateState) Task=`f1d2db8b-351f-428c-bcbd-c9a7c6055028`::moving from state preparing -> state finished >Thread-55715::DEBUG::2014-05-16 18:16:19,582::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55715::DEBUG::2014-05-16 18:16:19,582::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55715::DEBUG::2014-05-16 18:16:19,582::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55715::DEBUG::2014-05-16 18:16:19,582::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55715::DEBUG::2014-05-16 18:16:19,583::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55715::DEBUG::2014-05-16 18:16:19,583::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55715::DEBUG::2014-05-16 18:16:19,583::task::974::TaskManager.Task::(_decref) Task=`f1d2db8b-351f-428c-bcbd-c9a7c6055028`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:16:20,749::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:20,821::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353997 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:22,832::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:22,899::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306643 s, 33.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:16:23,134::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:16:23,144::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000754989 s, 5.4 MB/s\n'; <rc> = 0 >Thread-55717::DEBUG::2014-05-16 18:16:23,415::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55717::DEBUG::2014-05-16 18:16:23,415::task::579::TaskManager.Task::(_updateState) Task=`d771ff66-119c-4a85-905f-d0feecc9e0e1`::moving from state init -> state preparing >Thread-55717::INFO::2014-05-16 18:16:23,416::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-55717::DEBUG::2014-05-16 18:16:23,416::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-55717::DEBUG::2014-05-16 18:16:23,416::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c4dffe87-3182-4d94-ba47-0850149f1701 >Thread-55717::DEBUG::2014-05-16 18:16:23,416::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c4dffe87-3182-4d94-ba47-0850149f1701'} >Thread-55717::DEBUG::2014-05-16 18:16:23,416::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'c4dffe87-3182-4d94-ba47-0850149f1701': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c4dffe87-3182-4d94-ba47-0850149f1701'}} >Thread-55717::INFO::2014-05-16 18:16:23,416::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'c4dffe87-3182-4d94-ba47-0850149f1701': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c4dffe87-3182-4d94-ba47-0850149f1701'}}} >Thread-55717::DEBUG::2014-05-16 18:16:23,417::task::1168::TaskManager.Task::(prepare) Task=`d771ff66-119c-4a85-905f-d0feecc9e0e1`::finished: {'allTasksStatus': {'c4dffe87-3182-4d94-ba47-0850149f1701': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c4dffe87-3182-4d94-ba47-0850149f1701'}}} >Thread-55717::DEBUG::2014-05-16 18:16:23,417::task::579::TaskManager.Task::(_updateState) Task=`d771ff66-119c-4a85-905f-d0feecc9e0e1`::moving from state preparing -> state finished >Thread-55717::DEBUG::2014-05-16 18:16:23,417::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55717::DEBUG::2014-05-16 18:16:23,417::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55717::DEBUG::2014-05-16 18:16:23,417::task::974::TaskManager.Task::(_decref) Task=`d771ff66-119c-4a85-905f-d0feecc9e0e1`::ref 0 aborting False >Thread-55718::DEBUG::2014-05-16 18:16:23,544::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55718::DEBUG::2014-05-16 18:16:23,545::task::579::TaskManager.Task::(_updateState) Task=`33810e5f-d1f0-455a-8086-44766c1b1b4d`::moving from state init -> state preparing >Thread-55718::INFO::2014-05-16 18:16:23,545::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='c4dffe87-3182-4d94-ba47-0850149f1701', spUUID=None, options=None) >Thread-55718::DEBUG::2014-05-16 18:16:23,545::taskManager::161::TaskManager::(clearTask) Entry. taskID: c4dffe87-3182-4d94-ba47-0850149f1701 >Thread-55718::DEBUG::2014-05-16 18:16:23,546::taskManager::166::TaskManager::(clearTask) Return. >Thread-55718::INFO::2014-05-16 18:16:23,546::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-55718::DEBUG::2014-05-16 18:16:23,546::task::1168::TaskManager.Task::(prepare) Task=`33810e5f-d1f0-455a-8086-44766c1b1b4d`::finished: None >Thread-55718::DEBUG::2014-05-16 18:16:23,546::task::579::TaskManager.Task::(_updateState) Task=`33810e5f-d1f0-455a-8086-44766c1b1b4d`::moving from state preparing -> state finished >Thread-55718::DEBUG::2014-05-16 18:16:23,546::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55718::DEBUG::2014-05-16 18:16:23,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55718::DEBUG::2014-05-16 18:16:23,547::task::974::TaskManager.Task::(_decref) Task=`33810e5f-d1f0-455a-8086-44766c1b1b4d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:16:24,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:24,983::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354194 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:26,994::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:27,066::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352759 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:29,078::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:29,153::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036937 s, 27.7 MB/s\n'; <rc> = 0 >Thread-55721::DEBUG::2014-05-16 18:16:29,621::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55721::DEBUG::2014-05-16 18:16:29,622::task::579::TaskManager.Task::(_updateState) Task=`38c4bb29-9df1-4c80-bc62-494a529bb936`::moving from state init -> state preparing >Thread-55721::INFO::2014-05-16 18:16:29,622::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55721::INFO::2014-05-16 18:16:29,622::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55721::DEBUG::2014-05-16 18:16:29,622::task::1168::TaskManager.Task::(prepare) Task=`38c4bb29-9df1-4c80-bc62-494a529bb936`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55721::DEBUG::2014-05-16 18:16:29,623::task::579::TaskManager.Task::(_updateState) Task=`38c4bb29-9df1-4c80-bc62-494a529bb936`::moving from state preparing -> state finished >Thread-55721::DEBUG::2014-05-16 18:16:29,623::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55721::DEBUG::2014-05-16 18:16:29,623::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55721::DEBUG::2014-05-16 18:16:29,623::task::974::TaskManager.Task::(_decref) Task=`38c4bb29-9df1-4c80-bc62-494a529bb936`::ref 0 aborting False >Thread-55722::DEBUG::2014-05-16 18:16:29,632::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55722::DEBUG::2014-05-16 18:16:29,632::task::579::TaskManager.Task::(_updateState) Task=`dd561ef6-b6ba-45fa-be80-d3698ef644b8`::moving from state init -> state preparing >Thread-55722::INFO::2014-05-16 18:16:29,632::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55722::DEBUG::2014-05-16 18:16:29,632::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2d0df495-61d4-457e-b10a-2ff63f1015f2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55722::DEBUG::2014-05-16 18:16:29,633::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55722::DEBUG::2014-05-16 18:16:29,633::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55722::DEBUG::2014-05-16 18:16:29,633::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2d0df495-61d4-457e-b10a-2ff63f1015f2`::Granted request >Thread-55722::DEBUG::2014-05-16 18:16:29,633::task::811::TaskManager.Task::(resourceAcquired) Task=`dd561ef6-b6ba-45fa-be80-d3698ef644b8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55722::DEBUG::2014-05-16 18:16:29,633::task::974::TaskManager.Task::(_decref) Task=`dd561ef6-b6ba-45fa-be80-d3698ef644b8`::ref 1 aborting False >Thread-55722::INFO::2014-05-16 18:16:29,634::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55722::DEBUG::2014-05-16 18:16:29,634::task::1168::TaskManager.Task::(prepare) Task=`dd561ef6-b6ba-45fa-be80-d3698ef644b8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55722::DEBUG::2014-05-16 18:16:29,634::task::579::TaskManager.Task::(_updateState) Task=`dd561ef6-b6ba-45fa-be80-d3698ef644b8`::moving from state preparing -> state finished >Thread-55722::DEBUG::2014-05-16 18:16:29,635::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55722::DEBUG::2014-05-16 18:16:29,635::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55722::DEBUG::2014-05-16 18:16:29,635::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55722::DEBUG::2014-05-16 18:16:29,635::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55722::DEBUG::2014-05-16 18:16:29,635::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55722::DEBUG::2014-05-16 18:16:29,635::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55722::DEBUG::2014-05-16 18:16:29,636::task::974::TaskManager.Task::(_decref) Task=`dd561ef6-b6ba-45fa-be80-d3698ef644b8`::ref 0 aborting False >Thread-55723::DEBUG::2014-05-16 18:16:31,123::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4324073.000000 / 8.007956 / 262500000.000000 = 0.205704 >Thread-55723::DEBUG::2014-05-16 18:16:31,123::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0074195735890638147, 'statsAge': 0.95107197761535645, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20570366508074794, 'rxDropped': 0} >Thread-55723::DEBUG::2014-05-16 18:16:31,123::task::579::TaskManager.Task::(_updateState) Task=`171186f0-e807-424a-8481-7290800c7f5c`::moving from state init -> state preparing >Thread-55723::INFO::2014-05-16 18:16:31,123::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55723::INFO::2014-05-16 18:16:31,124::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000754989', 'lastCheck': '8.0', 'valid': True}} >Thread-55723::DEBUG::2014-05-16 18:16:31,124::task::1168::TaskManager.Task::(prepare) Task=`171186f0-e807-424a-8481-7290800c7f5c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000754989', 'lastCheck': '8.0', 'valid': True}} >Thread-55723::DEBUG::2014-05-16 18:16:31,124::task::579::TaskManager.Task::(_updateState) Task=`171186f0-e807-424a-8481-7290800c7f5c`::moving from state preparing -> state finished >Thread-55723::DEBUG::2014-05-16 18:16:31,124::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55723::DEBUG::2014-05-16 18:16:31,124::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55723::DEBUG::2014-05-16 18:16:31,124::task::974::TaskManager.Task::(_decref) Task=`171186f0-e807-424a-8481-7290800c7f5c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:16:31,165::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:31,232::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308395 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:16:33,182::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:16:33,192::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000858017 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:33,243::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:33,314::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347542 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:35,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:35,394::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307876 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:37,406::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:37,473::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312554 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:39,485::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:39,557::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035698 s, 28.7 MB/s\n'; <rc> = 0 >Thread-55727::DEBUG::2014-05-16 18:16:39,673::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55727::DEBUG::2014-05-16 18:16:39,674::task::579::TaskManager.Task::(_updateState) Task=`1b671412-fa52-4222-b1ee-d259324b7dd2`::moving from state init -> state preparing >Thread-55727::INFO::2014-05-16 18:16:39,674::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55727::INFO::2014-05-16 18:16:39,674::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55727::DEBUG::2014-05-16 18:16:39,675::task::1168::TaskManager.Task::(prepare) Task=`1b671412-fa52-4222-b1ee-d259324b7dd2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55727::DEBUG::2014-05-16 18:16:39,675::task::579::TaskManager.Task::(_updateState) Task=`1b671412-fa52-4222-b1ee-d259324b7dd2`::moving from state preparing -> state finished >Thread-55727::DEBUG::2014-05-16 18:16:39,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55727::DEBUG::2014-05-16 18:16:39,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55727::DEBUG::2014-05-16 18:16:39,675::task::974::TaskManager.Task::(_decref) Task=`1b671412-fa52-4222-b1ee-d259324b7dd2`::ref 0 aborting False >Thread-55728::DEBUG::2014-05-16 18:16:39,683::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55728::DEBUG::2014-05-16 18:16:39,683::task::579::TaskManager.Task::(_updateState) Task=`a3e3eca2-9728-48a6-829e-97ebefd1728a`::moving from state init -> state preparing >Thread-55728::INFO::2014-05-16 18:16:39,684::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55728::DEBUG::2014-05-16 18:16:39,684::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8261048f-447d-4363-88c0-a45236acdcc0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55728::DEBUG::2014-05-16 18:16:39,684::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55728::DEBUG::2014-05-16 18:16:39,684::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55728::DEBUG::2014-05-16 18:16:39,685::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8261048f-447d-4363-88c0-a45236acdcc0`::Granted request >Thread-55728::DEBUG::2014-05-16 18:16:39,685::task::811::TaskManager.Task::(resourceAcquired) Task=`a3e3eca2-9728-48a6-829e-97ebefd1728a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55728::DEBUG::2014-05-16 18:16:39,685::task::974::TaskManager.Task::(_decref) Task=`a3e3eca2-9728-48a6-829e-97ebefd1728a`::ref 1 aborting False >Thread-55728::INFO::2014-05-16 18:16:39,686::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55728::DEBUG::2014-05-16 18:16:39,686::task::1168::TaskManager.Task::(prepare) Task=`a3e3eca2-9728-48a6-829e-97ebefd1728a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55728::DEBUG::2014-05-16 18:16:39,686::task::579::TaskManager.Task::(_updateState) Task=`a3e3eca2-9728-48a6-829e-97ebefd1728a`::moving from state preparing -> state finished >Thread-55728::DEBUG::2014-05-16 18:16:39,686::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55728::DEBUG::2014-05-16 18:16:39,686::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55728::DEBUG::2014-05-16 18:16:39,687::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55728::DEBUG::2014-05-16 18:16:39,687::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55728::DEBUG::2014-05-16 18:16:39,687::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55728::DEBUG::2014-05-16 18:16:39,687::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55728::DEBUG::2014-05-16 18:16:39,687::task::974::TaskManager.Task::(_decref) Task=`a3e3eca2-9728-48a6-829e-97ebefd1728a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:16:41,568::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:41,640::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353224 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:16:43,212::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 18:16:43,212::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:16:43,227::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:16:43,235::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000810002 s, 2.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:16:43,236::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000810002 s, 2.5 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 18:16:43,236::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 18:16:43,236::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 18:16:43,236::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:16:43,237::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:16:43,237::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:16:43,237::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:16:43,237::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:16:43,238::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:16:43,238::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:16:43,395::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:16:43,396::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:16:43,397::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 18:16:43,398::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 18:16:43,398::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 18:16:43,398::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 18:16:43,399::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:16:43,540::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:16:43,560::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:16:43,571::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618464 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:43,651::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:43,721::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344062 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:45,733::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:45,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363277 s, 28.2 MB/s\n'; <rc> = 0 >Thread-55731::DEBUG::2014-05-16 18:16:46,318::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4432312.000000 / 8.008480 / 262500000.000000 = 0.210839 >Thread-55731::DEBUG::2014-05-16 18:16:46,318::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0074445848634996249, 'statsAge': 0.12963199615478516, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2108389849682927, 'rxDropped': 0} >Thread-55731::DEBUG::2014-05-16 18:16:46,319::task::579::TaskManager.Task::(_updateState) Task=`2c5c5b71-e7aa-4a49-a14d-79a32d06c2a4`::moving from state init -> state preparing >Thread-55731::INFO::2014-05-16 18:16:46,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55731::INFO::2014-05-16 18:16:46,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618464', 'lastCheck': '2.7', 'valid': True}} >Thread-55731::DEBUG::2014-05-16 18:16:46,319::task::1168::TaskManager.Task::(prepare) Task=`2c5c5b71-e7aa-4a49-a14d-79a32d06c2a4`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618464', 'lastCheck': '2.7', 'valid': True}} >Thread-55731::DEBUG::2014-05-16 18:16:46,320::task::579::TaskManager.Task::(_updateState) Task=`2c5c5b71-e7aa-4a49-a14d-79a32d06c2a4`::moving from state preparing -> state finished >Thread-55731::DEBUG::2014-05-16 18:16:46,320::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55731::DEBUG::2014-05-16 18:16:46,320::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55731::DEBUG::2014-05-16 18:16:46,320::task::974::TaskManager.Task::(_decref) Task=`2c5c5b71-e7aa-4a49-a14d-79a32d06c2a4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:16:47,817::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:47,889::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360151 s, 28.4 MB/s\n'; <rc> = 0 >Thread-55734::DEBUG::2014-05-16 18:16:49,757::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55734::DEBUG::2014-05-16 18:16:49,757::task::579::TaskManager.Task::(_updateState) Task=`80ee0483-7abb-4e33-ba93-c4ea64eee47d`::moving from state init -> state preparing >Thread-55734::INFO::2014-05-16 18:16:49,757::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55734::INFO::2014-05-16 18:16:49,758::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55734::DEBUG::2014-05-16 18:16:49,758::task::1168::TaskManager.Task::(prepare) Task=`80ee0483-7abb-4e33-ba93-c4ea64eee47d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55734::DEBUG::2014-05-16 18:16:49,758::task::579::TaskManager.Task::(_updateState) Task=`80ee0483-7abb-4e33-ba93-c4ea64eee47d`::moving from state preparing -> state finished >Thread-55734::DEBUG::2014-05-16 18:16:49,758::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55734::DEBUG::2014-05-16 18:16:49,758::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55734::DEBUG::2014-05-16 18:16:49,758::task::974::TaskManager.Task::(_decref) Task=`80ee0483-7abb-4e33-ba93-c4ea64eee47d`::ref 0 aborting False >Thread-55735::DEBUG::2014-05-16 18:16:49,796::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55735::DEBUG::2014-05-16 18:16:49,797::task::579::TaskManager.Task::(_updateState) Task=`a1cb2e15-6480-4963-b940-bd963dff4ef6`::moving from state init -> state preparing >Thread-55735::INFO::2014-05-16 18:16:49,797::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55735::DEBUG::2014-05-16 18:16:49,797::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`55b4a9ad-ec8a-4e7b-ad81-ea4bef3cba68`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55735::DEBUG::2014-05-16 18:16:49,797::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55735::DEBUG::2014-05-16 18:16:49,797::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55735::DEBUG::2014-05-16 18:16:49,797::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`55b4a9ad-ec8a-4e7b-ad81-ea4bef3cba68`::Granted request >Thread-55735::DEBUG::2014-05-16 18:16:49,798::task::811::TaskManager.Task::(resourceAcquired) Task=`a1cb2e15-6480-4963-b940-bd963dff4ef6`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55735::DEBUG::2014-05-16 18:16:49,798::task::974::TaskManager.Task::(_decref) Task=`a1cb2e15-6480-4963-b940-bd963dff4ef6`::ref 1 aborting False >Thread-55735::INFO::2014-05-16 18:16:49,798::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55735::DEBUG::2014-05-16 18:16:49,799::task::1168::TaskManager.Task::(prepare) Task=`a1cb2e15-6480-4963-b940-bd963dff4ef6`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55735::DEBUG::2014-05-16 18:16:49,799::task::579::TaskManager.Task::(_updateState) Task=`a1cb2e15-6480-4963-b940-bd963dff4ef6`::moving from state preparing -> state finished >Thread-55735::DEBUG::2014-05-16 18:16:49,799::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55735::DEBUG::2014-05-16 18:16:49,799::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55735::DEBUG::2014-05-16 18:16:49,799::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55735::DEBUG::2014-05-16 18:16:49,799::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55735::DEBUG::2014-05-16 18:16:49,799::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55735::DEBUG::2014-05-16 18:16:49,800::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55735::DEBUG::2014-05-16 18:16:49,800::task::974::TaskManager.Task::(_decref) Task=`a1cb2e15-6480-4963-b940-bd963dff4ef6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:16:49,901::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:49,968::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306205 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:51,980::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:52,051::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349442 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:16:53,604::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:16:53,614::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112509 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:54,063::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:54,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352433 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:56,146::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:56,217::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296273 s, 34.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:16:58,229::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:16:58,296::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305147 s, 33.6 MB/s\n'; <rc> = 0 >Thread-55739::DEBUG::2014-05-16 18:16:59,841::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55739::DEBUG::2014-05-16 18:16:59,841::task::579::TaskManager.Task::(_updateState) Task=`0432c365-1f12-489d-a1db-d5d8255ddde6`::moving from state init -> state preparing >Thread-55739::INFO::2014-05-16 18:16:59,841::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55739::INFO::2014-05-16 18:16:59,842::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55739::DEBUG::2014-05-16 18:16:59,842::task::1168::TaskManager.Task::(prepare) Task=`0432c365-1f12-489d-a1db-d5d8255ddde6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55739::DEBUG::2014-05-16 18:16:59,842::task::579::TaskManager.Task::(_updateState) Task=`0432c365-1f12-489d-a1db-d5d8255ddde6`::moving from state preparing -> state finished >Thread-55739::DEBUG::2014-05-16 18:16:59,842::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55739::DEBUG::2014-05-16 18:16:59,842::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55739::DEBUG::2014-05-16 18:16:59,842::task::974::TaskManager.Task::(_decref) Task=`0432c365-1f12-489d-a1db-d5d8255ddde6`::ref 0 aborting False >Thread-55740::DEBUG::2014-05-16 18:16:59,859::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55740::DEBUG::2014-05-16 18:16:59,860::task::579::TaskManager.Task::(_updateState) Task=`a47893f6-255c-42b6-8366-13877f27b07b`::moving from state init -> state preparing >Thread-55740::INFO::2014-05-16 18:16:59,860::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55740::DEBUG::2014-05-16 18:16:59,860::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`030a84b4-1fb3-466e-8f61-05f4fc586dcb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55740::DEBUG::2014-05-16 18:16:59,860::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55740::DEBUG::2014-05-16 18:16:59,861::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55740::DEBUG::2014-05-16 18:16:59,861::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`030a84b4-1fb3-466e-8f61-05f4fc586dcb`::Granted request >Thread-55740::DEBUG::2014-05-16 18:16:59,861::task::811::TaskManager.Task::(resourceAcquired) Task=`a47893f6-255c-42b6-8366-13877f27b07b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55740::DEBUG::2014-05-16 18:16:59,861::task::974::TaskManager.Task::(_decref) Task=`a47893f6-255c-42b6-8366-13877f27b07b`::ref 1 aborting False >Thread-55740::INFO::2014-05-16 18:16:59,862::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55740::DEBUG::2014-05-16 18:16:59,862::task::1168::TaskManager.Task::(prepare) Task=`a47893f6-255c-42b6-8366-13877f27b07b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55740::DEBUG::2014-05-16 18:16:59,862::task::579::TaskManager.Task::(_updateState) Task=`a47893f6-255c-42b6-8366-13877f27b07b`::moving from state preparing -> state finished >Thread-55740::DEBUG::2014-05-16 18:16:59,862::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55740::DEBUG::2014-05-16 18:16:59,863::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55740::DEBUG::2014-05-16 18:16:59,863::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55740::DEBUG::2014-05-16 18:16:59,863::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55740::DEBUG::2014-05-16 18:16:59,863::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55740::DEBUG::2014-05-16 18:16:59,863::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55740::DEBUG::2014-05-16 18:16:59,863::task::974::TaskManager.Task::(_decref) Task=`a47893f6-255c-42b6-8366-13877f27b07b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:17:00,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:00,379::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356822 s, 28.7 MB/s\n'; <rc> = 0 >Thread-55741::DEBUG::2014-05-16 18:17:01,580::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5414633.000000 / 8.010995 / 262500000.000000 = 0.257486 >Thread-55741::DEBUG::2014-05-16 18:17:01,580::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0063926425637526674, 'statsAge': 1.3735079765319824, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25748577983262516, 'rxDropped': 0} >Thread-55741::DEBUG::2014-05-16 18:17:01,580::task::579::TaskManager.Task::(_updateState) Task=`0a8c82e1-948b-4800-ac65-4b9a9d3f3128`::moving from state init -> state preparing >Thread-55741::INFO::2014-05-16 18:17:01,581::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55741::INFO::2014-05-16 18:17:01,581::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112509', 'lastCheck': '7.9', 'valid': True}} >Thread-55741::DEBUG::2014-05-16 18:17:01,581::task::1168::TaskManager.Task::(prepare) Task=`0a8c82e1-948b-4800-ac65-4b9a9d3f3128`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112509', 'lastCheck': '7.9', 'valid': True}} >Thread-55741::DEBUG::2014-05-16 18:17:01,581::task::579::TaskManager.Task::(_updateState) Task=`0a8c82e1-948b-4800-ac65-4b9a9d3f3128`::moving from state preparing -> state finished >Thread-55741::DEBUG::2014-05-16 18:17:01,581::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55741::DEBUG::2014-05-16 18:17:01,582::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55741::DEBUG::2014-05-16 18:17:01,582::task::974::TaskManager.Task::(_decref) Task=`0a8c82e1-948b-4800-ac65-4b9a9d3f3128`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:17:02,391::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:02,462::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353313 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:17:03,652::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:17:03,662::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112242 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:04,474::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:04,542::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318292 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:06,554::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:06,625::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346405 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:08,636::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:08,704::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313281 s, 32.7 MB/s\n'; <rc> = 0 >Thread-55745::DEBUG::2014-05-16 18:17:09,893::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55745::DEBUG::2014-05-16 18:17:09,894::task::579::TaskManager.Task::(_updateState) Task=`872cf8d8-efbe-46f8-9a53-64e08b70f898`::moving from state init -> state preparing >Thread-55745::INFO::2014-05-16 18:17:09,894::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55745::INFO::2014-05-16 18:17:09,894::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55745::DEBUG::2014-05-16 18:17:09,894::task::1168::TaskManager.Task::(prepare) Task=`872cf8d8-efbe-46f8-9a53-64e08b70f898`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55745::DEBUG::2014-05-16 18:17:09,895::task::579::TaskManager.Task::(_updateState) Task=`872cf8d8-efbe-46f8-9a53-64e08b70f898`::moving from state preparing -> state finished >Thread-55745::DEBUG::2014-05-16 18:17:09,895::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55745::DEBUG::2014-05-16 18:17:09,895::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55745::DEBUG::2014-05-16 18:17:09,895::task::974::TaskManager.Task::(_decref) Task=`872cf8d8-efbe-46f8-9a53-64e08b70f898`::ref 0 aborting False >Thread-55746::DEBUG::2014-05-16 18:17:09,903::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55746::DEBUG::2014-05-16 18:17:09,903::task::579::TaskManager.Task::(_updateState) Task=`1d87ed9d-2592-476f-ad50-3d6d5666447f`::moving from state init -> state preparing >Thread-55746::INFO::2014-05-16 18:17:09,904::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55746::DEBUG::2014-05-16 18:17:09,904::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2381cbca-ffa4-4fcc-ad9a-9f26ba089702`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55746::DEBUG::2014-05-16 18:17:09,904::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55746::DEBUG::2014-05-16 18:17:09,904::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55746::DEBUG::2014-05-16 18:17:09,905::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`2381cbca-ffa4-4fcc-ad9a-9f26ba089702`::Granted request >Thread-55746::DEBUG::2014-05-16 18:17:09,905::task::811::TaskManager.Task::(resourceAcquired) Task=`1d87ed9d-2592-476f-ad50-3d6d5666447f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55746::DEBUG::2014-05-16 18:17:09,905::task::974::TaskManager.Task::(_decref) Task=`1d87ed9d-2592-476f-ad50-3d6d5666447f`::ref 1 aborting False >Thread-55746::INFO::2014-05-16 18:17:09,906::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55746::DEBUG::2014-05-16 18:17:09,906::task::1168::TaskManager.Task::(prepare) Task=`1d87ed9d-2592-476f-ad50-3d6d5666447f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55746::DEBUG::2014-05-16 18:17:09,906::task::579::TaskManager.Task::(_updateState) Task=`1d87ed9d-2592-476f-ad50-3d6d5666447f`::moving from state preparing -> state finished >Thread-55746::DEBUG::2014-05-16 18:17:09,906::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55746::DEBUG::2014-05-16 18:17:09,906::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55746::DEBUG::2014-05-16 18:17:09,907::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55746::DEBUG::2014-05-16 18:17:09,907::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55746::DEBUG::2014-05-16 18:17:09,907::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55746::DEBUG::2014-05-16 18:17:09,907::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55746::DEBUG::2014-05-16 18:17:09,907::task::974::TaskManager.Task::(_decref) Task=`1d87ed9d-2592-476f-ad50-3d6d5666447f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:17:10,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:10,784::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305708 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:12,795::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:12,867::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035243 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:17:13,697::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:17:13,707::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000870082 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:14,878::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:14,950::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354545 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55749::DEBUG::2014-05-16 18:17:16,794::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319537.000000 / 8.008250 / 262500000.000000 = 0.205480 >Thread-55749::DEBUG::2014-05-16 18:17:16,795::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052842648888075695, 'statsAge': 0.57190608978271484, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20548033654716416, 'rxDropped': 0} >Thread-55749::DEBUG::2014-05-16 18:17:16,795::task::579::TaskManager.Task::(_updateState) Task=`c3090174-920a-4ed9-95c8-b467ac5a5e39`::moving from state init -> state preparing >Thread-55749::INFO::2014-05-16 18:17:16,795::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55749::INFO::2014-05-16 18:17:16,796::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000870082', 'lastCheck': '3.1', 'valid': True}} >Thread-55749::DEBUG::2014-05-16 18:17:16,796::task::1168::TaskManager.Task::(prepare) Task=`c3090174-920a-4ed9-95c8-b467ac5a5e39`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000870082', 'lastCheck': '3.1', 'valid': True}} >Thread-55749::DEBUG::2014-05-16 18:17:16,796::task::579::TaskManager.Task::(_updateState) Task=`c3090174-920a-4ed9-95c8-b467ac5a5e39`::moving from state preparing -> state finished >Thread-55749::DEBUG::2014-05-16 18:17:16,796::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55749::DEBUG::2014-05-16 18:17:16,796::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55749::DEBUG::2014-05-16 18:17:16,796::task::974::TaskManager.Task::(_decref) Task=`c3090174-920a-4ed9-95c8-b467ac5a5e39`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:17:16,961::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:17,033::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347249 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:19,045::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:19,117::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357487 s, 28.6 MB/s\n'; <rc> = 0 >Thread-55752::DEBUG::2014-05-16 18:17:19,968::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55752::DEBUG::2014-05-16 18:17:19,969::task::579::TaskManager.Task::(_updateState) Task=`d565eb4f-2113-4d39-a73c-f7587de20356`::moving from state init -> state preparing >Thread-55752::INFO::2014-05-16 18:17:19,969::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55752::INFO::2014-05-16 18:17:19,969::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55752::DEBUG::2014-05-16 18:17:19,969::task::1168::TaskManager.Task::(prepare) Task=`d565eb4f-2113-4d39-a73c-f7587de20356`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55752::DEBUG::2014-05-16 18:17:19,969::task::579::TaskManager.Task::(_updateState) Task=`d565eb4f-2113-4d39-a73c-f7587de20356`::moving from state preparing -> state finished >Thread-55752::DEBUG::2014-05-16 18:17:19,970::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55752::DEBUG::2014-05-16 18:17:19,970::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55752::DEBUG::2014-05-16 18:17:19,970::task::974::TaskManager.Task::(_decref) Task=`d565eb4f-2113-4d39-a73c-f7587de20356`::ref 0 aborting False >Thread-55753::DEBUG::2014-05-16 18:17:19,980::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55753::DEBUG::2014-05-16 18:17:19,981::task::579::TaskManager.Task::(_updateState) Task=`c50ed837-a0b3-42fd-9a63-9177be89502f`::moving from state init -> state preparing >Thread-55753::INFO::2014-05-16 18:17:19,981::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55753::DEBUG::2014-05-16 18:17:19,981::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`366ac959-2734-423b-b33b-178cdd8167c1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55753::DEBUG::2014-05-16 18:17:19,981::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55753::DEBUG::2014-05-16 18:17:19,981::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55753::DEBUG::2014-05-16 18:17:19,982::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`366ac959-2734-423b-b33b-178cdd8167c1`::Granted request >Thread-55753::DEBUG::2014-05-16 18:17:19,982::task::811::TaskManager.Task::(resourceAcquired) Task=`c50ed837-a0b3-42fd-9a63-9177be89502f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55753::DEBUG::2014-05-16 18:17:19,982::task::974::TaskManager.Task::(_decref) Task=`c50ed837-a0b3-42fd-9a63-9177be89502f`::ref 1 aborting False >Thread-55753::INFO::2014-05-16 18:17:19,982::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55753::DEBUG::2014-05-16 18:17:19,983::task::1168::TaskManager.Task::(prepare) Task=`c50ed837-a0b3-42fd-9a63-9177be89502f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55753::DEBUG::2014-05-16 18:17:19,983::task::579::TaskManager.Task::(_updateState) Task=`c50ed837-a0b3-42fd-9a63-9177be89502f`::moving from state preparing -> state finished >Thread-55753::DEBUG::2014-05-16 18:17:19,983::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55753::DEBUG::2014-05-16 18:17:19,983::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55753::DEBUG::2014-05-16 18:17:19,983::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55753::DEBUG::2014-05-16 18:17:19,983::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55753::DEBUG::2014-05-16 18:17:19,984::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55753::DEBUG::2014-05-16 18:17:19,984::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55753::DEBUG::2014-05-16 18:17:19,984::task::974::TaskManager.Task::(_decref) Task=`c50ed837-a0b3-42fd-9a63-9177be89502f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:17:21,128::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:21,195::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306168 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:23,206::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:23,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311753 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:17:23,745::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:17:23,755::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000816323 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:25,285::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:25,352::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308892 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:27,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55756::DEBUG::2014-05-16 18:17:27,434::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [5931e2fa] >Thread-55756::DEBUG::2014-05-16 18:17:27,435::task::579::TaskManager.Task::(_updateState) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::moving from state init -> state preparing >Thread-55756::INFO::2014-05-16 18:17:27,437::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='f26629d9-43c3-42cd-a3e6-93cb35cb35c7', size='34359738368', volFormat=4, preallocate=2, diskType=2, volUUID='2b9374f4-1eca-47cb-a470-59600aae5d57', desc='', srcImgUUID='7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', srcVolUUID='77c78124-ee6c-46b1-9112-a738f448beca') >Thread-55756::DEBUG::2014-05-16 18:17:27,439::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`b4599574-347b-4ff2-8801-70b6283611fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1484' at 'createVolume' >Thread-55756::DEBUG::2014-05-16 18:17:27,440::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55756::DEBUG::2014-05-16 18:17:27,441::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55756::DEBUG::2014-05-16 18:17:27,442::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`b4599574-347b-4ff2-8801-70b6283611fb`::Granted request >Thread-55756::DEBUG::2014-05-16 18:17:27,444::task::811::TaskManager.Task::(resourceAcquired) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55756::DEBUG::2014-05-16 18:17:27,445::task::974::TaskManager.Task::(_decref) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::ref 1 aborting False >Thread-55756::DEBUG::2014-05-16 18:17:27,449::task::736::TaskManager.Task::(_save) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0.temp >Dummy-51::DEBUG::2014-05-16 18:17:27,464::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345873 s, 29.6 MB/s\n'; <rc> = 0 >Thread-55756::DEBUG::2014-05-16 18:17:27,464::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 323d3712-3fe8-4bf8-b895-f908ed5c1ff0 >Thread-55756::INFO::2014-05-16 18:17:27,465::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-55756::DEBUG::2014-05-16 18:17:27,466::task::1163::TaskManager.Task::(prepare) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::Prepare: 1 jobs exist, move to acquiring >Thread-55756::DEBUG::2014-05-16 18:17:27,467::task::579::TaskManager.Task::(_updateState) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::moving from state preparing -> state acquiring >Thread-55756::DEBUG::2014-05-16 18:17:27,469::task::736::TaskManager.Task::(_save) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0.temp >Thread-55756::DEBUG::2014-05-16 18:17:27,482::task::579::TaskManager.Task::(_updateState) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::moving from state acquiring -> state queued >Thread-55756::DEBUG::2014-05-16 18:17:27,484::task::736::TaskManager.Task::(_save) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0.temp >Thread-55756::DEBUG::2014-05-16 18:17:27,497::taskManager::50::TaskManager::(_queueTask) queuing task: 323d3712-3fe8-4bf8-b895-f908ed5c1ff0 >Thread-55756::DEBUG::2014-05-16 18:17:27,498::taskManager::56::TaskManager::(_queueTask) task queued: 323d3712-3fe8-4bf8-b895-f908ed5c1ff0 >c4dffe87-3182-4d94-ba47-0850149f1701::DEBUG::2014-05-16 18:17:27,498::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-55756::DEBUG::2014-05-16 18:17:27,499::task::1165::TaskManager.Task::(prepare) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::returning >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,500::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 323d3712-3fe8-4bf8-b895-f908ed5c1ff0 running: <bound method Task.commit of <storage.task.Task instance at 0x7ff5343e7248>> with: None >Thread-55756::DEBUG::2014-05-16 18:17:27,501::task::974::TaskManager.Task::(_decref) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::ref 0 aborting False >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,502::task::1176::TaskManager.Task::(commit) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::committing task: 323d3712-3fe8-4bf8-b895-f908ed5c1ff0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,504::task::579::TaskManager.Task::(_updateState) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::moving from state queued -> state running >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,506::task::736::TaskManager.Task::(_save) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0.temp >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,522::task::889::TaskManager.Task::(_runJobs) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x2b04510>> (args: ('f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 67108864, 4, 2, 2, '2b9374f4-1eca-47cb-a470-59600aae5d57', '', '7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', '77c78124-ee6c-46b1-9112-a738f448beca') kwargs: {}) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,522::task::315::TaskManager.Task::(run) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x2b04510>> (args: ('f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 67108864, 4, 2, 2, '2b9374f4-1eca-47cb-a470-59600aae5d57', '', '7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', '77c78124-ee6c-46b1-9112-a738f448beca') kwargs: {}) callback None >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,522::resourceManager::197::ResourceManager.Request::(__init__) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f26629d9-43c3-42cd-a3e6-93cb35cb35c7`ReqID=`d846cf55-d345-468b-9366-69e25fcccc9e`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1895' at 'createVolume' >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,522::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f26629d9-43c3-42cd-a3e6-93cb35cb35c7' for lock type 'exclusive' >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,523::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,523::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,671::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,684::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,684::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,685::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image f26629d9-43c3-42cd-a3e6-93cb35cb35c7 does not exist in domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,685::resourceManager::600::ResourceManager::(registerResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f26629d9-43c3-42cd-a3e6-93cb35cb35c7' is free. Now locking as 'exclusive' (1 active user) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,685::resourceManager::237::ResourceManager.Request::(grant) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f26629d9-43c3-42cd-a3e6-93cb35cb35c7`ReqID=`d846cf55-d345-468b-9366-69e25fcccc9e`::Granted request >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::INFO::2014-05-16 18:17:27,685::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7 for image's volumes >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,686::task::736::TaskManager.Task::(_save) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0.temp >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,711::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,720::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000530686 s, 965 kB/s\n'; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,720::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000530686 s, 965 kB/s'], size: 512 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,720::volume::300::Storage.Volume::(share) Share volume 77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,739::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,747::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000509738 s, 1.0 MB/s\n'; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,748::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000509738 s, 1.0 MB/s'], size: 512 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,748::task::736::TaskManager.Task::(_save) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0.temp >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,755::blockVolume::380::Storage.Volume::(_share) Share volume 77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,774::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,783::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00105731 s, 484 kB/s\n'; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,783::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00105731 s, 484 kB/s'], size: 512 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::INFO::2014-05-16 18:17:27,783::volume::446::Storage.Volume::(create) Creating volume 2b9374f4-1eca-47cb-a470-59600aae5d57 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,784::task::736::TaskManager.Task::(_save) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0.temp >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,839::task::736::TaskManager.Task::(_save) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0.temp >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:27,847::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 2b9374f4-1eca-47cb-a470-59600aae5d57 f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,043::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,044::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,044::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,045::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,046::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::WARNING::2014-05-16 18:17:28,046::utils::114::root::(rmFile) File: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57 already removed >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::INFO::2014-05-16 18:17:28,051::blockVolume::196::Storage.Volume::(_create) Request to create snapshot f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57 of volume 7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96/77c78124-ee6c-46b1-9112-a738f448beca >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,052::task::736::TaskManager.Task::(_save) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0.temp >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,084::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,094::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000550142 s, 931 kB/s\n'; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,094::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000550142 s, 931 kB/s'], size: 512 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::INFO::2014-05-16 18:17:28,094::volume::793::Storage.Volume::(prepare) Volume: preparing volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,113::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,121::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000508962 s, 1.0 MB/s\n'; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,122::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000508962 s, 1.0 MB/s'], size: 512 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,122::resourceManager::197::ResourceManager.Request::(__init__) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca`ReqID=`e6d4cc01-3f8a-40a0-859b-5cbd0d5b9564`::Request was made in '/usr/share/vdsm/storage/volume.py' line '810' at 'prepare' >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,122::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' for lock type 'shared' >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,123::resourceManager::600::ResourceManager::(registerResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' is free. Now locking as 'shared' (1 active user) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,123::resourceManager::237::ResourceManager.Request::(grant) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca`ReqID=`e6d4cc01-3f8a-40a0-859b-5cbd0d5b9564`::Granted request >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,141::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,150::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000505589 s, 1.0 MB/s\n'; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,150::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000505589 s, 1.0 MB/s'], size: 512 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,150::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,169::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,177::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000506423 s, 1.0 MB/s\n'; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,177::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000506423 s, 1.0 MB/s'], size: 512 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,196::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,204::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000493083 s, 1.0 MB/s\n'; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,204::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000493083 s, 1.0 MB/s'], size: 512 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,205::volume::1058::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../f26629d9-43c3-42cd-a3e6-93cb35cb35c7/77c78124-ee6c-46b1-9112-a738f448beca /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57' (cwd /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,248::volume::1058::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::INFO::2014-05-16 18:17:28,248::blockVolume::420::Storage.Volume::(teardown) Tearing down volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca justme False >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,248::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,249::resourceManager::634::ResourceManager::(releaseResource) Released resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' (0 active users) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,249::resourceManager::640::ResourceManager::(releaseResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' is free, finding out if anyone is waiting for it. >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,250::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,419::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,420::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,420::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,420::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca', Clearing records. >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,421::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,421::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,573::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,587::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,587::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,588::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,588::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,738::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,753::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,753::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::WARNING::2014-05-16 18:17:28,754::blockSD::743::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv f79908bf-a757-4a71-9ab5-3a12ede5f65c/2b9374f4-1eca-47cb-a470-59600aae5d57 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,754::blockSD::766::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 15 in VG f79908bf-a757-4a71-9ab5-3a12ede5f65c >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,755::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_15 --addtag IU_f26629d9-43c3-42cd-a3e6-93cb35cb35c7 --addtag PU_77c78124-ee6c-46b1-9112-a738f448beca f79908bf-a757-4a71-9ab5-3a12ede5f65c/2b9374f4-1eca-47cb-a470-59600aae5d57' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,932::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,932::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,933::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:28,933::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/2b9374f4-1eca-47cb-a470-59600aae5d57' (cwd None) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,095::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,096::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,096::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,097::task::736::TaskManager.Task::(_save) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0.temp >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,127::blockVolume::622::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=2b9374f4-1eca-47cb-a470-59600aae5d57 sdUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c, metaId=('f79908bf-a757-4a71-9ab5-3a12ede5f65c', 15) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,142::task::736::TaskManager.Task::(_save) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0.temp >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,153::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f26629d9-43c3-42cd-a3e6-93cb35cb35c7' >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,153::resourceManager::634::ResourceManager::(releaseResource) Released resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f26629d9-43c3-42cd-a3e6-93cb35cb35c7' (0 active users) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,153::resourceManager::640::ResourceManager::(releaseResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f26629d9-43c3-42cd-a3e6-93cb35cb35c7' is free, finding out if anyone is waiting for it. >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,154::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.f26629d9-43c3-42cd-a3e6-93cb35cb35c7', Clearing records. >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,154::task::579::TaskManager.Task::(_updateState) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::moving from state running -> state finished >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,155::task::736::TaskManager.Task::(_save) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/323d3712-3fe8-4bf8-b895-f908ed5c1ff0.temp >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,166::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,166::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,166::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,166::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,167::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,167::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,167::task::897::TaskManager.Task::(_runJobs) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::Task.run: exit - success: result {'uuid': '2b9374f4-1eca-47cb-a470-59600aae5d57'} >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,167::task::974::TaskManager.Task::(_decref) Task=`323d3712-3fe8-4bf8-b895-f908ed5c1ff0`::ref 0 aborting False >323d3712-3fe8-4bf8-b895-f908ed5c1ff0::DEBUG::2014-05-16 18:17:29,167::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-51::DEBUG::2014-05-16 18:17:29,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:29,593::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339644 s, 30.1 MB/s\n'; <rc> = 0 >Thread-55758::DEBUG::2014-05-16 18:17:30,020::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55758::DEBUG::2014-05-16 18:17:30,020::task::579::TaskManager.Task::(_updateState) Task=`74b0d47f-9aff-432a-9008-7a71031d5312`::moving from state init -> state preparing >Thread-55758::INFO::2014-05-16 18:17:30,020::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55758::INFO::2014-05-16 18:17:30,021::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55758::DEBUG::2014-05-16 18:17:30,021::task::1168::TaskManager.Task::(prepare) Task=`74b0d47f-9aff-432a-9008-7a71031d5312`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55758::DEBUG::2014-05-16 18:17:30,021::task::579::TaskManager.Task::(_updateState) Task=`74b0d47f-9aff-432a-9008-7a71031d5312`::moving from state preparing -> state finished >Thread-55758::DEBUG::2014-05-16 18:17:30,021::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55758::DEBUG::2014-05-16 18:17:30,021::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55758::DEBUG::2014-05-16 18:17:30,021::task::974::TaskManager.Task::(_decref) Task=`74b0d47f-9aff-432a-9008-7a71031d5312`::ref 0 aborting False >Thread-55759::DEBUG::2014-05-16 18:17:30,031::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55759::DEBUG::2014-05-16 18:17:30,032::task::579::TaskManager.Task::(_updateState) Task=`bc36127d-3cc0-43a0-aae1-8d2b005d626c`::moving from state init -> state preparing >Thread-55759::INFO::2014-05-16 18:17:30,032::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55759::DEBUG::2014-05-16 18:17:30,032::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1baa4686-1f66-4602-9b09-5508c36c3464`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55759::DEBUG::2014-05-16 18:17:30,032::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55759::DEBUG::2014-05-16 18:17:30,033::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55759::DEBUG::2014-05-16 18:17:30,033::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1baa4686-1f66-4602-9b09-5508c36c3464`::Granted request >Thread-55759::DEBUG::2014-05-16 18:17:30,033::task::811::TaskManager.Task::(resourceAcquired) Task=`bc36127d-3cc0-43a0-aae1-8d2b005d626c`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55759::DEBUG::2014-05-16 18:17:30,033::task::974::TaskManager.Task::(_decref) Task=`bc36127d-3cc0-43a0-aae1-8d2b005d626c`::ref 1 aborting False >Thread-55759::DEBUG::2014-05-16 18:17:30,034::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-55759::DEBUG::2014-05-16 18:17:30,034::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55759::DEBUG::2014-05-16 18:17:30,183::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55759::DEBUG::2014-05-16 18:17:30,185::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-55759::INFO::2014-05-16 18:17:30,185::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55759::DEBUG::2014-05-16 18:17:30,186::task::1168::TaskManager.Task::(prepare) Task=`bc36127d-3cc0-43a0-aae1-8d2b005d626c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55759::DEBUG::2014-05-16 18:17:30,186::task::579::TaskManager.Task::(_updateState) Task=`bc36127d-3cc0-43a0-aae1-8d2b005d626c`::moving from state preparing -> state finished >Thread-55759::DEBUG::2014-05-16 18:17:30,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55759::DEBUG::2014-05-16 18:17:30,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55759::DEBUG::2014-05-16 18:17:30,186::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55759::DEBUG::2014-05-16 18:17:30,187::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55759::DEBUG::2014-05-16 18:17:30,187::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55759::DEBUG::2014-05-16 18:17:30,187::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55759::DEBUG::2014-05-16 18:17:30,187::task::974::TaskManager.Task::(_decref) Task=`bc36127d-3cc0-43a0-aae1-8d2b005d626c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:17:31,604::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:31,676::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351931 s, 29.1 MB/s\n'; <rc> = 0 >Thread-55760::DEBUG::2014-05-16 18:17:32,002::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 6436927.000000 / 8.009561 / 262500000.000000 = 0.306154 >Thread-55760::DEBUG::2014-05-16 18:17:32,002::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.11525501686153836, 'statsAge': 1.763840913772583, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.30615443814314153, 'rxDropped': 0} >Thread-55760::DEBUG::2014-05-16 18:17:32,003::task::579::TaskManager.Task::(_updateState) Task=`5ac92b37-3e83-450a-83b0-82110bc74dad`::moving from state init -> state preparing >Thread-55760::INFO::2014-05-16 18:17:32,003::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55760::INFO::2014-05-16 18:17:32,003::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000816323', 'lastCheck': '8.2', 'valid': True}} >Thread-55760::DEBUG::2014-05-16 18:17:32,004::task::1168::TaskManager.Task::(prepare) Task=`5ac92b37-3e83-450a-83b0-82110bc74dad`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000816323', 'lastCheck': '8.2', 'valid': True}} >Thread-55760::DEBUG::2014-05-16 18:17:32,004::task::579::TaskManager.Task::(_updateState) Task=`5ac92b37-3e83-450a-83b0-82110bc74dad`::moving from state preparing -> state finished >Thread-55760::DEBUG::2014-05-16 18:17:32,004::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55760::DEBUG::2014-05-16 18:17:32,004::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55760::DEBUG::2014-05-16 18:17:32,004::task::974::TaskManager.Task::(_decref) Task=`5ac92b37-3e83-450a-83b0-82110bc74dad`::ref 0 aborting False >Thread-55762::DEBUG::2014-05-16 18:17:33,534::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55762::DEBUG::2014-05-16 18:17:33,534::task::579::TaskManager.Task::(_updateState) Task=`82f46581-1831-4c37-bf7a-33e4c25a94de`::moving from state init -> state preparing >Thread-55762::INFO::2014-05-16 18:17:33,535::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-55762::DEBUG::2014-05-16 18:17:33,535::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-55762::DEBUG::2014-05-16 18:17:33,535::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 323d3712-3fe8-4bf8-b895-f908ed5c1ff0 >Thread-55762::DEBUG::2014-05-16 18:17:33,535::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '323d3712-3fe8-4bf8-b895-f908ed5c1ff0'} >Thread-55762::DEBUG::2014-05-16 18:17:33,535::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'323d3712-3fe8-4bf8-b895-f908ed5c1ff0': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '323d3712-3fe8-4bf8-b895-f908ed5c1ff0'}} >Thread-55762::INFO::2014-05-16 18:17:33,535::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'323d3712-3fe8-4bf8-b895-f908ed5c1ff0': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '323d3712-3fe8-4bf8-b895-f908ed5c1ff0'}}} >Thread-55762::DEBUG::2014-05-16 18:17:33,535::task::1168::TaskManager.Task::(prepare) Task=`82f46581-1831-4c37-bf7a-33e4c25a94de`::finished: {'allTasksStatus': {'323d3712-3fe8-4bf8-b895-f908ed5c1ff0': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '323d3712-3fe8-4bf8-b895-f908ed5c1ff0'}}} >Thread-55762::DEBUG::2014-05-16 18:17:33,536::task::579::TaskManager.Task::(_updateState) Task=`82f46581-1831-4c37-bf7a-33e4c25a94de`::moving from state preparing -> state finished >Thread-55762::DEBUG::2014-05-16 18:17:33,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55762::DEBUG::2014-05-16 18:17:33,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55762::DEBUG::2014-05-16 18:17:33,536::task::974::TaskManager.Task::(_decref) Task=`82f46581-1831-4c37-bf7a-33e4c25a94de`::ref 0 aborting False >Thread-55763::DEBUG::2014-05-16 18:17:33,676::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [5931e2fa] >Thread-55763::DEBUG::2014-05-16 18:17:33,676::task::579::TaskManager.Task::(_updateState) Task=`2bc33e61-12a7-4320-9ebc-51b030c05d34`::moving from state init -> state preparing >Thread-55763::INFO::2014-05-16 18:17:33,676::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='f26629d9-43c3-42cd-a3e6-93cb35cb35c7', volUUID='2b9374f4-1eca-47cb-a470-59600aae5d57', options=None) >Thread-55763::DEBUG::2014-05-16 18:17:33,676::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`3cc424d4-b6c6-4d6c-9e83-f960c9ac3109`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3104' at 'getVolumeInfo' >Thread-55763::DEBUG::2014-05-16 18:17:33,677::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55763::DEBUG::2014-05-16 18:17:33,677::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55763::DEBUG::2014-05-16 18:17:33,677::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`3cc424d4-b6c6-4d6c-9e83-f960c9ac3109`::Granted request >Thread-55763::DEBUG::2014-05-16 18:17:33,677::task::811::TaskManager.Task::(resourceAcquired) Task=`2bc33e61-12a7-4320-9ebc-51b030c05d34`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55763::DEBUG::2014-05-16 18:17:33,677::task::974::TaskManager.Task::(_decref) Task=`2bc33e61-12a7-4320-9ebc-51b030c05d34`::ref 1 aborting False >Thread-55763::DEBUG::2014-05-16 18:17:33,678::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55763::DEBUG::2014-05-16 18:17:33,678::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:33,688::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:33,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0527075 s, 19.4 MB/s\n'; <rc> = 0 >Thread-55763::DEBUG::2014-05-16 18:17:33,843::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55763::DEBUG::2014-05-16 18:17:33,897::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55763::DEBUG::2014-05-16 18:17:33,899::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55763::INFO::2014-05-16 18:17:33,901::volume::883::Storage.Volume::(getInfo) Info request: sdUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c imgUUID=f26629d9-43c3-42cd-a3e6-93cb35cb35c7 volUUID = 2b9374f4-1eca-47cb-a470-59600aae5d57 >Thread-30::DEBUG::2014-05-16 18:17:33,964::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:17:34,002::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000521311 s, 7.9 MB/s\n'; <rc> = 0 >Thread-55763::DEBUG::2014-05-16 18:17:34,096::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-55763::DEBUG::2014-05-16 18:17:34,117::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000475617 s, 1.1 MB/s\n'; <rc> = 0 >Thread-55763::DEBUG::2014-05-16 18:17:34,119::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000475617 s, 1.1 MB/s'], size: 512 >Thread-55763::DEBUG::2014-05-16 18:17:34,169::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-55763::DEBUG::2014-05-16 18:17:34,178::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000537466 s, 953 kB/s\n'; <rc> = 0 >Thread-55763::DEBUG::2014-05-16 18:17:34,178::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000537466 s, 953 kB/s'], size: 512 >Thread-55763::DEBUG::2014-05-16 18:17:34,178::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55763::DEBUG::2014-05-16 18:17:34,179::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55763::DEBUG::2014-05-16 18:17:34,324::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55763::DEBUG::2014-05-16 18:17:34,339::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55763::DEBUG::2014-05-16 18:17:34,339::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55763::INFO::2014-05-16 18:17:34,339::volume::912::Storage.Volume::(getInfo) f79908bf-a757-4a71-9ab5-3a12ede5f65c/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57 info is {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 'ctime': '1400264249', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400264249', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-55763::INFO::2014-05-16 18:17:34,340::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 'ctime': '1400264249', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400264249', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-55763::DEBUG::2014-05-16 18:17:34,340::task::1168::TaskManager.Task::(prepare) Task=`2bc33e61-12a7-4320-9ebc-51b030c05d34`::finished: {'info': {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 'ctime': '1400264249', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400264249', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-55763::DEBUG::2014-05-16 18:17:34,340::task::579::TaskManager.Task::(_updateState) Task=`2bc33e61-12a7-4320-9ebc-51b030c05d34`::moving from state preparing -> state finished >Thread-55763::DEBUG::2014-05-16 18:17:34,340::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55763::DEBUG::2014-05-16 18:17:34,340::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55763::DEBUG::2014-05-16 18:17:34,341::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55763::DEBUG::2014-05-16 18:17:34,341::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55763::DEBUG::2014-05-16 18:17:34,341::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55763::DEBUG::2014-05-16 18:17:34,341::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55763::DEBUG::2014-05-16 18:17:34,341::task::974::TaskManager.Task::(_decref) Task=`2bc33e61-12a7-4320-9ebc-51b030c05d34`::ref 0 aborting False >Thread-55764::DEBUG::2014-05-16 18:17:34,440::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55764::DEBUG::2014-05-16 18:17:34,441::task::579::TaskManager.Task::(_updateState) Task=`6f65adb0-9b7d-4ee3-b181-028e50887d66`::moving from state init -> state preparing >Thread-55764::INFO::2014-05-16 18:17:34,441::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='323d3712-3fe8-4bf8-b895-f908ed5c1ff0', spUUID=None, options=None) >Thread-55764::DEBUG::2014-05-16 18:17:34,441::taskManager::161::TaskManager::(clearTask) Entry. taskID: 323d3712-3fe8-4bf8-b895-f908ed5c1ff0 >Thread-55764::DEBUG::2014-05-16 18:17:34,442::taskManager::166::TaskManager::(clearTask) Return. >Thread-55764::INFO::2014-05-16 18:17:34,442::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-55764::DEBUG::2014-05-16 18:17:34,442::task::1168::TaskManager.Task::(prepare) Task=`6f65adb0-9b7d-4ee3-b181-028e50887d66`::finished: None >Thread-55764::DEBUG::2014-05-16 18:17:34,442::task::579::TaskManager.Task::(_updateState) Task=`6f65adb0-9b7d-4ee3-b181-028e50887d66`::moving from state preparing -> state finished >Thread-55764::DEBUG::2014-05-16 18:17:34,442::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55764::DEBUG::2014-05-16 18:17:34,443::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55764::DEBUG::2014-05-16 18:17:34,443::task::974::TaskManager.Task::(_decref) Task=`6f65adb0-9b7d-4ee3-b181-028e50887d66`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:17:36,156::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:36,228::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353681 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:38,239::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:38,313::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332978 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:40,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55767::DEBUG::2014-05-16 18:17:40,392::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55767::DEBUG::2014-05-16 18:17:40,394::task::579::TaskManager.Task::(_updateState) Task=`858cedce-b941-4856-a9f2-59bc0d3d946c`::moving from state init -> state preparing >Thread-55767::INFO::2014-05-16 18:17:40,395::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55767::INFO::2014-05-16 18:17:40,396::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55767::DEBUG::2014-05-16 18:17:40,397::task::1168::TaskManager.Task::(prepare) Task=`858cedce-b941-4856-a9f2-59bc0d3d946c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55767::DEBUG::2014-05-16 18:17:40,398::task::579::TaskManager.Task::(_updateState) Task=`858cedce-b941-4856-a9f2-59bc0d3d946c`::moving from state preparing -> state finished >Thread-55767::DEBUG::2014-05-16 18:17:40,399::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55767::DEBUG::2014-05-16 18:17:40,399::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55767::DEBUG::2014-05-16 18:17:40,400::task::974::TaskManager.Task::(_decref) Task=`858cedce-b941-4856-a9f2-59bc0d3d946c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:17:40,414::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305622 s, 33.5 MB/s\n'; <rc> = 0 >Thread-55768::DEBUG::2014-05-16 18:17:40,454::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55768::DEBUG::2014-05-16 18:17:40,455::task::579::TaskManager.Task::(_updateState) Task=`45c20d7f-9dc9-4938-ab61-f10589d8e90a`::moving from state init -> state preparing >Thread-55768::INFO::2014-05-16 18:17:40,455::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55768::DEBUG::2014-05-16 18:17:40,455::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`18333df5-d5e3-4b86-87d5-a5d61166ea4e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55768::DEBUG::2014-05-16 18:17:40,455::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55768::DEBUG::2014-05-16 18:17:40,456::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55768::DEBUG::2014-05-16 18:17:40,456::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`18333df5-d5e3-4b86-87d5-a5d61166ea4e`::Granted request >Thread-55768::DEBUG::2014-05-16 18:17:40,456::task::811::TaskManager.Task::(resourceAcquired) Task=`45c20d7f-9dc9-4938-ab61-f10589d8e90a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55768::DEBUG::2014-05-16 18:17:40,456::task::974::TaskManager.Task::(_decref) Task=`45c20d7f-9dc9-4938-ab61-f10589d8e90a`::ref 1 aborting False >Thread-55768::INFO::2014-05-16 18:17:40,457::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55768::DEBUG::2014-05-16 18:17:40,457::task::1168::TaskManager.Task::(prepare) Task=`45c20d7f-9dc9-4938-ab61-f10589d8e90a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55768::DEBUG::2014-05-16 18:17:40,457::task::579::TaskManager.Task::(_updateState) Task=`45c20d7f-9dc9-4938-ab61-f10589d8e90a`::moving from state preparing -> state finished >Thread-55768::DEBUG::2014-05-16 18:17:40,457::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55768::DEBUG::2014-05-16 18:17:40,458::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55768::DEBUG::2014-05-16 18:17:40,458::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55768::DEBUG::2014-05-16 18:17:40,458::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55768::DEBUG::2014-05-16 18:17:40,458::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55768::DEBUG::2014-05-16 18:17:40,458::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55768::DEBUG::2014-05-16 18:17:40,459::task::974::TaskManager.Task::(_decref) Task=`45c20d7f-9dc9-4938-ab61-f10589d8e90a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:17:42,426::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:42,497::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347732 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:17:44,175::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:17:44,185::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990516 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:44,508::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:44,579::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352874 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:46,590::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:46,667::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390469 s, 26.2 MB/s\n'; <rc> = 0 >Thread-55771::DEBUG::2014-05-16 18:17:47,323::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4320691.000000 / 8.008703 / 262500000.000000 = 0.205524 >Thread-55771::DEBUG::2014-05-16 18:17:47,323::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0072244264473308485, 'statsAge': 1.0677399635314941, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20552360665234179, 'rxDropped': 0} >Thread-55771::DEBUG::2014-05-16 18:17:47,324::task::579::TaskManager.Task::(_updateState) Task=`e239eb93-a314-4fbf-8197-29eab9e7c342`::moving from state init -> state preparing >Thread-55771::INFO::2014-05-16 18:17:47,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55771::INFO::2014-05-16 18:17:47,324::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000990516', 'lastCheck': '3.1', 'valid': True}} >Thread-55771::DEBUG::2014-05-16 18:17:47,325::task::1168::TaskManager.Task::(prepare) Task=`e239eb93-a314-4fbf-8197-29eab9e7c342`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000990516', 'lastCheck': '3.1', 'valid': True}} >Thread-55771::DEBUG::2014-05-16 18:17:47,325::task::579::TaskManager.Task::(_updateState) Task=`e239eb93-a314-4fbf-8197-29eab9e7c342`::moving from state preparing -> state finished >Thread-55771::DEBUG::2014-05-16 18:17:47,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55771::DEBUG::2014-05-16 18:17:47,325::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55771::DEBUG::2014-05-16 18:17:47,325::task::974::TaskManager.Task::(_decref) Task=`e239eb93-a314-4fbf-8197-29eab9e7c342`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:17:48,679::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:48,751::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353882 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55774::DEBUG::2014-05-16 18:17:50,602::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55774::DEBUG::2014-05-16 18:17:50,602::task::579::TaskManager.Task::(_updateState) Task=`9ce9fb22-d6fe-4b26-a10d-a19327cf4085`::moving from state init -> state preparing >Thread-55774::INFO::2014-05-16 18:17:50,602::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55774::INFO::2014-05-16 18:17:50,602::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55774::DEBUG::2014-05-16 18:17:50,603::task::1168::TaskManager.Task::(prepare) Task=`9ce9fb22-d6fe-4b26-a10d-a19327cf4085`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55774::DEBUG::2014-05-16 18:17:50,603::task::579::TaskManager.Task::(_updateState) Task=`9ce9fb22-d6fe-4b26-a10d-a19327cf4085`::moving from state preparing -> state finished >Thread-55774::DEBUG::2014-05-16 18:17:50,603::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55774::DEBUG::2014-05-16 18:17:50,603::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55774::DEBUG::2014-05-16 18:17:50,603::task::974::TaskManager.Task::(_decref) Task=`9ce9fb22-d6fe-4b26-a10d-a19327cf4085`::ref 0 aborting False >Thread-55775::DEBUG::2014-05-16 18:17:50,613::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55775::DEBUG::2014-05-16 18:17:50,613::task::579::TaskManager.Task::(_updateState) Task=`c9dd53a9-9375-4333-bb6e-d42f66555f22`::moving from state init -> state preparing >Thread-55775::INFO::2014-05-16 18:17:50,614::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55775::DEBUG::2014-05-16 18:17:50,614::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f0cd966e-1b4d-443a-8456-a12196a8467d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55775::DEBUG::2014-05-16 18:17:50,614::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55775::DEBUG::2014-05-16 18:17:50,614::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55775::DEBUG::2014-05-16 18:17:50,614::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f0cd966e-1b4d-443a-8456-a12196a8467d`::Granted request >Thread-55775::DEBUG::2014-05-16 18:17:50,615::task::811::TaskManager.Task::(resourceAcquired) Task=`c9dd53a9-9375-4333-bb6e-d42f66555f22`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55775::DEBUG::2014-05-16 18:17:50,615::task::974::TaskManager.Task::(_decref) Task=`c9dd53a9-9375-4333-bb6e-d42f66555f22`::ref 1 aborting False >Thread-55775::INFO::2014-05-16 18:17:50,615::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55775::DEBUG::2014-05-16 18:17:50,615::task::1168::TaskManager.Task::(prepare) Task=`c9dd53a9-9375-4333-bb6e-d42f66555f22`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55775::DEBUG::2014-05-16 18:17:50,616::task::579::TaskManager.Task::(_updateState) Task=`c9dd53a9-9375-4333-bb6e-d42f66555f22`::moving from state preparing -> state finished >Thread-55775::DEBUG::2014-05-16 18:17:50,616::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55775::DEBUG::2014-05-16 18:17:50,616::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55775::DEBUG::2014-05-16 18:17:50,616::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55775::DEBUG::2014-05-16 18:17:50,616::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55775::DEBUG::2014-05-16 18:17:50,616::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55775::DEBUG::2014-05-16 18:17:50,616::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55775::DEBUG::2014-05-16 18:17:50,617::task::974::TaskManager.Task::(_decref) Task=`c9dd53a9-9375-4333-bb6e-d42f66555f22`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:17:50,762::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:50,829::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301143 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:52,841::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:52,907::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304033 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:17:54,221::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:17:54,232::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00115916 s, 3.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:54,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:54,991::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356542 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:57,002::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:57,074::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356609 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:17:59,086::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:17:59,155::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311745 s, 32.8 MB/s\n'; <rc> = 0 >Thread-55779::DEBUG::2014-05-16 18:18:00,670::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55779::DEBUG::2014-05-16 18:18:00,670::task::579::TaskManager.Task::(_updateState) Task=`1207f166-525a-44a3-9729-6a275534c401`::moving from state init -> state preparing >Thread-55779::INFO::2014-05-16 18:18:00,671::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55779::INFO::2014-05-16 18:18:00,671::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55779::DEBUG::2014-05-16 18:18:00,671::task::1168::TaskManager.Task::(prepare) Task=`1207f166-525a-44a3-9729-6a275534c401`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55779::DEBUG::2014-05-16 18:18:00,671::task::579::TaskManager.Task::(_updateState) Task=`1207f166-525a-44a3-9729-6a275534c401`::moving from state preparing -> state finished >Thread-55779::DEBUG::2014-05-16 18:18:00,671::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55779::DEBUG::2014-05-16 18:18:00,671::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55779::DEBUG::2014-05-16 18:18:00,672::task::974::TaskManager.Task::(_decref) Task=`1207f166-525a-44a3-9729-6a275534c401`::ref 0 aborting False >Thread-55780::DEBUG::2014-05-16 18:18:00,725::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55780::DEBUG::2014-05-16 18:18:00,726::task::579::TaskManager.Task::(_updateState) Task=`b724594a-02a7-410c-a4b8-177849f3daf7`::moving from state init -> state preparing >Thread-55780::INFO::2014-05-16 18:18:00,726::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55780::DEBUG::2014-05-16 18:18:00,726::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a8abe630-a789-48c4-9e72-3f45c0d60c3b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55780::DEBUG::2014-05-16 18:18:00,726::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55780::DEBUG::2014-05-16 18:18:00,727::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55780::DEBUG::2014-05-16 18:18:00,727::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a8abe630-a789-48c4-9e72-3f45c0d60c3b`::Granted request >Thread-55780::DEBUG::2014-05-16 18:18:00,727::task::811::TaskManager.Task::(resourceAcquired) Task=`b724594a-02a7-410c-a4b8-177849f3daf7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55780::DEBUG::2014-05-16 18:18:00,727::task::974::TaskManager.Task::(_decref) Task=`b724594a-02a7-410c-a4b8-177849f3daf7`::ref 1 aborting False >Thread-55780::INFO::2014-05-16 18:18:00,728::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55780::DEBUG::2014-05-16 18:18:00,728::task::1168::TaskManager.Task::(prepare) Task=`b724594a-02a7-410c-a4b8-177849f3daf7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55780::DEBUG::2014-05-16 18:18:00,728::task::579::TaskManager.Task::(_updateState) Task=`b724594a-02a7-410c-a4b8-177849f3daf7`::moving from state preparing -> state finished >Thread-55780::DEBUG::2014-05-16 18:18:00,728::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55780::DEBUG::2014-05-16 18:18:00,728::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55780::DEBUG::2014-05-16 18:18:00,729::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55780::DEBUG::2014-05-16 18:18:00,729::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55780::DEBUG::2014-05-16 18:18:00,729::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55780::DEBUG::2014-05-16 18:18:00,729::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55780::DEBUG::2014-05-16 18:18:00,729::task::974::TaskManager.Task::(_decref) Task=`b724594a-02a7-410c-a4b8-177849f3daf7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:18:01,167::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:01,235::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312595 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:03,246::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:03,320::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353727 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55781::DEBUG::2014-05-16 18:18:03,622::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5415409.000000 / 8.008226 / 262500000.000000 = 0.257612 >Thread-55781::DEBUG::2014-05-16 18:18:03,622::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0080650405382518744, 'statsAge': 1.349761962890625, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25761173243018781, 'rxDropped': 0} >Thread-55781::DEBUG::2014-05-16 18:18:03,622::task::579::TaskManager.Task::(_updateState) Task=`d292451c-0849-4157-bb30-678f3907729c`::moving from state init -> state preparing >Thread-55781::INFO::2014-05-16 18:18:03,623::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55781::INFO::2014-05-16 18:18:03,623::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00115916', 'lastCheck': '9.4', 'valid': True}} >Thread-55781::DEBUG::2014-05-16 18:18:03,623::task::1168::TaskManager.Task::(prepare) Task=`d292451c-0849-4157-bb30-678f3907729c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00115916', 'lastCheck': '9.4', 'valid': True}} >Thread-55781::DEBUG::2014-05-16 18:18:03,623::task::579::TaskManager.Task::(_updateState) Task=`d292451c-0849-4157-bb30-678f3907729c`::moving from state preparing -> state finished >Thread-55781::DEBUG::2014-05-16 18:18:03,623::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55781::DEBUG::2014-05-16 18:18:03,623::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55781::DEBUG::2014-05-16 18:18:03,624::task::974::TaskManager.Task::(_decref) Task=`d292451c-0849-4157-bb30-678f3907729c`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:18:04,265::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:18:04,280::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000794031 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:05,331::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:05,404::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035104 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:07,416::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:07,483::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304222 s, 33.7 MB/s\n'; <rc> = 0 >Thread-55784::DEBUG::2014-05-16 18:18:09,088::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [4cde1be6] >Thread-55784::DEBUG::2014-05-16 18:18:09,089::task::579::TaskManager.Task::(_updateState) Task=`91e98032-f7d1-4d65-af6b-ac129521f761`::moving from state init -> state preparing >Thread-55784::INFO::2014-05-16 18:18:09,089::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55784::DEBUG::2014-05-16 18:18:09,090::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`64884290-d3a4-4f1a-ba59-626e2c1b4543`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55784::DEBUG::2014-05-16 18:18:09,090::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55784::DEBUG::2014-05-16 18:18:09,090::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55784::DEBUG::2014-05-16 18:18:09,090::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`64884290-d3a4-4f1a-ba59-626e2c1b4543`::Granted request >Thread-55784::DEBUG::2014-05-16 18:18:09,091::task::811::TaskManager.Task::(resourceAcquired) Task=`91e98032-f7d1-4d65-af6b-ac129521f761`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55784::DEBUG::2014-05-16 18:18:09,091::task::974::TaskManager.Task::(_decref) Task=`91e98032-f7d1-4d65-af6b-ac129521f761`::ref 1 aborting False >Thread-55784::INFO::2014-05-16 18:18:09,091::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55784::DEBUG::2014-05-16 18:18:09,092::task::1168::TaskManager.Task::(prepare) Task=`91e98032-f7d1-4d65-af6b-ac129521f761`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55784::DEBUG::2014-05-16 18:18:09,092::task::579::TaskManager.Task::(_updateState) Task=`91e98032-f7d1-4d65-af6b-ac129521f761`::moving from state preparing -> state finished >Thread-55784::DEBUG::2014-05-16 18:18:09,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55784::DEBUG::2014-05-16 18:18:09,092::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55784::DEBUG::2014-05-16 18:18:09,092::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55784::DEBUG::2014-05-16 18:18:09,093::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55784::DEBUG::2014-05-16 18:18:09,093::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55784::DEBUG::2014-05-16 18:18:09,093::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55784::DEBUG::2014-05-16 18:18:09,093::task::974::TaskManager.Task::(_decref) Task=`91e98032-f7d1-4d65-af6b-ac129521f761`::ref 0 aborting False >Thread-55785::DEBUG::2014-05-16 18:18:09,219::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmCreate with ({'custom': {'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6device_ca477d46-903a-4be4-aa25-3f5ec5981401device_ccc98468-6a20-48d5-adb7-90dfad130d0bdevice_f6a22d78-2d3c-495c-b433-2c05edbbcb70': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=f6a22d78-2d3c-495c-b433-2c05edbbcb70, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6device_ca477d46-903a-4be4-aa25-3f5ec5981401device_ccc98468-6a20-48d5-adb7-90dfad130d0b': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=ccc98468-6a20-48d5-adb7-90dfad130d0b, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6device_ca477d46-903a-4be4-aa25-3f5ec5981401': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=ca477d46-903a-4be4-aa25-3f5ec5981401, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=7040bb13-cf26-4c8a-843f-90f08aa31ee4, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=a26d8f98-60ff-49b5-9c62-21973b9a75c6, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}'}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'cpuType': 'Nehalem', 'vmId': '8fecb214-bbbf-4a4e-a147-6400b070a55f', 'devices': [{'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}}, 'readonly': 'true', 'deviceId': '85b2e6dc-5a63-4cee-b735-3a9191988be5', 'path': '', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': 'ebab2484-a019-4c69-bbd7-bb2182204677'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': '644b528f-42e5-4043-b24f-23f74baf7c06', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'volumeID': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 'specParams': {}, 'readonly': 'false', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'optional': 'false', 'deviceId': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '712869f4-1194-4008-9869-e48089d80f96'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'cc485581-f3c7-43ec-abc3-a7398f8c6f8a'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'f5b69b8b-1d8f-4616-af5c-f48f33bab82a'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'cf9c26ac-33f5-45bd-808b-67d6d6ad4446'}, {'specParams': {}, 'deviceId': 'f31e91e7-cc1b-45bd-943b-141b8611f9c3', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '2', 'vmType': 'kvm', 'smartcardEnable': 'true', 'timeOffset': '3600', 'memSize': 2048, 'spiceSslCipherSuite': 'DEFAULT', 'smpCoresPerSocket': '1', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'memGuaranteedSize': 1024, 'vmName': 'bob', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} flowID [4cde1be6] >Thread-55785::INFO::2014-05-16 18:18:09,230::API::648::vds::(_getNetworkIp) network None: using 0 >Thread-55785::INFO::2014-05-16 18:18:09,230::clientIF::394::vds::(createVm) vmContainerLock acquired by vm 8fecb214-bbbf-4a4e-a147-6400b070a55f >Thread-55785::DEBUG::2014-05-16 18:18:09,234::clientIF::407::vds::(createVm) Total desktops after creation of 8fecb214-bbbf-4a4e-a147-6400b070a55f is 1 >Thread-55786::DEBUG::2014-05-16 18:18:09,234::vm::2156::vm.Vm::(_startUnderlyingVm) vmId=`8fecb214-bbbf-4a4e-a147-6400b070a55f`::Start >Thread-55785::DEBUG::2014-05-16 18:18:09,235::BindingXMLRPC::982::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '8fecb214-bbbf-4a4e-a147-6400b070a55f', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6device_ca477d46-903a-4be4-aa25-3f5ec5981401device_ccc98468-6a20-48d5-adb7-90dfad130d0bdevice_f6a22d78-2d3c-495c-b433-2c05edbbcb70': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=f6a22d78-2d3c-495c-b433-2c05edbbcb70, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6device_ca477d46-903a-4be4-aa25-3f5ec5981401device_ccc98468-6a20-48d5-adb7-90dfad130d0b': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=ccc98468-6a20-48d5-adb7-90dfad130d0b, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6device_ca477d46-903a-4be4-aa25-3f5ec5981401': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=ca477d46-903a-4be4-aa25-3f5ec5981401, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=7040bb13-cf26-4c8a-843f-90f08aa31ee4, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=a26d8f98-60ff-49b5-9c62-21973b9a75c6, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}}, 'readonly': 'true', 'deviceId': '85b2e6dc-5a63-4cee-b735-3a9191988be5', 'path': '', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': 'ebab2484-a019-4c69-bbd7-bb2182204677'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': '644b528f-42e5-4043-b24f-23f74baf7c06', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'volumeID': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 'specParams': {}, 'readonly': 'false', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'optional': 'false', 'deviceId': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '712869f4-1194-4008-9869-e48089d80f96'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'cc485581-f3c7-43ec-abc3-a7398f8c6f8a'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'f5b69b8b-1d8f-4616-af5c-f48f33bab82a'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'cf9c26ac-33f5-45bd-808b-67d6d6ad4446'}, {'specParams': {}, 'deviceId': 'f31e91e7-cc1b-45bd-943b-141b8611f9c3', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'bob', 'display': 'qxl', 'nice': '0'}} >Thread-55786::DEBUG::2014-05-16 18:18:09,236::vm::2160::vm.Vm::(_startUnderlyingVm) vmId=`8fecb214-bbbf-4a4e-a147-6400b070a55f`::_ongoingCreations acquired >Thread-55786::INFO::2014-05-16 18:18:09,237::vm::3011::vm.Vm::(_run) vmId=`8fecb214-bbbf-4a4e-a147-6400b070a55f`::VM wrapper has started >Thread-55786::DEBUG::2014-05-16 18:18:09,239::task::579::TaskManager.Task::(_updateState) Task=`b99cf01d-cb8e-4241-a2a7-f138b17b09b2`::moving from state init -> state preparing >Thread-55786::INFO::2014-05-16 18:18:09,240::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='f26629d9-43c3-42cd-a3e6-93cb35cb35c7', volUUID='2b9374f4-1eca-47cb-a470-59600aae5d57', options=None) >Thread-55786::INFO::2014-05-16 18:18:09,242::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55786::DEBUG::2014-05-16 18:18:09,243::task::1168::TaskManager.Task::(prepare) Task=`b99cf01d-cb8e-4241-a2a7-f138b17b09b2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55786::DEBUG::2014-05-16 18:18:09,244::task::579::TaskManager.Task::(_updateState) Task=`b99cf01d-cb8e-4241-a2a7-f138b17b09b2`::moving from state preparing -> state finished >Thread-55786::DEBUG::2014-05-16 18:18:09,244::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55786::DEBUG::2014-05-16 18:18:09,245::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55786::DEBUG::2014-05-16 18:18:09,246::task::974::TaskManager.Task::(_decref) Task=`b99cf01d-cb8e-4241-a2a7-f138b17b09b2`::ref 0 aborting False >Thread-55786::INFO::2014-05-16 18:18:09,325::clientIF::353::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/8fecb214-bbbf-4a4e-a147-6400b070a55f.5956d5b3620f98211d0b1903abc90c25.img >Thread-55786::INFO::2014-05-16 18:18:09,326::clientIF::353::vds::(prepareVolumePath) prepared volume path: >Thread-55786::DEBUG::2014-05-16 18:18:09,326::task::579::TaskManager.Task::(_updateState) Task=`898fdb2d-dffe-432d-86e5-c2d0ccd83bf3`::moving from state init -> state preparing >Thread-55786::INFO::2014-05-16 18:18:09,327::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='f26629d9-43c3-42cd-a3e6-93cb35cb35c7', leafUUID='2b9374f4-1eca-47cb-a470-59600aae5d57') >Thread-55786::DEBUG::2014-05-16 18:18:09,327::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`d905e2dc-1ad5-462a-afc7-586861ecf4a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage' >Thread-55786::DEBUG::2014-05-16 18:18:09,327::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55786::DEBUG::2014-05-16 18:18:09,328::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55786::DEBUG::2014-05-16 18:18:09,328::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`d905e2dc-1ad5-462a-afc7-586861ecf4a8`::Granted request >Thread-55786::DEBUG::2014-05-16 18:18:09,329::task::811::TaskManager.Task::(resourceAcquired) Task=`898fdb2d-dffe-432d-86e5-c2d0ccd83bf3`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55786::DEBUG::2014-05-16 18:18:09,329::task::974::TaskManager.Task::(_decref) Task=`898fdb2d-dffe-432d-86e5-c2d0ccd83bf3`::ref 1 aborting False >Thread-55786::DEBUG::2014-05-16 18:18:09,329::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55786::DEBUG::2014-05-16 18:18:09,330::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:09,494::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55786::DEBUG::2014-05-16 18:18:09,539::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55786::DEBUG::2014-05-16 18:18:09,573::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55786::DEBUG::2014-05-16 18:18:09,574::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55786::DEBUG::2014-05-16 18:18:09,581::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca f79908bf-a757-4a71-9ab5-3a12ede5f65c/2b9374f4-1eca-47cb-a470-59600aae5d57' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:09,626::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0940873 s, 10.9 MB/s\n'; <rc> = 0 >Thread-55786::DEBUG::2014-05-16 18:18:09,790::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55786::DEBUG::2014-05-16 18:18:09,790::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55786::DEBUG::2014-05-16 18:18:09,790::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55786::DEBUG::2014-05-16 18:18:09,792::blockSD::1039::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7 >Thread-55786::DEBUG::2014-05-16 18:18:09,792::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55786::DEBUG::2014-05-16 18:18:09,793::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55786::DEBUG::2014-05-16 18:18:09,937::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55786::DEBUG::2014-05-16 18:18:09,951::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55786::DEBUG::2014-05-16 18:18:09,951::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55786::INFO::2014-05-16 18:18:09,952::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57', 'volumeID': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7'}, 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57', 'imgVolumesInfo': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57', 'volumeID': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7'}]} >Thread-55786::DEBUG::2014-05-16 18:18:09,952::task::1168::TaskManager.Task::(prepare) Task=`898fdb2d-dffe-432d-86e5-c2d0ccd83bf3`::finished: {'info': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57', 'volumeID': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7'}, 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57', 'imgVolumesInfo': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57', 'volumeID': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7'}]} >Thread-55786::DEBUG::2014-05-16 18:18:09,953::task::579::TaskManager.Task::(_updateState) Task=`898fdb2d-dffe-432d-86e5-c2d0ccd83bf3`::moving from state preparing -> state finished >Thread-55786::DEBUG::2014-05-16 18:18:09,953::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55786::DEBUG::2014-05-16 18:18:09,953::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55786::DEBUG::2014-05-16 18:18:09,953::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55786::DEBUG::2014-05-16 18:18:09,954::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55786::DEBUG::2014-05-16 18:18:09,954::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55786::DEBUG::2014-05-16 18:18:09,954::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55786::DEBUG::2014-05-16 18:18:09,954::task::974::TaskManager.Task::(_decref) Task=`898fdb2d-dffe-432d-86e5-c2d0ccd83bf3`::ref 0 aborting False >Thread-55786::INFO::2014-05-16 18:18:09,954::clientIF::353::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57 >Thread-55786::DEBUG::2014-05-16 18:18:09,974::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-55786::DEBUG::2014-05-16 18:18:10,053::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55786::INFO::2014-05-16 18:18:10,053::hooks::100::root::(_runHooksDir) >Thread-55786::DEBUG::2014-05-16 18:18:10,053::vm::3073::vm.Vm::(_run) vmId=`8fecb214-bbbf-4a4e-a147-6400b070a55f`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>bob</name> > <uuid>8fecb214-bbbf-4a4e-a147-6400b070a55f</uuid> > <memory>2097152</memory> > <currentMemory>2097152</currentMemory> > <vcpu>2</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/8fecb214-bbbf-4a4e-a147-6400b070a55f.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/8fecb214-bbbf-4a4e-a147-6400b070a55f.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <smartcard mode="passthrough" type="spicevmc"/> > <smartcard mode="passthrough" type="spicevmc"/> > <smartcard mode="passthrough" type="spicevmc"/> > <controller model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" type="qxl" vram="32768"/> > </video> > <disk device="floppy" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/8fecb214-bbbf-4a4e-a147-6400b070a55f.5956d5b3620f98211d0b1903abc90c25.img" startupPolicy="optional"/> > <target bus="fdc" dev="fda"/> > <readonly/> > <serial/> > <readonly/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57"/> > <target bus="virtio" dev="vda"/> > <serial>f26629d9-43c3-42cd-a3e6-93cb35cb35c7</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > <memballoon model="virtio"/> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140407.0.el6ev</entry> > <entry name="serial">44454C4C-3500-1054-8036-C6C04F5A5131</entry> > <entry name="uuid">8fecb214-bbbf-4a4e-a147-6400b070a55f</entry> > </system> > </sysinfo> > <clock adjustment="3600" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Nehalem</model> > <topology cores="1" sockets="2" threads="1"/> > </cpu> ></domain> > >Thread-55786::DEBUG::2014-05-16 18:18:10,150::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 67 edom: 10 level: 2 message: unsupported configuration: this QEMU binary lacks multiple smartcard support >Thread-55786::DEBUG::2014-05-16 18:18:10,151::vm::2177::vm.Vm::(_startUnderlyingVm) vmId=`8fecb214-bbbf-4a4e-a147-6400b070a55f`::_ongoingCreations released >Thread-55786::ERROR::2014-05-16 18:18:10,151::vm::2203::vm.Vm::(_startUnderlyingVm) vmId=`8fecb214-bbbf-4a4e-a147-6400b070a55f`::The vm start process failed >Traceback (most recent call last): > File "/usr/share/vdsm/vm.py", line 2163, in _startUnderlyingVm > File "/usr/share/vdsm/vm.py", line 3107, in _run > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 2665, in createXML >libvirtError: unsupported configuration: this QEMU binary lacks multiple smartcard support >Thread-55786::DEBUG::2014-05-16 18:18:10,156::vm::2657::vm.Vm::(setDownStatus) vmId=`8fecb214-bbbf-4a4e-a147-6400b070a55f`::Changed state to Down: unsupported configuration: this QEMU binary lacks multiple smartcard support >Thread-55789::DEBUG::2014-05-16 18:18:10,763::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55789::DEBUG::2014-05-16 18:18:10,763::task::579::TaskManager.Task::(_updateState) Task=`6b9e1a3d-e1bb-4766-952f-8b5e16473aec`::moving from state init -> state preparing >Thread-55789::INFO::2014-05-16 18:18:10,763::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55789::INFO::2014-05-16 18:18:10,764::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55789::DEBUG::2014-05-16 18:18:10,764::task::1168::TaskManager.Task::(prepare) Task=`6b9e1a3d-e1bb-4766-952f-8b5e16473aec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55789::DEBUG::2014-05-16 18:18:10,764::task::579::TaskManager.Task::(_updateState) Task=`6b9e1a3d-e1bb-4766-952f-8b5e16473aec`::moving from state preparing -> state finished >Thread-55789::DEBUG::2014-05-16 18:18:10,764::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55789::DEBUG::2014-05-16 18:18:10,764::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55789::DEBUG::2014-05-16 18:18:10,764::task::974::TaskManager.Task::(_decref) Task=`6b9e1a3d-e1bb-4766-952f-8b5e16473aec`::ref 0 aborting False >Thread-55790::DEBUG::2014-05-16 18:18:10,798::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55790::DEBUG::2014-05-16 18:18:10,798::task::579::TaskManager.Task::(_updateState) Task=`29c65b95-8b57-4da6-97d5-cadda960d447`::moving from state init -> state preparing >Thread-55790::INFO::2014-05-16 18:18:10,798::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55790::DEBUG::2014-05-16 18:18:10,798::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a7f193ed-6b8a-4155-8e16-22ee9959f0c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55790::DEBUG::2014-05-16 18:18:10,799::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55790::DEBUG::2014-05-16 18:18:10,799::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55790::DEBUG::2014-05-16 18:18:10,799::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a7f193ed-6b8a-4155-8e16-22ee9959f0c9`::Granted request >Thread-55790::DEBUG::2014-05-16 18:18:10,799::task::811::TaskManager.Task::(resourceAcquired) Task=`29c65b95-8b57-4da6-97d5-cadda960d447`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55790::DEBUG::2014-05-16 18:18:10,799::task::974::TaskManager.Task::(_decref) Task=`29c65b95-8b57-4da6-97d5-cadda960d447`::ref 1 aborting False >Thread-55790::INFO::2014-05-16 18:18:10,800::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55790::DEBUG::2014-05-16 18:18:10,800::task::1168::TaskManager.Task::(prepare) Task=`29c65b95-8b57-4da6-97d5-cadda960d447`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55790::DEBUG::2014-05-16 18:18:10,800::task::579::TaskManager.Task::(_updateState) Task=`29c65b95-8b57-4da6-97d5-cadda960d447`::moving from state preparing -> state finished >Thread-55790::DEBUG::2014-05-16 18:18:10,800::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55790::DEBUG::2014-05-16 18:18:10,800::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55790::DEBUG::2014-05-16 18:18:10,801::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55790::DEBUG::2014-05-16 18:18:10,801::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55790::DEBUG::2014-05-16 18:18:10,801::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55790::DEBUG::2014-05-16 18:18:10,801::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55790::DEBUG::2014-05-16 18:18:10,801::task::974::TaskManager.Task::(_decref) Task=`29c65b95-8b57-4da6-97d5-cadda960d447`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:18:11,638::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:11,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308286 s, 33.2 MB/s\n'; <rc> = 0 >Thread-55792::DEBUG::2014-05-16 18:18:12,801::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('8fecb214-bbbf-4a4e-a147-6400b070a55f',) {} >Thread-55792::DEBUG::2014-05-16 18:18:12,802::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Down', 'hash': '0', 'exitMessage': 'unsupported configuration: this QEMU binary lacks multiple smartcard support', 'vmId': '8fecb214-bbbf-4a4e-a147-6400b070a55f', 'timeOffset': '3600', 'exitCode': 1}]} >Thread-55793::DEBUG::2014-05-16 18:18:12,816::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmDestroy with ('8fecb214-bbbf-4a4e-a147-6400b070a55f',) {} >Thread-55793::INFO::2014-05-16 18:18:12,816::API::324::vds::(destroy) vmContainerLock acquired by vm 8fecb214-bbbf-4a4e-a147-6400b070a55f >Thread-55793::DEBUG::2014-05-16 18:18:12,816::vm::4533::vm.Vm::(destroy) vmId=`8fecb214-bbbf-4a4e-a147-6400b070a55f`::destroy Called >Thread-55793::INFO::2014-05-16 18:18:12,827::vm::4479::vm.Vm::(releaseVm) vmId=`8fecb214-bbbf-4a4e-a147-6400b070a55f`::Release VM resources >Thread-55793::WARNING::2014-05-16 18:18:12,827::vm::1851::vm.Vm::(_set_lastStatus) vmId=`8fecb214-bbbf-4a4e-a147-6400b070a55f`::trying to set state to Powering down when already Down >Thread-55793::WARNING::2014-05-16 18:18:12,827::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7ff5344684d0>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7ff5344684d0>> _deviceXML:<disk device="floppy" snapshot="no" type="file"><source file="/var/run/vdsm/payload/8fecb214-bbbf-4a4e-a147-6400b070a55f.5956d5b3620f98211d0b1903abc90c25.img" startupPolicy="optional"/><target bus="fdc" dev="fda"/><readonly/><serial></serial><readonly/></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7ff5344684d0>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7ff5344684d0>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7ff5344684d0>> apparentsize:0 blockDev:False cache:none conf:{'status': 'Down', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '8fecb214-bbbf-4a4e-a147-6400b070a55f', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6device_ca477d46-903a-4be4-aa25-3f5ec5981401device_ccc98468-6a20-48d5-adb7-90dfad130d0bdevice_f6a22d78-2d3c-495c-b433-2c05edbbcb70': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=f6a22d78-2d3c-495c-b433-2c05edbbcb70, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6device_ca477d46-903a-4be4-aa25-3f5ec5981401device_ccc98468-6a20-48d5-adb7-90dfad130d0b': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=ccc98468-6a20-48d5-adb7-90dfad130d0b, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6device_ca477d46-903a-4be4-aa25-3f5ec5981401': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=ca477d46-903a-4be4-aa25-3f5ec5981401, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=7040bb13-cf26-4c8a-843f-90f08aa31ee4, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=a26d8f98-60ff-49b5-9c62-21973b9a75c6, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'exitCode': 1, 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'exitMessage': 'unsupported configuration: this QEMU binary lacks multiple smartcard support', 'transparentHugePages': 'true', 'devices': [{'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '712869f4-1194-4008-9869-e48089d80f96'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'cc485581-f3c7-43ec-abc3-a7398f8c6f8a'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'f5b69b8b-1d8f-4616-af5c-f48f33bab82a'}, {'specParams': {}, 'deviceId': 'f31e91e7-cc1b-45bd-943b-141b8611f9c3', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': 'ebab2484-a019-4c69-bbd7-bb2182204677'}, {'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}}, 'readonly': 'true', 'deviceId': '85b2e6dc-5a63-4cee-b735-3a9191988be5', 'path': '/var/run/vdsm/payload/8fecb214-bbbf-4a4e-a147-6400b070a55f.5956d5b3620f98211d0b1903abc90c25.img', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': '644b528f-42e5-4043-b24f-23f74baf7c06', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'volumeInfo': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57', 'volumeID': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 'readonly': 'false', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'reqsize': '0', 'format': 'cow', 'deviceId': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57', 'propagateErrors': 'off', 'optional': 'false', 'bootOrder': '1', 'volumeID': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'specParams': {}, 'volumeChain': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57', 'volumeID': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7'}]}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'cf9c26ac-33f5-45bd-808b-67d6d6ad4446', 'target': 2097152}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'bob', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7ff5344684d0>> device:floppy deviceId:85b2e6dc-5a63-4cee-b735-3a9191988be5 extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7ff5344684d0>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7ff5344684d0>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7ff5344684d0>> hasVolumeLeases:False iface:fdc index:0 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7ff5344684d0>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7ff5344684d0>> log:<logUtils.SimpleLogAdapter instance at 0x7ff5501013b0> name:fda networkDev:False path:/var/run/vdsm/payload/8fecb214-bbbf-4a4e-a147-6400b070a55f.5956d5b3620f98211d0b1903abc90c25.img readonly:true reqsize:0 serial: shared:false specParams:{'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}} transientDisk:False truesize:0 type:disk volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath > File "/usr/share/vdsm/vm.py", line 1431, in __getitem__ >KeyError: 'domainID' >Thread-55793::WARNING::2014-05-16 18:18:12,829::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7ff53805b150>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7ff53805b150>> _deviceXML:<disk device="cdrom" snapshot="no" type="file"><address bus="1" controller="0" target="0" type="drive" unit="0"/><source file="" startupPolicy="optional"/><target bus="ide" dev="hdc"/><readonly/><serial></serial></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7ff53805b150>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7ff53805b150>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7ff53805b150>> address:{' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'} apparentsize:0 blockDev:False cache:none conf:{'status': 'Down', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '8fecb214-bbbf-4a4e-a147-6400b070a55f', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6device_ca477d46-903a-4be4-aa25-3f5ec5981401device_ccc98468-6a20-48d5-adb7-90dfad130d0bdevice_f6a22d78-2d3c-495c-b433-2c05edbbcb70': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=f6a22d78-2d3c-495c-b433-2c05edbbcb70, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6device_ca477d46-903a-4be4-aa25-3f5ec5981401device_ccc98468-6a20-48d5-adb7-90dfad130d0b': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=ccc98468-6a20-48d5-adb7-90dfad130d0b, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6device_ca477d46-903a-4be4-aa25-3f5ec5981401': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=ca477d46-903a-4be4-aa25-3f5ec5981401, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=7040bb13-cf26-4c8a-843f-90f08aa31ee4, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_7040bb13-cf26-4c8a-843f-90f08aa31ee4device_a26d8f98-60ff-49b5-9c62-21973b9a75c6': 'VmDevice {vmId=8fecb214-bbbf-4a4e-a147-6400b070a55f, deviceId=a26d8f98-60ff-49b5-9c62-21973b9a75c6, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'exitCode': 1, 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'exitMessage': 'unsupported configuration: this QEMU binary lacks multiple smartcard support', 'transparentHugePages': 'true', 'devices': [{'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '712869f4-1194-4008-9869-e48089d80f96'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'cc485581-f3c7-43ec-abc3-a7398f8c6f8a'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': 'f5b69b8b-1d8f-4616-af5c-f48f33bab82a'}, {'specParams': {}, 'deviceId': 'f31e91e7-cc1b-45bd-943b-141b8611f9c3', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': 'ebab2484-a019-4c69-bbd7-bb2182204677'}, {'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}}, 'readonly': 'true', 'deviceId': '85b2e6dc-5a63-4cee-b735-3a9191988be5', 'path': '/var/run/vdsm/payload/8fecb214-bbbf-4a4e-a147-6400b070a55f.5956d5b3620f98211d0b1903abc90c25.img', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': '644b528f-42e5-4043-b24f-23f74baf7c06', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'volumeInfo': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57', 'volumeID': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 'readonly': 'false', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'reqsize': '0', 'format': 'cow', 'deviceId': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57', 'propagateErrors': 'off', 'optional': 'false', 'bootOrder': '1', 'volumeID': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'specParams': {}, 'volumeChain': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57', 'volumeID': '2b9374f4-1eca-47cb-a470-59600aae5d57', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'f26629d9-43c3-42cd-a3e6-93cb35cb35c7'}]}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'cf9c26ac-33f5-45bd-808b-67d6d6ad4446', 'target': 2097152}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'bob', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7ff53805b150>> device:cdrom deviceId:644b528f-42e5-4043-b24f-23f74baf7c06 extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7ff53805b150>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7ff53805b150>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7ff53805b150>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7ff53805b150>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7ff53805b150>> log:<logUtils.SimpleLogAdapter instance at 0x7ff5501013b0> name:hdc networkDev:False path: readonly:true reqsize:0 serial: shared:false specParams:{'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'} transientDisk:False truesize:0 type:disk volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath > File "/usr/share/vdsm/vm.py", line 1431, in __getitem__ >KeyError: 'domainID' >Thread-55793::DEBUG::2014-05-16 18:18:12,831::task::579::TaskManager.Task::(_updateState) Task=`1a6bc72c-b323-481f-8a44-c2fc98ae20d7`::moving from state init -> state preparing >Thread-55793::INFO::2014-05-16 18:18:12,831::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='f26629d9-43c3-42cd-a3e6-93cb35cb35c7', volUUID=None) >Thread-55793::DEBUG::2014-05-16 18:18:12,832::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`a1285a80-f5ba-44f8-a9ed-232efd05e9cf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'teardownImage' >Thread-55793::DEBUG::2014-05-16 18:18:12,832::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55793::DEBUG::2014-05-16 18:18:12,832::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55793::DEBUG::2014-05-16 18:18:12,832::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`a1285a80-f5ba-44f8-a9ed-232efd05e9cf`::Granted request >Thread-55793::DEBUG::2014-05-16 18:18:12,833::task::811::TaskManager.Task::(resourceAcquired) Task=`1a6bc72c-b323-481f-8a44-c2fc98ae20d7`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55793::DEBUG::2014-05-16 18:18:12,833::task::974::TaskManager.Task::(_decref) Task=`1a6bc72c-b323-481f-8a44-c2fc98ae20d7`::ref 1 aborting False >Thread-55793::DEBUG::2014-05-16 18:18:12,833::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55793::DEBUG::2014-05-16 18:18:12,834::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55793::DEBUG::2014-05-16 18:18:12,982::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55793::DEBUG::2014-05-16 18:18:13,000::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55793::DEBUG::2014-05-16 18:18:13,000::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55793::DEBUG::2014-05-16 18:18:13,001::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/2b9374f4-1eca-47cb-a470-59600aae5d57' (cwd None) >Thread-55793::DEBUG::2014-05-16 18:18:13,163::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55793::DEBUG::2014-05-16 18:18:13,163::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55793::DEBUG::2014-05-16 18:18:13,164::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55793::INFO::2014-05-16 18:18:13,164::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-55793::DEBUG::2014-05-16 18:18:13,164::task::1168::TaskManager.Task::(prepare) Task=`1a6bc72c-b323-481f-8a44-c2fc98ae20d7`::finished: None >Thread-55793::DEBUG::2014-05-16 18:18:13,164::task::579::TaskManager.Task::(_updateState) Task=`1a6bc72c-b323-481f-8a44-c2fc98ae20d7`::moving from state preparing -> state finished >Thread-55793::DEBUG::2014-05-16 18:18:13,165::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55793::DEBUG::2014-05-16 18:18:13,165::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55793::DEBUG::2014-05-16 18:18:13,165::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55793::DEBUG::2014-05-16 18:18:13,165::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55793::DEBUG::2014-05-16 18:18:13,166::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55793::DEBUG::2014-05-16 18:18:13,166::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55793::DEBUG::2014-05-16 18:18:13,166::task::974::TaskManager.Task::(_decref) Task=`1a6bc72c-b323-481f-8a44-c2fc98ae20d7`::ref 0 aborting False >Thread-55793::WARNING::2014-05-16 18:18:13,167::utils::114::root::(rmFile) File: /var/lib/libvirt/qemu/channels/8fecb214-bbbf-4a4e-a147-6400b070a55f.com.redhat.rhevm.vdsm already removed >Thread-55793::WARNING::2014-05-16 18:18:13,167::utils::114::root::(rmFile) File: /var/lib/libvirt/qemu/channels/8fecb214-bbbf-4a4e-a147-6400b070a55f.org.qemu.guest_agent.0 already removed >Thread-55793::DEBUG::2014-05-16 18:18:13,168::task::579::TaskManager.Task::(_updateState) Task=`683c23fc-ef9b-4c4b-b5fd-510765c58145`::moving from state init -> state preparing >Thread-55793::INFO::2014-05-16 18:18:13,168::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='8fecb214-bbbf-4a4e-a147-6400b070a55f') >Thread-55793::INFO::2014-05-16 18:18:13,170::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-55793::DEBUG::2014-05-16 18:18:13,170::task::1168::TaskManager.Task::(prepare) Task=`683c23fc-ef9b-4c4b-b5fd-510765c58145`::finished: None >Thread-55793::DEBUG::2014-05-16 18:18:13,170::task::579::TaskManager.Task::(_updateState) Task=`683c23fc-ef9b-4c4b-b5fd-510765c58145`::moving from state preparing -> state finished >Thread-55793::DEBUG::2014-05-16 18:18:13,170::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55793::DEBUG::2014-05-16 18:18:13,170::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55793::DEBUG::2014-05-16 18:18:13,171::task::974::TaskManager.Task::(_decref) Task=`683c23fc-ef9b-4c4b-b5fd-510765c58145`::ref 0 aborting False >Thread-55793::DEBUG::2014-05-16 18:18:13,171::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd' (cwd None) >Thread-55793::DEBUG::2014-05-16 18:18:13,439::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55793::INFO::2014-05-16 18:18:13,440::hooks::100::root::(_runHooksDir) >Thread-55793::DEBUG::2014-05-16 18:18:13,441::vm::4527::vm.Vm::(deleteVm) vmId=`8fecb214-bbbf-4a4e-a147-6400b070a55f`::Total desktops after destroy of 8fecb214-bbbf-4a4e-a147-6400b070a55f is 0 >Thread-55793::DEBUG::2014-05-16 18:18:13,441::BindingXMLRPC::982::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >Dummy-51::DEBUG::2014-05-16 18:18:13,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:13,788::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351897 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:18:14,317::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:18:14,327::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685426 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:15,800::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:15,873::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355358 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:17,885::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:17,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351817 s, 29.1 MB/s\n'; <rc> = 0 >Thread-55797::DEBUG::2014-05-16 18:18:19,649::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3884184.000000 / 8.009397 / 262500000.000000 = 0.184744 >Thread-55797::DEBUG::2014-05-16 18:18:19,649::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0062580776535933738, 'statsAge': 1.3542859554290771, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.18474413708517581, 'rxDropped': 0} >Thread-55797::DEBUG::2014-05-16 18:18:19,650::task::579::TaskManager.Task::(_updateState) Task=`7bb820de-5ef6-4a1b-8f4c-d27896e09e0b`::moving from state init -> state preparing >Thread-55797::INFO::2014-05-16 18:18:19,650::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55797::INFO::2014-05-16 18:18:19,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685426', 'lastCheck': '5.3', 'valid': True}} >Thread-55797::DEBUG::2014-05-16 18:18:19,650::task::1168::TaskManager.Task::(prepare) Task=`7bb820de-5ef6-4a1b-8f4c-d27896e09e0b`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685426', 'lastCheck': '5.3', 'valid': True}} >Thread-55797::DEBUG::2014-05-16 18:18:19,651::task::579::TaskManager.Task::(_updateState) Task=`7bb820de-5ef6-4a1b-8f4c-d27896e09e0b`::moving from state preparing -> state finished >Thread-55797::DEBUG::2014-05-16 18:18:19,651::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55797::DEBUG::2014-05-16 18:18:19,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55797::DEBUG::2014-05-16 18:18:19,651::task::974::TaskManager.Task::(_decref) Task=`7bb820de-5ef6-4a1b-8f4c-d27896e09e0b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:18:19,968::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:20,195::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033437 s, 30.6 MB/s\n'; <rc> = 0 >Thread-55799::DEBUG::2014-05-16 18:18:20,851::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55799::DEBUG::2014-05-16 18:18:20,852::task::579::TaskManager.Task::(_updateState) Task=`bc285260-22a7-40d4-8948-fadcf0cf565d`::moving from state init -> state preparing >Thread-55799::INFO::2014-05-16 18:18:20,852::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55799::INFO::2014-05-16 18:18:20,852::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55799::DEBUG::2014-05-16 18:18:20,852::task::1168::TaskManager.Task::(prepare) Task=`bc285260-22a7-40d4-8948-fadcf0cf565d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55799::DEBUG::2014-05-16 18:18:20,852::task::579::TaskManager.Task::(_updateState) Task=`bc285260-22a7-40d4-8948-fadcf0cf565d`::moving from state preparing -> state finished >Thread-55799::DEBUG::2014-05-16 18:18:20,853::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55799::DEBUG::2014-05-16 18:18:20,853::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55799::DEBUG::2014-05-16 18:18:20,853::task::974::TaskManager.Task::(_decref) Task=`bc285260-22a7-40d4-8948-fadcf0cf565d`::ref 0 aborting False >Thread-55800::DEBUG::2014-05-16 18:18:20,864::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55800::DEBUG::2014-05-16 18:18:20,864::task::579::TaskManager.Task::(_updateState) Task=`850671ad-2f90-4b21-9849-669548c13def`::moving from state init -> state preparing >Thread-55800::INFO::2014-05-16 18:18:20,864::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55800::DEBUG::2014-05-16 18:18:20,865::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`93bedbfe-c283-4121-aeb7-4f142d0e1a3a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55800::DEBUG::2014-05-16 18:18:20,865::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55800::DEBUG::2014-05-16 18:18:20,865::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55800::DEBUG::2014-05-16 18:18:20,865::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`93bedbfe-c283-4121-aeb7-4f142d0e1a3a`::Granted request >Thread-55800::DEBUG::2014-05-16 18:18:20,866::task::811::TaskManager.Task::(resourceAcquired) Task=`850671ad-2f90-4b21-9849-669548c13def`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55800::DEBUG::2014-05-16 18:18:20,866::task::974::TaskManager.Task::(_decref) Task=`850671ad-2f90-4b21-9849-669548c13def`::ref 1 aborting False >Thread-55800::INFO::2014-05-16 18:18:20,866::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55800::DEBUG::2014-05-16 18:18:20,867::task::1168::TaskManager.Task::(prepare) Task=`850671ad-2f90-4b21-9849-669548c13def`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55800::DEBUG::2014-05-16 18:18:20,867::task::579::TaskManager.Task::(_updateState) Task=`850671ad-2f90-4b21-9849-669548c13def`::moving from state preparing -> state finished >Thread-55800::DEBUG::2014-05-16 18:18:20,867::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55800::DEBUG::2014-05-16 18:18:20,867::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55800::DEBUG::2014-05-16 18:18:20,867::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55800::DEBUG::2014-05-16 18:18:20,868::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55800::DEBUG::2014-05-16 18:18:20,868::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55800::DEBUG::2014-05-16 18:18:20,868::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55800::DEBUG::2014-05-16 18:18:20,868::task::974::TaskManager.Task::(_decref) Task=`850671ad-2f90-4b21-9849-669548c13def`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:18:22,208::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:22,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308831 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:24,286::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:24,450::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360928 s, 28.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:18:24,465::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:18:24,487::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700679 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:26,580::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:26,647::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310285 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:28,658::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:28,725::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313883 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:30,737::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:30,809::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351632 s, 29.1 MB/s\n'; <rc> = 0 >Thread-55804::DEBUG::2014-05-16 18:18:30,928::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55804::DEBUG::2014-05-16 18:18:30,928::task::579::TaskManager.Task::(_updateState) Task=`2299487d-477c-4aa5-875e-a695e3d69362`::moving from state init -> state preparing >Thread-55804::INFO::2014-05-16 18:18:30,929::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55804::INFO::2014-05-16 18:18:30,929::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55804::DEBUG::2014-05-16 18:18:30,929::task::1168::TaskManager.Task::(prepare) Task=`2299487d-477c-4aa5-875e-a695e3d69362`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55804::DEBUG::2014-05-16 18:18:30,929::task::579::TaskManager.Task::(_updateState) Task=`2299487d-477c-4aa5-875e-a695e3d69362`::moving from state preparing -> state finished >Thread-55804::DEBUG::2014-05-16 18:18:30,930::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55804::DEBUG::2014-05-16 18:18:30,930::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55804::DEBUG::2014-05-16 18:18:30,930::task::974::TaskManager.Task::(_decref) Task=`2299487d-477c-4aa5-875e-a695e3d69362`::ref 0 aborting False >Thread-55805::DEBUG::2014-05-16 18:18:30,939::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55805::DEBUG::2014-05-16 18:18:30,939::task::579::TaskManager.Task::(_updateState) Task=`f80d288b-4a3c-44cd-aaed-2041681e5b45`::moving from state init -> state preparing >Thread-55805::INFO::2014-05-16 18:18:30,939::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55805::DEBUG::2014-05-16 18:18:30,940::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e83c341b-6c14-4edd-8536-dc9998306f1e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55805::DEBUG::2014-05-16 18:18:30,940::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55805::DEBUG::2014-05-16 18:18:30,940::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55805::DEBUG::2014-05-16 18:18:30,940::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e83c341b-6c14-4edd-8536-dc9998306f1e`::Granted request >Thread-55805::DEBUG::2014-05-16 18:18:30,941::task::811::TaskManager.Task::(resourceAcquired) Task=`f80d288b-4a3c-44cd-aaed-2041681e5b45`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55805::DEBUG::2014-05-16 18:18:30,941::task::974::TaskManager.Task::(_decref) Task=`f80d288b-4a3c-44cd-aaed-2041681e5b45`::ref 1 aborting False >Thread-55805::INFO::2014-05-16 18:18:30,941::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55805::DEBUG::2014-05-16 18:18:30,942::task::1168::TaskManager.Task::(prepare) Task=`f80d288b-4a3c-44cd-aaed-2041681e5b45`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55805::DEBUG::2014-05-16 18:18:30,942::task::579::TaskManager.Task::(_updateState) Task=`f80d288b-4a3c-44cd-aaed-2041681e5b45`::moving from state preparing -> state finished >Thread-55805::DEBUG::2014-05-16 18:18:30,942::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55805::DEBUG::2014-05-16 18:18:30,942::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55805::DEBUG::2014-05-16 18:18:30,942::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55805::DEBUG::2014-05-16 18:18:30,943::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55805::DEBUG::2014-05-16 18:18:30,943::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55805::DEBUG::2014-05-16 18:18:30,943::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55805::DEBUG::2014-05-16 18:18:30,943::task::974::TaskManager.Task::(_decref) Task=`f80d288b-4a3c-44cd-aaed-2041681e5b45`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:18:32,820::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:32,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352555 s, 29.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:18:34,590::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:18:34,601::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110067 s, 3.7 MB/s\n'; <rc> = 0 >Thread-55807::DEBUG::2014-05-16 18:18:34,885::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4311159.000000 / 8.008341 / 262500000.000000 = 0.205079 >Thread-55807::DEBUG::2014-05-16 18:18:34,885::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053732548033719749, 'statsAge': 0.5719749927520752, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20507946284261414, 'rxDropped': 0} >Thread-55807::DEBUG::2014-05-16 18:18:34,885::task::579::TaskManager.Task::(_updateState) Task=`6deb18f0-d13e-47b1-bc29-948151dcc827`::moving from state init -> state preparing >Thread-55807::INFO::2014-05-16 18:18:34,885::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55807::INFO::2014-05-16 18:18:34,886::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110067', 'lastCheck': '0.3', 'valid': True}} >Thread-55807::DEBUG::2014-05-16 18:18:34,886::task::1168::TaskManager.Task::(prepare) Task=`6deb18f0-d13e-47b1-bc29-948151dcc827`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110067', 'lastCheck': '0.3', 'valid': True}} >Thread-55807::DEBUG::2014-05-16 18:18:34,886::task::579::TaskManager.Task::(_updateState) Task=`6deb18f0-d13e-47b1-bc29-948151dcc827`::moving from state preparing -> state finished >Thread-55807::DEBUG::2014-05-16 18:18:34,886::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55807::DEBUG::2014-05-16 18:18:34,886::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55807::DEBUG::2014-05-16 18:18:34,886::task::974::TaskManager.Task::(_decref) Task=`6deb18f0-d13e-47b1-bc29-948151dcc827`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:18:34,903::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:34,974::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352785 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:36,986::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:37,058::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355311 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:39,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:39,137::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030391 s, 33.7 MB/s\n'; <rc> = 0 >Thread-55810::DEBUG::2014-05-16 18:18:40,973::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55810::DEBUG::2014-05-16 18:18:40,973::task::579::TaskManager.Task::(_updateState) Task=`336d21f5-136c-4f6f-a046-4387682891dc`::moving from state init -> state preparing >Thread-55810::INFO::2014-05-16 18:18:40,974::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55810::INFO::2014-05-16 18:18:40,974::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55810::DEBUG::2014-05-16 18:18:40,974::task::1168::TaskManager.Task::(prepare) Task=`336d21f5-136c-4f6f-a046-4387682891dc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55810::DEBUG::2014-05-16 18:18:40,974::task::579::TaskManager.Task::(_updateState) Task=`336d21f5-136c-4f6f-a046-4387682891dc`::moving from state preparing -> state finished >Thread-55810::DEBUG::2014-05-16 18:18:40,974::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55810::DEBUG::2014-05-16 18:18:40,974::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55810::DEBUG::2014-05-16 18:18:40,974::task::974::TaskManager.Task::(_decref) Task=`336d21f5-136c-4f6f-a046-4387682891dc`::ref 0 aborting False >Thread-55811::DEBUG::2014-05-16 18:18:40,982::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55811::DEBUG::2014-05-16 18:18:40,983::task::579::TaskManager.Task::(_updateState) Task=`1903dd26-4d1f-4b42-a72a-758862910079`::moving from state init -> state preparing >Thread-55811::INFO::2014-05-16 18:18:40,983::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55811::DEBUG::2014-05-16 18:18:40,983::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e494860c-b67a-40dc-938f-2bdb9d5f200a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55811::DEBUG::2014-05-16 18:18:40,983::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55811::DEBUG::2014-05-16 18:18:40,983::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55811::DEBUG::2014-05-16 18:18:40,984::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e494860c-b67a-40dc-938f-2bdb9d5f200a`::Granted request >Thread-55811::DEBUG::2014-05-16 18:18:40,984::task::811::TaskManager.Task::(resourceAcquired) Task=`1903dd26-4d1f-4b42-a72a-758862910079`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55811::DEBUG::2014-05-16 18:18:40,984::task::974::TaskManager.Task::(_decref) Task=`1903dd26-4d1f-4b42-a72a-758862910079`::ref 1 aborting False >Thread-55811::INFO::2014-05-16 18:18:40,984::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55811::DEBUG::2014-05-16 18:18:40,985::task::1168::TaskManager.Task::(prepare) Task=`1903dd26-4d1f-4b42-a72a-758862910079`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55811::DEBUG::2014-05-16 18:18:40,985::task::579::TaskManager.Task::(_updateState) Task=`1903dd26-4d1f-4b42-a72a-758862910079`::moving from state preparing -> state finished >Thread-55811::DEBUG::2014-05-16 18:18:40,985::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55811::DEBUG::2014-05-16 18:18:40,985::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55811::DEBUG::2014-05-16 18:18:40,985::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55811::DEBUG::2014-05-16 18:18:40,985::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55811::DEBUG::2014-05-16 18:18:40,986::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55811::DEBUG::2014-05-16 18:18:40,986::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55811::DEBUG::2014-05-16 18:18:40,986::task::974::TaskManager.Task::(_decref) Task=`1903dd26-4d1f-4b42-a72a-758862910079`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:18:41,149::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:41,216::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314856 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:43,228::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:43,304::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346273 s, 29.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:18:44,638::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:18:44,648::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113305 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:45,318::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:45,389::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347295 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:47,401::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:47,474::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354684 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:49,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:49,553::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311509 s, 32.9 MB/s\n'; <rc> = 0 >Thread-55815::DEBUG::2014-05-16 18:18:50,280::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4325668.000000 / 8.008514 / 262500000.000000 = 0.205765 >Thread-55815::DEBUG::2014-05-16 18:18:50,280::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.03265096579143454, 'statsAge': 1.9529891014099121, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20576520672072124, 'rxDropped': 0} >Thread-55815::DEBUG::2014-05-16 18:18:50,281::task::579::TaskManager.Task::(_updateState) Task=`1f09bc6e-2cdf-4a39-8540-13ea74f91527`::moving from state init -> state preparing >Thread-55815::INFO::2014-05-16 18:18:50,281::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55815::INFO::2014-05-16 18:18:50,281::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113305', 'lastCheck': '5.6', 'valid': True}} >Thread-55815::DEBUG::2014-05-16 18:18:50,282::task::1168::TaskManager.Task::(prepare) Task=`1f09bc6e-2cdf-4a39-8540-13ea74f91527`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113305', 'lastCheck': '5.6', 'valid': True}} >Thread-55815::DEBUG::2014-05-16 18:18:50,282::task::579::TaskManager.Task::(_updateState) Task=`1f09bc6e-2cdf-4a39-8540-13ea74f91527`::moving from state preparing -> state finished >Thread-55815::DEBUG::2014-05-16 18:18:50,282::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55815::DEBUG::2014-05-16 18:18:50,282::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55815::DEBUG::2014-05-16 18:18:50,282::task::974::TaskManager.Task::(_decref) Task=`1f09bc6e-2cdf-4a39-8540-13ea74f91527`::ref 0 aborting False >Thread-55817::DEBUG::2014-05-16 18:18:51,049::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55817::DEBUG::2014-05-16 18:18:51,050::task::579::TaskManager.Task::(_updateState) Task=`bb5604ae-fac6-4a52-8050-f84df047a0f6`::moving from state init -> state preparing >Thread-55817::INFO::2014-05-16 18:18:51,050::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55817::INFO::2014-05-16 18:18:51,050::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55817::DEBUG::2014-05-16 18:18:51,050::task::1168::TaskManager.Task::(prepare) Task=`bb5604ae-fac6-4a52-8050-f84df047a0f6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55817::DEBUG::2014-05-16 18:18:51,050::task::579::TaskManager.Task::(_updateState) Task=`bb5604ae-fac6-4a52-8050-f84df047a0f6`::moving from state preparing -> state finished >Thread-55817::DEBUG::2014-05-16 18:18:51,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55817::DEBUG::2014-05-16 18:18:51,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55817::DEBUG::2014-05-16 18:18:51,051::task::974::TaskManager.Task::(_decref) Task=`bb5604ae-fac6-4a52-8050-f84df047a0f6`::ref 0 aborting False >Thread-55818::DEBUG::2014-05-16 18:18:51,061::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55818::DEBUG::2014-05-16 18:18:51,062::task::579::TaskManager.Task::(_updateState) Task=`b763c578-d886-4c60-95a7-aac02c8cc806`::moving from state init -> state preparing >Thread-55818::INFO::2014-05-16 18:18:51,062::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55818::DEBUG::2014-05-16 18:18:51,062::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`339be432-2fa7-4813-85b9-f5313b847164`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55818::DEBUG::2014-05-16 18:18:51,062::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55818::DEBUG::2014-05-16 18:18:51,063::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55818::DEBUG::2014-05-16 18:18:51,063::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`339be432-2fa7-4813-85b9-f5313b847164`::Granted request >Thread-55818::DEBUG::2014-05-16 18:18:51,063::task::811::TaskManager.Task::(resourceAcquired) Task=`b763c578-d886-4c60-95a7-aac02c8cc806`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55818::DEBUG::2014-05-16 18:18:51,063::task::974::TaskManager.Task::(_decref) Task=`b763c578-d886-4c60-95a7-aac02c8cc806`::ref 1 aborting False >Thread-55818::INFO::2014-05-16 18:18:51,064::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55818::DEBUG::2014-05-16 18:18:51,064::task::1168::TaskManager.Task::(prepare) Task=`b763c578-d886-4c60-95a7-aac02c8cc806`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55818::DEBUG::2014-05-16 18:18:51,064::task::579::TaskManager.Task::(_updateState) Task=`b763c578-d886-4c60-95a7-aac02c8cc806`::moving from state preparing -> state finished >Thread-55818::DEBUG::2014-05-16 18:18:51,064::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55818::DEBUG::2014-05-16 18:18:51,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55818::DEBUG::2014-05-16 18:18:51,065::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55818::DEBUG::2014-05-16 18:18:51,065::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55818::DEBUG::2014-05-16 18:18:51,065::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55818::DEBUG::2014-05-16 18:18:51,065::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55818::DEBUG::2014-05-16 18:18:51,065::task::974::TaskManager.Task::(_decref) Task=`b763c578-d886-4c60-95a7-aac02c8cc806`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:18:51,565::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:51,636::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035156 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:53,648::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:53,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311008 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:18:54,686::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:18:54,696::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701494 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:55,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:55,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305596 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:57,804::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:57,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359734 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:18:59,888::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:18:59,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302432 s, 33.9 MB/s\n'; <rc> = 0 >Thread-55822::DEBUG::2014-05-16 18:19:01,132::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55822::DEBUG::2014-05-16 18:19:01,133::task::579::TaskManager.Task::(_updateState) Task=`64615863-7efa-4238-9608-6378c48ba3f0`::moving from state init -> state preparing >Thread-55822::INFO::2014-05-16 18:19:01,133::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55822::INFO::2014-05-16 18:19:01,133::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55822::DEBUG::2014-05-16 18:19:01,133::task::1168::TaskManager.Task::(prepare) Task=`64615863-7efa-4238-9608-6378c48ba3f0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55822::DEBUG::2014-05-16 18:19:01,134::task::579::TaskManager.Task::(_updateState) Task=`64615863-7efa-4238-9608-6378c48ba3f0`::moving from state preparing -> state finished >Thread-55822::DEBUG::2014-05-16 18:19:01,134::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55822::DEBUG::2014-05-16 18:19:01,134::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55822::DEBUG::2014-05-16 18:19:01,134::task::974::TaskManager.Task::(_decref) Task=`64615863-7efa-4238-9608-6378c48ba3f0`::ref 0 aborting False >Thread-55823::DEBUG::2014-05-16 18:19:01,142::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55823::DEBUG::2014-05-16 18:19:01,143::task::579::TaskManager.Task::(_updateState) Task=`05dd911b-817c-4cca-b104-d7d27dedf965`::moving from state init -> state preparing >Thread-55823::INFO::2014-05-16 18:19:01,143::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55823::DEBUG::2014-05-16 18:19:01,143::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`01a44598-5a45-43ab-9dd0-b7ad92b957c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55823::DEBUG::2014-05-16 18:19:01,143::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55823::DEBUG::2014-05-16 18:19:01,144::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55823::DEBUG::2014-05-16 18:19:01,144::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`01a44598-5a45-43ab-9dd0-b7ad92b957c9`::Granted request >Thread-55823::DEBUG::2014-05-16 18:19:01,144::task::811::TaskManager.Task::(resourceAcquired) Task=`05dd911b-817c-4cca-b104-d7d27dedf965`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55823::DEBUG::2014-05-16 18:19:01,144::task::974::TaskManager.Task::(_decref) Task=`05dd911b-817c-4cca-b104-d7d27dedf965`::ref 1 aborting False >Thread-55823::INFO::2014-05-16 18:19:01,145::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55823::DEBUG::2014-05-16 18:19:01,145::task::1168::TaskManager.Task::(prepare) Task=`05dd911b-817c-4cca-b104-d7d27dedf965`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55823::DEBUG::2014-05-16 18:19:01,145::task::579::TaskManager.Task::(_updateState) Task=`05dd911b-817c-4cca-b104-d7d27dedf965`::moving from state preparing -> state finished >Thread-55823::DEBUG::2014-05-16 18:19:01,145::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55823::DEBUG::2014-05-16 18:19:01,146::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55823::DEBUG::2014-05-16 18:19:01,146::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55823::DEBUG::2014-05-16 18:19:01,146::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55823::DEBUG::2014-05-16 18:19:01,146::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55823::DEBUG::2014-05-16 18:19:01,146::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55823::DEBUG::2014-05-16 18:19:01,146::task::974::TaskManager.Task::(_decref) Task=`05dd911b-817c-4cca-b104-d7d27dedf965`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:19:01,965::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:02,042::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358987 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:04,054::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:04,126::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357334 s, 28.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:19:04,728::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:19:04,739::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000790311 s, 5.2 MB/s\n'; <rc> = 0 >Thread-55825::DEBUG::2014-05-16 18:19:05,612::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4338789.000000 / 8.008339 / 262500000.000000 = 0.206394 >Thread-55825::DEBUG::2014-05-16 18:19:05,612::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0054223479287280087, 'statsAge': 1.268463134765625, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20639386204984619, 'rxDropped': 0} >Thread-55825::DEBUG::2014-05-16 18:19:05,613::task::579::TaskManager.Task::(_updateState) Task=`89a6fb05-1267-4c12-8527-a2e63a9b9244`::moving from state init -> state preparing >Thread-55825::INFO::2014-05-16 18:19:05,613::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55825::INFO::2014-05-16 18:19:05,613::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790311', 'lastCheck': '0.9', 'valid': True}} >Thread-55825::DEBUG::2014-05-16 18:19:05,614::task::1168::TaskManager.Task::(prepare) Task=`89a6fb05-1267-4c12-8527-a2e63a9b9244`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790311', 'lastCheck': '0.9', 'valid': True}} >Thread-55825::DEBUG::2014-05-16 18:19:05,614::task::579::TaskManager.Task::(_updateState) Task=`89a6fb05-1267-4c12-8527-a2e63a9b9244`::moving from state preparing -> state finished >Thread-55825::DEBUG::2014-05-16 18:19:05,614::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55825::DEBUG::2014-05-16 18:19:05,614::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55825::DEBUG::2014-05-16 18:19:05,614::task::974::TaskManager.Task::(_decref) Task=`89a6fb05-1267-4c12-8527-a2e63a9b9244`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:19:06,138::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:06,209::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350735 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:08,220::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:08,287::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310012 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:10,299::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:10,373::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330476 s, 31.0 MB/s\n'; <rc> = 0 >Thread-55828::DEBUG::2014-05-16 18:19:11,209::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55828::DEBUG::2014-05-16 18:19:11,210::task::579::TaskManager.Task::(_updateState) Task=`d330bae4-f967-41b7-894b-7e8e2014970d`::moving from state init -> state preparing >Thread-55828::INFO::2014-05-16 18:19:11,210::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55828::INFO::2014-05-16 18:19:11,210::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55828::DEBUG::2014-05-16 18:19:11,210::task::1168::TaskManager.Task::(prepare) Task=`d330bae4-f967-41b7-894b-7e8e2014970d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55828::DEBUG::2014-05-16 18:19:11,210::task::579::TaskManager.Task::(_updateState) Task=`d330bae4-f967-41b7-894b-7e8e2014970d`::moving from state preparing -> state finished >Thread-55828::DEBUG::2014-05-16 18:19:11,211::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55828::DEBUG::2014-05-16 18:19:11,211::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55828::DEBUG::2014-05-16 18:19:11,211::task::974::TaskManager.Task::(_decref) Task=`d330bae4-f967-41b7-894b-7e8e2014970d`::ref 0 aborting False >Thread-55829::DEBUG::2014-05-16 18:19:11,219::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55829::DEBUG::2014-05-16 18:19:11,220::task::579::TaskManager.Task::(_updateState) Task=`dbe1ae97-ae64-4aa1-a056-8c95e45e2d24`::moving from state init -> state preparing >Thread-55829::INFO::2014-05-16 18:19:11,220::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55829::DEBUG::2014-05-16 18:19:11,220::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fda0b4a1-2121-4044-a8cf-f87664facc0c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55829::DEBUG::2014-05-16 18:19:11,220::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55829::DEBUG::2014-05-16 18:19:11,221::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55829::DEBUG::2014-05-16 18:19:11,221::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fda0b4a1-2121-4044-a8cf-f87664facc0c`::Granted request >Thread-55829::DEBUG::2014-05-16 18:19:11,221::task::811::TaskManager.Task::(resourceAcquired) Task=`dbe1ae97-ae64-4aa1-a056-8c95e45e2d24`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55829::DEBUG::2014-05-16 18:19:11,221::task::974::TaskManager.Task::(_decref) Task=`dbe1ae97-ae64-4aa1-a056-8c95e45e2d24`::ref 1 aborting False >Thread-55829::INFO::2014-05-16 18:19:11,222::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55829::DEBUG::2014-05-16 18:19:11,222::task::1168::TaskManager.Task::(prepare) Task=`dbe1ae97-ae64-4aa1-a056-8c95e45e2d24`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55829::DEBUG::2014-05-16 18:19:11,222::task::579::TaskManager.Task::(_updateState) Task=`dbe1ae97-ae64-4aa1-a056-8c95e45e2d24`::moving from state preparing -> state finished >Thread-55829::DEBUG::2014-05-16 18:19:11,223::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55829::DEBUG::2014-05-16 18:19:11,223::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55829::DEBUG::2014-05-16 18:19:11,223::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55829::DEBUG::2014-05-16 18:19:11,223::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55829::DEBUG::2014-05-16 18:19:11,223::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55829::DEBUG::2014-05-16 18:19:11,223::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55829::DEBUG::2014-05-16 18:19:11,224::task::974::TaskManager.Task::(_decref) Task=`dbe1ae97-ae64-4aa1-a056-8c95e45e2d24`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:19:12,385::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:12,456::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360787 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:14,468::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:14,535::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313564 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:19:14,783::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:19:14,793::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000738623 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:16,547::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:16,614::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305156 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:18,625::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:18,698::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036316 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:20,709::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:20,775::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299559 s, 34.2 MB/s\n'; <rc> = 0 >Thread-55833::DEBUG::2014-05-16 18:19:20,809::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413599.000000 / 8.008243 / 262500000.000000 = 0.257525 >Thread-55833::DEBUG::2014-05-16 18:19:20,810::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0063203447513068495, 'statsAge': 0.44643878936767578, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25752507846617601, 'rxDropped': 0} >Thread-55833::DEBUG::2014-05-16 18:19:20,810::task::579::TaskManager.Task::(_updateState) Task=`d08607fc-29d7-42c1-84d4-69536bd84143`::moving from state init -> state preparing >Thread-55833::INFO::2014-05-16 18:19:20,810::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55833::INFO::2014-05-16 18:19:20,811::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738623', 'lastCheck': '6.0', 'valid': True}} >Thread-55833::DEBUG::2014-05-16 18:19:20,811::task::1168::TaskManager.Task::(prepare) Task=`d08607fc-29d7-42c1-84d4-69536bd84143`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738623', 'lastCheck': '6.0', 'valid': True}} >Thread-55833::DEBUG::2014-05-16 18:19:20,811::task::579::TaskManager.Task::(_updateState) Task=`d08607fc-29d7-42c1-84d4-69536bd84143`::moving from state preparing -> state finished >Thread-55833::DEBUG::2014-05-16 18:19:20,811::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55833::DEBUG::2014-05-16 18:19:20,811::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55833::DEBUG::2014-05-16 18:19:20,811::task::974::TaskManager.Task::(_decref) Task=`d08607fc-29d7-42c1-84d4-69536bd84143`::ref 0 aborting False >Thread-55835::DEBUG::2014-05-16 18:19:21,261::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55835::DEBUG::2014-05-16 18:19:21,261::task::579::TaskManager.Task::(_updateState) Task=`f2a5faee-82e9-43b4-9b09-0facdf7522c2`::moving from state init -> state preparing >Thread-55835::INFO::2014-05-16 18:19:21,261::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55835::INFO::2014-05-16 18:19:21,262::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55835::DEBUG::2014-05-16 18:19:21,262::task::1168::TaskManager.Task::(prepare) Task=`f2a5faee-82e9-43b4-9b09-0facdf7522c2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55835::DEBUG::2014-05-16 18:19:21,262::task::579::TaskManager.Task::(_updateState) Task=`f2a5faee-82e9-43b4-9b09-0facdf7522c2`::moving from state preparing -> state finished >Thread-55835::DEBUG::2014-05-16 18:19:21,262::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55835::DEBUG::2014-05-16 18:19:21,262::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55835::DEBUG::2014-05-16 18:19:21,262::task::974::TaskManager.Task::(_decref) Task=`f2a5faee-82e9-43b4-9b09-0facdf7522c2`::ref 0 aborting False >Thread-55836::DEBUG::2014-05-16 18:19:21,272::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55836::DEBUG::2014-05-16 18:19:21,273::task::579::TaskManager.Task::(_updateState) Task=`daf8f79f-a98f-4606-b1af-b76443909a81`::moving from state init -> state preparing >Thread-55836::INFO::2014-05-16 18:19:21,273::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55836::DEBUG::2014-05-16 18:19:21,273::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`91354bef-e735-49de-be90-d757c75d4b92`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55836::DEBUG::2014-05-16 18:19:21,273::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55836::DEBUG::2014-05-16 18:19:21,274::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55836::DEBUG::2014-05-16 18:19:21,274::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`91354bef-e735-49de-be90-d757c75d4b92`::Granted request >Thread-55836::DEBUG::2014-05-16 18:19:21,274::task::811::TaskManager.Task::(resourceAcquired) Task=`daf8f79f-a98f-4606-b1af-b76443909a81`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55836::DEBUG::2014-05-16 18:19:21,274::task::974::TaskManager.Task::(_decref) Task=`daf8f79f-a98f-4606-b1af-b76443909a81`::ref 1 aborting False >Thread-55836::INFO::2014-05-16 18:19:21,275::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55836::DEBUG::2014-05-16 18:19:21,275::task::1168::TaskManager.Task::(prepare) Task=`daf8f79f-a98f-4606-b1af-b76443909a81`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55836::DEBUG::2014-05-16 18:19:21,275::task::579::TaskManager.Task::(_updateState) Task=`daf8f79f-a98f-4606-b1af-b76443909a81`::moving from state preparing -> state finished >Thread-55836::DEBUG::2014-05-16 18:19:21,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55836::DEBUG::2014-05-16 18:19:21,275::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55836::DEBUG::2014-05-16 18:19:21,276::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55836::DEBUG::2014-05-16 18:19:21,276::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55836::DEBUG::2014-05-16 18:19:21,276::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55836::DEBUG::2014-05-16 18:19:21,276::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55836::DEBUG::2014-05-16 18:19:21,276::task::974::TaskManager.Task::(_decref) Task=`daf8f79f-a98f-4606-b1af-b76443909a81`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:19:22,787::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:22,854::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307563 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:19:24,831::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:19:24,841::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104654 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:24,865::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:24,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351515 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:26,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:27,015::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310725 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:29,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:29,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031686 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:31,107::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:31,179::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354557 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55840::DEBUG::2014-05-16 18:19:31,314::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55840::DEBUG::2014-05-16 18:19:31,315::task::579::TaskManager.Task::(_updateState) Task=`1282de74-4019-40b2-8202-3485c80e912b`::moving from state init -> state preparing >Thread-55840::INFO::2014-05-16 18:19:31,315::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55840::INFO::2014-05-16 18:19:31,315::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55840::DEBUG::2014-05-16 18:19:31,315::task::1168::TaskManager.Task::(prepare) Task=`1282de74-4019-40b2-8202-3485c80e912b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55840::DEBUG::2014-05-16 18:19:31,315::task::579::TaskManager.Task::(_updateState) Task=`1282de74-4019-40b2-8202-3485c80e912b`::moving from state preparing -> state finished >Thread-55840::DEBUG::2014-05-16 18:19:31,316::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55840::DEBUG::2014-05-16 18:19:31,316::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55840::DEBUG::2014-05-16 18:19:31,316::task::974::TaskManager.Task::(_decref) Task=`1282de74-4019-40b2-8202-3485c80e912b`::ref 0 aborting False >Thread-55841::DEBUG::2014-05-16 18:19:31,344::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55841::DEBUG::2014-05-16 18:19:31,345::task::579::TaskManager.Task::(_updateState) Task=`b2ed1049-7cad-41d0-835d-f82750a103db`::moving from state init -> state preparing >Thread-55841::INFO::2014-05-16 18:19:31,345::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55841::DEBUG::2014-05-16 18:19:31,345::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e5120bfb-d3ba-4854-8d53-77d31f59a373`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55841::DEBUG::2014-05-16 18:19:31,345::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55841::DEBUG::2014-05-16 18:19:31,346::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55841::DEBUG::2014-05-16 18:19:31,346::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e5120bfb-d3ba-4854-8d53-77d31f59a373`::Granted request >Thread-55841::DEBUG::2014-05-16 18:19:31,346::task::811::TaskManager.Task::(resourceAcquired) Task=`b2ed1049-7cad-41d0-835d-f82750a103db`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55841::DEBUG::2014-05-16 18:19:31,346::task::974::TaskManager.Task::(_decref) Task=`b2ed1049-7cad-41d0-835d-f82750a103db`::ref 1 aborting False >Thread-55841::INFO::2014-05-16 18:19:31,347::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55841::DEBUG::2014-05-16 18:19:31,347::task::1168::TaskManager.Task::(prepare) Task=`b2ed1049-7cad-41d0-835d-f82750a103db`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55841::DEBUG::2014-05-16 18:19:31,347::task::579::TaskManager.Task::(_updateState) Task=`b2ed1049-7cad-41d0-835d-f82750a103db`::moving from state preparing -> state finished >Thread-55841::DEBUG::2014-05-16 18:19:31,347::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55841::DEBUG::2014-05-16 18:19:31,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55841::DEBUG::2014-05-16 18:19:31,348::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55841::DEBUG::2014-05-16 18:19:31,348::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55841::DEBUG::2014-05-16 18:19:31,348::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55841::DEBUG::2014-05-16 18:19:31,348::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55841::DEBUG::2014-05-16 18:19:31,348::task::974::TaskManager.Task::(_decref) Task=`b2ed1049-7cad-41d0-835d-f82750a103db`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:19:33,191::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:33,269::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348055 s, 29.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:19:34,875::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:19:34,886::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00118542 s, 3.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:35,280::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:35,354::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357938 s, 28.6 MB/s\n'; <rc> = 0 >Thread-55843::DEBUG::2014-05-16 18:19:36,357::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317374.000000 / 8.008300 / 262500000.000000 = 0.205376 >Thread-55843::DEBUG::2014-05-16 18:19:36,357::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053866969717411457, 'statsAge': 1.9796569347381592, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20537615863644676, 'rxDropped': 0} >Thread-55843::DEBUG::2014-05-16 18:19:36,358::task::579::TaskManager.Task::(_updateState) Task=`3c10c276-502a-47db-81dd-b9e7051c58d8`::moving from state init -> state preparing >Thread-55843::INFO::2014-05-16 18:19:36,358::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55843::INFO::2014-05-16 18:19:36,358::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00118542', 'lastCheck': '1.5', 'valid': True}} >Thread-55843::DEBUG::2014-05-16 18:19:36,358::task::1168::TaskManager.Task::(prepare) Task=`3c10c276-502a-47db-81dd-b9e7051c58d8`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00118542', 'lastCheck': '1.5', 'valid': True}} >Thread-55843::DEBUG::2014-05-16 18:19:36,359::task::579::TaskManager.Task::(_updateState) Task=`3c10c276-502a-47db-81dd-b9e7051c58d8`::moving from state preparing -> state finished >Thread-55843::DEBUG::2014-05-16 18:19:36,359::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55843::DEBUG::2014-05-16 18:19:36,359::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55843::DEBUG::2014-05-16 18:19:36,359::task::974::TaskManager.Task::(_decref) Task=`3c10c276-502a-47db-81dd-b9e7051c58d8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:19:37,365::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:37,432::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310315 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:39,443::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:39,516::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361416 s, 28.3 MB/s\n'; <rc> = 0 >Thread-55846::DEBUG::2014-05-16 18:19:41,414::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55846::DEBUG::2014-05-16 18:19:41,414::task::579::TaskManager.Task::(_updateState) Task=`0580b297-b6eb-4b13-9cd1-8ab7eb3cb9ef`::moving from state init -> state preparing >Thread-55846::INFO::2014-05-16 18:19:41,415::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55846::INFO::2014-05-16 18:19:41,415::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55846::DEBUG::2014-05-16 18:19:41,415::task::1168::TaskManager.Task::(prepare) Task=`0580b297-b6eb-4b13-9cd1-8ab7eb3cb9ef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55846::DEBUG::2014-05-16 18:19:41,415::task::579::TaskManager.Task::(_updateState) Task=`0580b297-b6eb-4b13-9cd1-8ab7eb3cb9ef`::moving from state preparing -> state finished >Thread-55846::DEBUG::2014-05-16 18:19:41,415::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55846::DEBUG::2014-05-16 18:19:41,415::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55846::DEBUG::2014-05-16 18:19:41,416::task::974::TaskManager.Task::(_decref) Task=`0580b297-b6eb-4b13-9cd1-8ab7eb3cb9ef`::ref 0 aborting False >Thread-55847::DEBUG::2014-05-16 18:19:41,424::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55847::DEBUG::2014-05-16 18:19:41,425::task::579::TaskManager.Task::(_updateState) Task=`57c44158-8785-49d9-9b30-0be6390f3859`::moving from state init -> state preparing >Thread-55847::INFO::2014-05-16 18:19:41,425::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55847::DEBUG::2014-05-16 18:19:41,425::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`340cbaf5-fda8-41d9-94f5-509bf5ce589a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55847::DEBUG::2014-05-16 18:19:41,425::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55847::DEBUG::2014-05-16 18:19:41,425::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55847::DEBUG::2014-05-16 18:19:41,426::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`340cbaf5-fda8-41d9-94f5-509bf5ce589a`::Granted request >Thread-55847::DEBUG::2014-05-16 18:19:41,426::task::811::TaskManager.Task::(resourceAcquired) Task=`57c44158-8785-49d9-9b30-0be6390f3859`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55847::DEBUG::2014-05-16 18:19:41,426::task::974::TaskManager.Task::(_decref) Task=`57c44158-8785-49d9-9b30-0be6390f3859`::ref 1 aborting False >Thread-55847::INFO::2014-05-16 18:19:41,427::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55847::DEBUG::2014-05-16 18:19:41,427::task::1168::TaskManager.Task::(prepare) Task=`57c44158-8785-49d9-9b30-0be6390f3859`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55847::DEBUG::2014-05-16 18:19:41,427::task::579::TaskManager.Task::(_updateState) Task=`57c44158-8785-49d9-9b30-0be6390f3859`::moving from state preparing -> state finished >Thread-55847::DEBUG::2014-05-16 18:19:41,427::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55847::DEBUG::2014-05-16 18:19:41,427::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55847::DEBUG::2014-05-16 18:19:41,427::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55847::DEBUG::2014-05-16 18:19:41,428::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55847::DEBUG::2014-05-16 18:19:41,428::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55847::DEBUG::2014-05-16 18:19:41,428::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55847::DEBUG::2014-05-16 18:19:41,428::task::974::TaskManager.Task::(_decref) Task=`57c44158-8785-49d9-9b30-0be6390f3859`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:19:41,528::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:41,594::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302998 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:43,606::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:43,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03161 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:19:44,922::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:19:44,934::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0015657 s, 2.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:45,685::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:45,763::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408801 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:47,775::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:47,846::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350829 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:49,858::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:49,926::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313615 s, 32.7 MB/s\n'; <rc> = 0 >Thread-55851::DEBUG::2014-05-16 18:19:51,544::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55851::DEBUG::2014-05-16 18:19:51,544::task::579::TaskManager.Task::(_updateState) Task=`f0ae42c8-d076-44f8-a051-d032418f43f4`::moving from state init -> state preparing >Thread-55851::INFO::2014-05-16 18:19:51,545::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55851::INFO::2014-05-16 18:19:51,545::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55851::DEBUG::2014-05-16 18:19:51,545::task::1168::TaskManager.Task::(prepare) Task=`f0ae42c8-d076-44f8-a051-d032418f43f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55851::DEBUG::2014-05-16 18:19:51,545::task::579::TaskManager.Task::(_updateState) Task=`f0ae42c8-d076-44f8-a051-d032418f43f4`::moving from state preparing -> state finished >Thread-55851::DEBUG::2014-05-16 18:19:51,545::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55851::DEBUG::2014-05-16 18:19:51,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55851::DEBUG::2014-05-16 18:19:51,546::task::974::TaskManager.Task::(_decref) Task=`f0ae42c8-d076-44f8-a051-d032418f43f4`::ref 0 aborting False >Thread-55852::DEBUG::2014-05-16 18:19:51,593::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55852::DEBUG::2014-05-16 18:19:51,593::task::579::TaskManager.Task::(_updateState) Task=`9b818154-13fa-475f-8312-6b48b44a8735`::moving from state init -> state preparing >Thread-55852::INFO::2014-05-16 18:19:51,593::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55852::DEBUG::2014-05-16 18:19:51,595::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8d01114a-cbc7-4dc5-9182-9bedbb565168`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55852::DEBUG::2014-05-16 18:19:51,595::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55852::DEBUG::2014-05-16 18:19:51,595::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55852::DEBUG::2014-05-16 18:19:51,595::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8d01114a-cbc7-4dc5-9182-9bedbb565168`::Granted request >Thread-55852::DEBUG::2014-05-16 18:19:51,596::task::811::TaskManager.Task::(resourceAcquired) Task=`9b818154-13fa-475f-8312-6b48b44a8735`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55852::DEBUG::2014-05-16 18:19:51,596::task::974::TaskManager.Task::(_decref) Task=`9b818154-13fa-475f-8312-6b48b44a8735`::ref 1 aborting False >Thread-55852::INFO::2014-05-16 18:19:51,596::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55852::DEBUG::2014-05-16 18:19:51,596::task::1168::TaskManager.Task::(prepare) Task=`9b818154-13fa-475f-8312-6b48b44a8735`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55852::DEBUG::2014-05-16 18:19:51,597::task::579::TaskManager.Task::(_updateState) Task=`9b818154-13fa-475f-8312-6b48b44a8735`::moving from state preparing -> state finished >Thread-55852::DEBUG::2014-05-16 18:19:51,597::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55852::DEBUG::2014-05-16 18:19:51,597::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55852::DEBUG::2014-05-16 18:19:51,597::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55852::DEBUG::2014-05-16 18:19:51,597::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55852::DEBUG::2014-05-16 18:19:51,598::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55852::DEBUG::2014-05-16 18:19:51,598::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55852::DEBUG::2014-05-16 18:19:51,598::task::974::TaskManager.Task::(_decref) Task=`9b818154-13fa-475f-8312-6b48b44a8735`::ref 0 aborting False >Thread-55853::DEBUG::2014-05-16 18:19:51,879::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3242275.000000 / 8.008386 / 262500000.000000 = 0.154232 >Thread-55853::DEBUG::2014-05-16 18:19:51,879::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0039427241157194365, 'statsAge': 1.4715218544006348, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.154232370931594, 'rxDropped': 0} >Thread-55853::DEBUG::2014-05-16 18:19:51,880::task::579::TaskManager.Task::(_updateState) Task=`ba368974-33ad-49fb-b870-b7492b7ae211`::moving from state init -> state preparing >Thread-55853::INFO::2014-05-16 18:19:51,880::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55853::INFO::2014-05-16 18:19:51,880::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015657', 'lastCheck': '6.9', 'valid': True}} >Thread-55853::DEBUG::2014-05-16 18:19:51,880::task::1168::TaskManager.Task::(prepare) Task=`ba368974-33ad-49fb-b870-b7492b7ae211`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015657', 'lastCheck': '6.9', 'valid': True}} >Thread-55853::DEBUG::2014-05-16 18:19:51,880::task::579::TaskManager.Task::(_updateState) Task=`ba368974-33ad-49fb-b870-b7492b7ae211`::moving from state preparing -> state finished >Thread-55853::DEBUG::2014-05-16 18:19:51,881::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55853::DEBUG::2014-05-16 18:19:51,881::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55853::DEBUG::2014-05-16 18:19:51,881::task::974::TaskManager.Task::(_decref) Task=`ba368974-33ad-49fb-b870-b7492b7ae211`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:19:51,937::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:52,008::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353325 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:54,020::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:54,087::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310272 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:19:54,971::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:19:54,981::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000827178 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:56,099::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:56,166::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031096 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:19:58,178::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:19:58,251::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359084 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:00,263::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:00,331::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314604 s, 32.5 MB/s\n'; <rc> = 0 >Thread-55857::DEBUG::2014-05-16 18:20:01,987::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55857::DEBUG::2014-05-16 18:20:01,988::task::579::TaskManager.Task::(_updateState) Task=`846c4c17-78d0-408f-880b-14f2afad9b92`::moving from state init -> state preparing >Thread-55857::INFO::2014-05-16 18:20:01,988::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55857::INFO::2014-05-16 18:20:01,988::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55857::DEBUG::2014-05-16 18:20:01,988::task::1168::TaskManager.Task::(prepare) Task=`846c4c17-78d0-408f-880b-14f2afad9b92`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55857::DEBUG::2014-05-16 18:20:01,988::task::579::TaskManager.Task::(_updateState) Task=`846c4c17-78d0-408f-880b-14f2afad9b92`::moving from state preparing -> state finished >Thread-55857::DEBUG::2014-05-16 18:20:01,989::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55857::DEBUG::2014-05-16 18:20:01,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55857::DEBUG::2014-05-16 18:20:01,989::task::974::TaskManager.Task::(_decref) Task=`846c4c17-78d0-408f-880b-14f2afad9b92`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:20:02,343::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:02,415::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346743 s, 29.5 MB/s\n'; <rc> = 0 >Thread-55858::DEBUG::2014-05-16 18:20:02,667::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55858::DEBUG::2014-05-16 18:20:02,669::task::579::TaskManager.Task::(_updateState) Task=`3deddddd-e994-40e0-b2f3-0b39aa7f74ec`::moving from state init -> state preparing >Thread-55858::INFO::2014-05-16 18:20:02,671::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55858::DEBUG::2014-05-16 18:20:02,672::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ac98cc76-e2c5-482f-b98c-a26e70ad9d1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55858::DEBUG::2014-05-16 18:20:02,672::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55858::DEBUG::2014-05-16 18:20:02,672::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55858::DEBUG::2014-05-16 18:20:02,672::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ac98cc76-e2c5-482f-b98c-a26e70ad9d1c`::Granted request >Thread-55858::DEBUG::2014-05-16 18:20:02,673::task::811::TaskManager.Task::(resourceAcquired) Task=`3deddddd-e994-40e0-b2f3-0b39aa7f74ec`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55858::DEBUG::2014-05-16 18:20:02,673::task::974::TaskManager.Task::(_decref) Task=`3deddddd-e994-40e0-b2f3-0b39aa7f74ec`::ref 1 aborting False >Thread-55858::INFO::2014-05-16 18:20:02,674::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55858::DEBUG::2014-05-16 18:20:02,674::task::1168::TaskManager.Task::(prepare) Task=`3deddddd-e994-40e0-b2f3-0b39aa7f74ec`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55858::DEBUG::2014-05-16 18:20:02,674::task::579::TaskManager.Task::(_updateState) Task=`3deddddd-e994-40e0-b2f3-0b39aa7f74ec`::moving from state preparing -> state finished >Thread-55858::DEBUG::2014-05-16 18:20:02,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55858::DEBUG::2014-05-16 18:20:02,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55858::DEBUG::2014-05-16 18:20:02,675::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55858::DEBUG::2014-05-16 18:20:02,675::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55858::DEBUG::2014-05-16 18:20:02,675::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55858::DEBUG::2014-05-16 18:20:02,675::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55858::DEBUG::2014-05-16 18:20:02,675::task::974::TaskManager.Task::(_decref) Task=`3deddddd-e994-40e0-b2f3-0b39aa7f74ec`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:20:04,427::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:04,494::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312709 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:20:05,019::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:20:05,029::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000805672 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:06,506::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:06,576::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341747 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:08,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:08,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359314 s, 28.5 MB/s\n'; <rc> = 0 >Thread-55861::DEBUG::2014-05-16 18:20:08,989::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413085.000000 / 8.015123 / 262500000.000000 = 0.257280 >Thread-55861::DEBUG::2014-05-16 18:20:08,989::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065797521711710516, 'statsAge': 0.54998278617858887, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25727959332459371, 'rxDropped': 0} >Thread-55861::DEBUG::2014-05-16 18:20:08,990::task::579::TaskManager.Task::(_updateState) Task=`ed8acbdf-f999-401e-9d2c-ea72d4b5c114`::moving from state init -> state preparing >Thread-55861::INFO::2014-05-16 18:20:08,990::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55861::INFO::2014-05-16 18:20:08,990::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000805672', 'lastCheck': '3.9', 'valid': True}} >Thread-55861::DEBUG::2014-05-16 18:20:08,990::task::1168::TaskManager.Task::(prepare) Task=`ed8acbdf-f999-401e-9d2c-ea72d4b5c114`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000805672', 'lastCheck': '3.9', 'valid': True}} >Thread-55861::DEBUG::2014-05-16 18:20:08,990::task::579::TaskManager.Task::(_updateState) Task=`ed8acbdf-f999-401e-9d2c-ea72d4b5c114`::moving from state preparing -> state finished >Thread-55861::DEBUG::2014-05-16 18:20:08,991::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55861::DEBUG::2014-05-16 18:20:08,991::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55861::DEBUG::2014-05-16 18:20:08,991::task::974::TaskManager.Task::(_decref) Task=`ed8acbdf-f999-401e-9d2c-ea72d4b5c114`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:20:10,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:10,741::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313476 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:12,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:12,823::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350605 s, 29.2 MB/s\n'; <rc> = 0 >Thread-55864::DEBUG::2014-05-16 18:20:12,935::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55864::DEBUG::2014-05-16 18:20:12,935::task::579::TaskManager.Task::(_updateState) Task=`aa592ab2-bfa0-4f37-b524-5e37086c33d8`::moving from state init -> state preparing >Thread-55864::INFO::2014-05-16 18:20:12,936::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55864::INFO::2014-05-16 18:20:12,936::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55864::DEBUG::2014-05-16 18:20:12,936::task::1168::TaskManager.Task::(prepare) Task=`aa592ab2-bfa0-4f37-b524-5e37086c33d8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55864::DEBUG::2014-05-16 18:20:12,936::task::579::TaskManager.Task::(_updateState) Task=`aa592ab2-bfa0-4f37-b524-5e37086c33d8`::moving from state preparing -> state finished >Thread-55864::DEBUG::2014-05-16 18:20:12,936::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55864::DEBUG::2014-05-16 18:20:12,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55864::DEBUG::2014-05-16 18:20:12,937::task::974::TaskManager.Task::(_decref) Task=`aa592ab2-bfa0-4f37-b524-5e37086c33d8`::ref 0 aborting False >Thread-55865::DEBUG::2014-05-16 18:20:12,984::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55865::DEBUG::2014-05-16 18:20:12,984::task::579::TaskManager.Task::(_updateState) Task=`a5f696c3-0773-4926-af24-3968a4d84f37`::moving from state init -> state preparing >Thread-55865::INFO::2014-05-16 18:20:12,985::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55865::DEBUG::2014-05-16 18:20:12,985::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f4fd33f4-4f3e-43ef-9e5c-a5f1b9b3b246`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55865::DEBUG::2014-05-16 18:20:12,985::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55865::DEBUG::2014-05-16 18:20:12,985::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55865::DEBUG::2014-05-16 18:20:12,986::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f4fd33f4-4f3e-43ef-9e5c-a5f1b9b3b246`::Granted request >Thread-55865::DEBUG::2014-05-16 18:20:12,986::task::811::TaskManager.Task::(resourceAcquired) Task=`a5f696c3-0773-4926-af24-3968a4d84f37`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55865::DEBUG::2014-05-16 18:20:12,986::task::974::TaskManager.Task::(_decref) Task=`a5f696c3-0773-4926-af24-3968a4d84f37`::ref 1 aborting False >Thread-55865::INFO::2014-05-16 18:20:12,987::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55865::DEBUG::2014-05-16 18:20:12,987::task::1168::TaskManager.Task::(prepare) Task=`a5f696c3-0773-4926-af24-3968a4d84f37`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55865::DEBUG::2014-05-16 18:20:12,987::task::579::TaskManager.Task::(_updateState) Task=`a5f696c3-0773-4926-af24-3968a4d84f37`::moving from state preparing -> state finished >Thread-55865::DEBUG::2014-05-16 18:20:12,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55865::DEBUG::2014-05-16 18:20:12,987::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55865::DEBUG::2014-05-16 18:20:12,988::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55865::DEBUG::2014-05-16 18:20:12,988::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55865::DEBUG::2014-05-16 18:20:12,988::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55865::DEBUG::2014-05-16 18:20:12,988::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55865::DEBUG::2014-05-16 18:20:12,988::task::974::TaskManager.Task::(_decref) Task=`a5f696c3-0773-4926-af24-3968a4d84f37`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:20:14,835::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:14,902::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315307 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:20:15,067::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:20:15,078::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000783196 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:16,914::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:16,981::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310624 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:18,993::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:19,065::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356537 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:21,076::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:21,143::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030532 s, 33.5 MB/s\n'; <rc> = 0 >Thread-55869::DEBUG::2014-05-16 18:20:23,081::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55869::DEBUG::2014-05-16 18:20:23,082::task::579::TaskManager.Task::(_updateState) Task=`61ad26cc-bd90-43c6-bb12-c22a37e1413e`::moving from state init -> state preparing >Thread-55869::INFO::2014-05-16 18:20:23,082::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55869::INFO::2014-05-16 18:20:23,082::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55869::DEBUG::2014-05-16 18:20:23,083::task::1168::TaskManager.Task::(prepare) Task=`61ad26cc-bd90-43c6-bb12-c22a37e1413e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55869::DEBUG::2014-05-16 18:20:23,083::task::579::TaskManager.Task::(_updateState) Task=`61ad26cc-bd90-43c6-bb12-c22a37e1413e`::moving from state preparing -> state finished >Thread-55869::DEBUG::2014-05-16 18:20:23,083::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55869::DEBUG::2014-05-16 18:20:23,083::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55869::DEBUG::2014-05-16 18:20:23,083::task::974::TaskManager.Task::(_decref) Task=`61ad26cc-bd90-43c6-bb12-c22a37e1413e`::ref 0 aborting False >Thread-55870::DEBUG::2014-05-16 18:20:23,106::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55870::DEBUG::2014-05-16 18:20:23,107::task::579::TaskManager.Task::(_updateState) Task=`ee2167ad-edf3-4eb8-a946-71fb6999de6f`::moving from state init -> state preparing >Thread-55870::INFO::2014-05-16 18:20:23,107::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55870::DEBUG::2014-05-16 18:20:23,107::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ec88bf47-15ba-43bd-9ce0-c223bc71015e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55870::DEBUG::2014-05-16 18:20:23,107::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55870::DEBUG::2014-05-16 18:20:23,108::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55870::DEBUG::2014-05-16 18:20:23,108::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ec88bf47-15ba-43bd-9ce0-c223bc71015e`::Granted request >Thread-55870::DEBUG::2014-05-16 18:20:23,108::task::811::TaskManager.Task::(resourceAcquired) Task=`ee2167ad-edf3-4eb8-a946-71fb6999de6f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55870::DEBUG::2014-05-16 18:20:23,108::task::974::TaskManager.Task::(_decref) Task=`ee2167ad-edf3-4eb8-a946-71fb6999de6f`::ref 1 aborting False >Thread-55870::INFO::2014-05-16 18:20:23,109::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55870::DEBUG::2014-05-16 18:20:23,109::task::1168::TaskManager.Task::(prepare) Task=`ee2167ad-edf3-4eb8-a946-71fb6999de6f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55870::DEBUG::2014-05-16 18:20:23,109::task::579::TaskManager.Task::(_updateState) Task=`ee2167ad-edf3-4eb8-a946-71fb6999de6f`::moving from state preparing -> state finished >Thread-55870::DEBUG::2014-05-16 18:20:23,109::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55870::DEBUG::2014-05-16 18:20:23,110::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55870::DEBUG::2014-05-16 18:20:23,110::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55870::DEBUG::2014-05-16 18:20:23,110::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55870::DEBUG::2014-05-16 18:20:23,110::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55870::DEBUG::2014-05-16 18:20:23,110::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55870::DEBUG::2014-05-16 18:20:23,110::task::974::TaskManager.Task::(_decref) Task=`ee2167ad-edf3-4eb8-a946-71fb6999de6f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:20:23,155::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:23,227::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352116 s, 29.1 MB/s\n'; <rc> = 0 >Thread-55871::DEBUG::2014-05-16 18:20:24,370::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5418464.000000 / 8.008196 / 262500000.000000 = 0.257758 >Thread-55871::DEBUG::2014-05-16 18:20:24,371::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066254028527711062, 'statsAge': 1.9170429706573486, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25775802610096171, 'rxDropped': 0} >Thread-55871::DEBUG::2014-05-16 18:20:24,371::task::579::TaskManager.Task::(_updateState) Task=`6d475586-49f7-4d0e-9969-963ada4268b3`::moving from state init -> state preparing >Thread-55871::INFO::2014-05-16 18:20:24,371::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55871::INFO::2014-05-16 18:20:24,372::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000783196', 'lastCheck': '9.3', 'valid': True}} >Thread-55871::DEBUG::2014-05-16 18:20:24,372::task::1168::TaskManager.Task::(prepare) Task=`6d475586-49f7-4d0e-9969-963ada4268b3`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000783196', 'lastCheck': '9.3', 'valid': True}} >Thread-55871::DEBUG::2014-05-16 18:20:24,372::task::579::TaskManager.Task::(_updateState) Task=`6d475586-49f7-4d0e-9969-963ada4268b3`::moving from state preparing -> state finished >Thread-55871::DEBUG::2014-05-16 18:20:24,372::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55871::DEBUG::2014-05-16 18:20:24,372::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55871::DEBUG::2014-05-16 18:20:24,372::task::974::TaskManager.Task::(_decref) Task=`6d475586-49f7-4d0e-9969-963ada4268b3`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:20:25,116::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:20:25,126::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108126 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:25,238::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:25,310::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356884 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:27,322::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:27,389::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312368 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:29,400::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:29,469::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031099 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:31,481::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:31,550::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313343 s, 32.7 MB/s\n'; <rc> = 0 >Thread-55875::DEBUG::2014-05-16 18:20:33,213::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55875::DEBUG::2014-05-16 18:20:33,214::task::579::TaskManager.Task::(_updateState) Task=`8a0421d3-b555-42ef-a2f9-8f7508313c18`::moving from state init -> state preparing >Thread-55875::INFO::2014-05-16 18:20:33,214::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55875::INFO::2014-05-16 18:20:33,214::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55875::DEBUG::2014-05-16 18:20:33,215::task::1168::TaskManager.Task::(prepare) Task=`8a0421d3-b555-42ef-a2f9-8f7508313c18`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55875::DEBUG::2014-05-16 18:20:33,215::task::579::TaskManager.Task::(_updateState) Task=`8a0421d3-b555-42ef-a2f9-8f7508313c18`::moving from state preparing -> state finished >Thread-55875::DEBUG::2014-05-16 18:20:33,215::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55875::DEBUG::2014-05-16 18:20:33,215::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55875::DEBUG::2014-05-16 18:20:33,215::task::974::TaskManager.Task::(_decref) Task=`8a0421d3-b555-42ef-a2f9-8f7508313c18`::ref 0 aborting False >Thread-55876::DEBUG::2014-05-16 18:20:33,223::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55876::DEBUG::2014-05-16 18:20:33,223::task::579::TaskManager.Task::(_updateState) Task=`a550ff06-f1e0-43a6-82b7-8fa97986ec34`::moving from state init -> state preparing >Thread-55876::INFO::2014-05-16 18:20:33,223::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55876::DEBUG::2014-05-16 18:20:33,224::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bb03fc8a-d742-4d63-a002-0311a8263132`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55876::DEBUG::2014-05-16 18:20:33,224::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55876::DEBUG::2014-05-16 18:20:33,224::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55876::DEBUG::2014-05-16 18:20:33,224::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bb03fc8a-d742-4d63-a002-0311a8263132`::Granted request >Thread-55876::DEBUG::2014-05-16 18:20:33,225::task::811::TaskManager.Task::(resourceAcquired) Task=`a550ff06-f1e0-43a6-82b7-8fa97986ec34`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55876::DEBUG::2014-05-16 18:20:33,225::task::974::TaskManager.Task::(_decref) Task=`a550ff06-f1e0-43a6-82b7-8fa97986ec34`::ref 1 aborting False >Thread-55876::INFO::2014-05-16 18:20:33,226::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55876::DEBUG::2014-05-16 18:20:33,226::task::1168::TaskManager.Task::(prepare) Task=`a550ff06-f1e0-43a6-82b7-8fa97986ec34`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55876::DEBUG::2014-05-16 18:20:33,226::task::579::TaskManager.Task::(_updateState) Task=`a550ff06-f1e0-43a6-82b7-8fa97986ec34`::moving from state preparing -> state finished >Thread-55876::DEBUG::2014-05-16 18:20:33,226::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55876::DEBUG::2014-05-16 18:20:33,226::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55876::DEBUG::2014-05-16 18:20:33,226::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55876::DEBUG::2014-05-16 18:20:33,227::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55876::DEBUG::2014-05-16 18:20:33,227::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55876::DEBUG::2014-05-16 18:20:33,227::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55876::DEBUG::2014-05-16 18:20:33,227::task::974::TaskManager.Task::(_decref) Task=`a550ff06-f1e0-43a6-82b7-8fa97986ec34`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:20:33,561::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:33,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357797 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:20:35,160::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:20:35,170::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107459 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:35,645::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:35,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350372 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:37,727::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:37,799::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352046 s, 29.1 MB/s\n'; <rc> = 0 >Thread-55879::DEBUG::2014-05-16 18:20:39,758::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318242.000000 / 8.008424 / 262500000.000000 = 0.205414 >Thread-55879::DEBUG::2014-05-16 18:20:39,758::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053898482698836276, 'statsAge': 1.2877249717712402, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20541426908229762, 'rxDropped': 0} >Thread-55879::DEBUG::2014-05-16 18:20:39,759::task::579::TaskManager.Task::(_updateState) Task=`f75838e5-5e53-4e10-bb62-7060027fc0b3`::moving from state init -> state preparing >Thread-55879::INFO::2014-05-16 18:20:39,759::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55879::INFO::2014-05-16 18:20:39,759::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107459', 'lastCheck': '4.6', 'valid': True}} >Thread-55879::DEBUG::2014-05-16 18:20:39,759::task::1168::TaskManager.Task::(prepare) Task=`f75838e5-5e53-4e10-bb62-7060027fc0b3`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107459', 'lastCheck': '4.6', 'valid': True}} >Thread-55879::DEBUG::2014-05-16 18:20:39,759::task::579::TaskManager.Task::(_updateState) Task=`f75838e5-5e53-4e10-bb62-7060027fc0b3`::moving from state preparing -> state finished >Thread-55879::DEBUG::2014-05-16 18:20:39,759::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55879::DEBUG::2014-05-16 18:20:39,760::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55879::DEBUG::2014-05-16 18:20:39,760::task::974::TaskManager.Task::(_decref) Task=`f75838e5-5e53-4e10-bb62-7060027fc0b3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:20:39,811::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:39,882::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354642 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:41,894::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:41,960::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298367 s, 34.3 MB/s\n'; <rc> = 0 >Thread-55882::DEBUG::2014-05-16 18:20:43,336::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55882::DEBUG::2014-05-16 18:20:43,337::task::579::TaskManager.Task::(_updateState) Task=`9056203f-f8a6-44f9-aaa6-01ebf0d81260`::moving from state init -> state preparing >Thread-55882::INFO::2014-05-16 18:20:43,337::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55882::INFO::2014-05-16 18:20:43,338::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55882::DEBUG::2014-05-16 18:20:43,338::task::1168::TaskManager.Task::(prepare) Task=`9056203f-f8a6-44f9-aaa6-01ebf0d81260`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55882::DEBUG::2014-05-16 18:20:43,338::task::579::TaskManager.Task::(_updateState) Task=`9056203f-f8a6-44f9-aaa6-01ebf0d81260`::moving from state preparing -> state finished >Thread-55882::DEBUG::2014-05-16 18:20:43,338::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55882::DEBUG::2014-05-16 18:20:43,338::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55882::DEBUG::2014-05-16 18:20:43,338::task::974::TaskManager.Task::(_decref) Task=`9056203f-f8a6-44f9-aaa6-01ebf0d81260`::ref 0 aborting False >Thread-55883::DEBUG::2014-05-16 18:20:43,347::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55883::DEBUG::2014-05-16 18:20:43,348::task::579::TaskManager.Task::(_updateState) Task=`4ab9e482-6190-4c43-a528-455f5b092d2f`::moving from state init -> state preparing >Thread-55883::INFO::2014-05-16 18:20:43,348::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55883::DEBUG::2014-05-16 18:20:43,348::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d51c263d-20b5-4ef0-9d54-6e1e8ffe693d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55883::DEBUG::2014-05-16 18:20:43,348::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55883::DEBUG::2014-05-16 18:20:43,349::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55883::DEBUG::2014-05-16 18:20:43,350::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d51c263d-20b5-4ef0-9d54-6e1e8ffe693d`::Granted request >Thread-55883::DEBUG::2014-05-16 18:20:43,350::task::811::TaskManager.Task::(resourceAcquired) Task=`4ab9e482-6190-4c43-a528-455f5b092d2f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55883::DEBUG::2014-05-16 18:20:43,350::task::974::TaskManager.Task::(_decref) Task=`4ab9e482-6190-4c43-a528-455f5b092d2f`::ref 1 aborting False >Thread-55883::INFO::2014-05-16 18:20:43,351::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55883::DEBUG::2014-05-16 18:20:43,351::task::1168::TaskManager.Task::(prepare) Task=`4ab9e482-6190-4c43-a528-455f5b092d2f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55883::DEBUG::2014-05-16 18:20:43,351::task::579::TaskManager.Task::(_updateState) Task=`4ab9e482-6190-4c43-a528-455f5b092d2f`::moving from state preparing -> state finished >Thread-55883::DEBUG::2014-05-16 18:20:43,351::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55883::DEBUG::2014-05-16 18:20:43,351::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55883::DEBUG::2014-05-16 18:20:43,352::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55883::DEBUG::2014-05-16 18:20:43,352::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55883::DEBUG::2014-05-16 18:20:43,352::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55883::DEBUG::2014-05-16 18:20:43,352::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55883::DEBUG::2014-05-16 18:20:43,352::task::974::TaskManager.Task::(_decref) Task=`4ab9e482-6190-4c43-a528-455f5b092d2f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:20:43,971::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:44,040::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03221 s, 31.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:20:45,207::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:20:45,218::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000817447 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:46,053::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:46,125::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347721 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:48,136::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:48,207::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351973 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:50,219::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:50,287::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310904 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:52,300::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:52,370::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350937 s, 29.2 MB/s\n'; <rc> = 0 >Thread-55887::DEBUG::2014-05-16 18:20:53,402::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55887::DEBUG::2014-05-16 18:20:53,403::task::579::TaskManager.Task::(_updateState) Task=`76ca0623-c20f-4b6a-89ae-4f21bc4efd39`::moving from state init -> state preparing >Thread-55887::INFO::2014-05-16 18:20:53,403::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55887::INFO::2014-05-16 18:20:53,404::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55887::DEBUG::2014-05-16 18:20:53,404::task::1168::TaskManager.Task::(prepare) Task=`76ca0623-c20f-4b6a-89ae-4f21bc4efd39`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55887::DEBUG::2014-05-16 18:20:53,404::task::579::TaskManager.Task::(_updateState) Task=`76ca0623-c20f-4b6a-89ae-4f21bc4efd39`::moving from state preparing -> state finished >Thread-55887::DEBUG::2014-05-16 18:20:53,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55887::DEBUG::2014-05-16 18:20:53,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55887::DEBUG::2014-05-16 18:20:53,404::task::974::TaskManager.Task::(_decref) Task=`76ca0623-c20f-4b6a-89ae-4f21bc4efd39`::ref 0 aborting False >Thread-55888::DEBUG::2014-05-16 18:20:53,412::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55888::DEBUG::2014-05-16 18:20:53,413::task::579::TaskManager.Task::(_updateState) Task=`0a127e7c-6917-43f4-a436-14d760583585`::moving from state init -> state preparing >Thread-55888::INFO::2014-05-16 18:20:53,413::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55888::DEBUG::2014-05-16 18:20:53,413::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`23e0d1c5-62b5-416a-a7b1-4fd1a2fc7d37`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55888::DEBUG::2014-05-16 18:20:53,414::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55888::DEBUG::2014-05-16 18:20:53,414::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55888::DEBUG::2014-05-16 18:20:53,414::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`23e0d1c5-62b5-416a-a7b1-4fd1a2fc7d37`::Granted request >Thread-55888::DEBUG::2014-05-16 18:20:53,414::task::811::TaskManager.Task::(resourceAcquired) Task=`0a127e7c-6917-43f4-a436-14d760583585`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55888::DEBUG::2014-05-16 18:20:53,414::task::974::TaskManager.Task::(_decref) Task=`0a127e7c-6917-43f4-a436-14d760583585`::ref 1 aborting False >Thread-55888::INFO::2014-05-16 18:20:53,415::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55888::DEBUG::2014-05-16 18:20:53,415::task::1168::TaskManager.Task::(prepare) Task=`0a127e7c-6917-43f4-a436-14d760583585`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55888::DEBUG::2014-05-16 18:20:53,415::task::579::TaskManager.Task::(_updateState) Task=`0a127e7c-6917-43f4-a436-14d760583585`::moving from state preparing -> state finished >Thread-55888::DEBUG::2014-05-16 18:20:53,416::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55888::DEBUG::2014-05-16 18:20:53,416::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55888::DEBUG::2014-05-16 18:20:53,416::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55888::DEBUG::2014-05-16 18:20:53,416::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55888::DEBUG::2014-05-16 18:20:53,416::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55888::DEBUG::2014-05-16 18:20:53,416::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55888::DEBUG::2014-05-16 18:20:53,417::task::974::TaskManager.Task::(_decref) Task=`0a127e7c-6917-43f4-a436-14d760583585`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:20:54,377::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:54,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357419 s, 28.6 MB/s\n'; <rc> = 0 >Thread-55889::DEBUG::2014-05-16 18:20:55,082::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314834.000000 / 8.008370 / 262500000.000000 = 0.205254 >Thread-55889::DEBUG::2014-05-16 18:20:55,082::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005385508160808212, 'statsAge': 0.59482884407043457, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20525353507104016, 'rxDropped': 0} >Thread-55889::DEBUG::2014-05-16 18:20:55,083::task::579::TaskManager.Task::(_updateState) Task=`4de3f36d-79fd-426c-a9e0-5a23e04e4a76`::moving from state init -> state preparing >Thread-55889::INFO::2014-05-16 18:20:55,083::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55889::INFO::2014-05-16 18:20:55,083::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000817447', 'lastCheck': '9.8', 'valid': True}} >Thread-55889::DEBUG::2014-05-16 18:20:55,083::task::1168::TaskManager.Task::(prepare) Task=`4de3f36d-79fd-426c-a9e0-5a23e04e4a76`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000817447', 'lastCheck': '9.8', 'valid': True}} >Thread-55889::DEBUG::2014-05-16 18:20:55,084::task::579::TaskManager.Task::(_updateState) Task=`4de3f36d-79fd-426c-a9e0-5a23e04e4a76`::moving from state preparing -> state finished >Thread-55889::DEBUG::2014-05-16 18:20:55,084::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55889::DEBUG::2014-05-16 18:20:55,084::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55889::DEBUG::2014-05-16 18:20:55,084::task::974::TaskManager.Task::(_decref) Task=`4de3f36d-79fd-426c-a9e0-5a23e04e4a76`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:20:55,255::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:20:55,266::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000829732 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:56,460::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:56,532::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353811 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:20:58,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:20:58,611::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307725 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:00,622::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:00,693::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346383 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:02,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:02,775::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339799 s, 30.1 MB/s\n'; <rc> = 0 >Thread-55893::DEBUG::2014-05-16 18:21:03,509::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55893::DEBUG::2014-05-16 18:21:03,510::task::579::TaskManager.Task::(_updateState) Task=`39c8883f-8a84-4ec7-96b8-70e78331bd7a`::moving from state init -> state preparing >Thread-55893::INFO::2014-05-16 18:21:03,510::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55893::INFO::2014-05-16 18:21:03,510::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55893::DEBUG::2014-05-16 18:21:03,510::task::1168::TaskManager.Task::(prepare) Task=`39c8883f-8a84-4ec7-96b8-70e78331bd7a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55893::DEBUG::2014-05-16 18:21:03,511::task::579::TaskManager.Task::(_updateState) Task=`39c8883f-8a84-4ec7-96b8-70e78331bd7a`::moving from state preparing -> state finished >Thread-55893::DEBUG::2014-05-16 18:21:03,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55893::DEBUG::2014-05-16 18:21:03,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55893::DEBUG::2014-05-16 18:21:03,511::task::974::TaskManager.Task::(_decref) Task=`39c8883f-8a84-4ec7-96b8-70e78331bd7a`::ref 0 aborting False >Thread-55894::DEBUG::2014-05-16 18:21:03,521::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55894::DEBUG::2014-05-16 18:21:03,521::task::579::TaskManager.Task::(_updateState) Task=`68046425-86ad-4c3f-81bd-595e9a4a2a73`::moving from state init -> state preparing >Thread-55894::INFO::2014-05-16 18:21:03,521::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55894::DEBUG::2014-05-16 18:21:03,522::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`863d8b6b-8f77-45f8-94a1-d32f6e1de5c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55894::DEBUG::2014-05-16 18:21:03,522::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55894::DEBUG::2014-05-16 18:21:03,522::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55894::DEBUG::2014-05-16 18:21:03,522::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`863d8b6b-8f77-45f8-94a1-d32f6e1de5c3`::Granted request >Thread-55894::DEBUG::2014-05-16 18:21:03,523::task::811::TaskManager.Task::(resourceAcquired) Task=`68046425-86ad-4c3f-81bd-595e9a4a2a73`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55894::DEBUG::2014-05-16 18:21:03,523::task::974::TaskManager.Task::(_decref) Task=`68046425-86ad-4c3f-81bd-595e9a4a2a73`::ref 1 aborting False >Thread-55894::INFO::2014-05-16 18:21:03,523::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55894::DEBUG::2014-05-16 18:21:03,524::task::1168::TaskManager.Task::(prepare) Task=`68046425-86ad-4c3f-81bd-595e9a4a2a73`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55894::DEBUG::2014-05-16 18:21:03,524::task::579::TaskManager.Task::(_updateState) Task=`68046425-86ad-4c3f-81bd-595e9a4a2a73`::moving from state preparing -> state finished >Thread-55894::DEBUG::2014-05-16 18:21:03,524::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55894::DEBUG::2014-05-16 18:21:03,524::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55894::DEBUG::2014-05-16 18:21:03,524::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55894::DEBUG::2014-05-16 18:21:03,524::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55894::DEBUG::2014-05-16 18:21:03,525::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55894::DEBUG::2014-05-16 18:21:03,525::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55894::DEBUG::2014-05-16 18:21:03,525::task::974::TaskManager.Task::(_decref) Task=`68046425-86ad-4c3f-81bd-595e9a4a2a73`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:21:04,787::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:04,855::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317648 s, 32.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:21:05,303::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:21:05,314::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000798804 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:06,866::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:06,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348709 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:08,949::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:09,022::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358921 s, 28.5 MB/s\n'; <rc> = 0 >Thread-55897::DEBUG::2014-05-16 18:21:10,331::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5418392.000000 / 8.008327 / 262500000.000000 = 0.257750 >Thread-55897::DEBUG::2014-05-16 18:21:10,331::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0068521059032588885, 'statsAge': 1.8270359039306641, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25775038050436488, 'rxDropped': 0} >Thread-55897::DEBUG::2014-05-16 18:21:10,331::task::579::TaskManager.Task::(_updateState) Task=`9278964a-5c66-4020-b103-ec75742b1d9e`::moving from state init -> state preparing >Thread-55897::INFO::2014-05-16 18:21:10,332::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55897::INFO::2014-05-16 18:21:10,332::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000798804', 'lastCheck': '5.0', 'valid': True}} >Thread-55897::DEBUG::2014-05-16 18:21:10,332::task::1168::TaskManager.Task::(prepare) Task=`9278964a-5c66-4020-b103-ec75742b1d9e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000798804', 'lastCheck': '5.0', 'valid': True}} >Thread-55897::DEBUG::2014-05-16 18:21:10,332::task::579::TaskManager.Task::(_updateState) Task=`9278964a-5c66-4020-b103-ec75742b1d9e`::moving from state preparing -> state finished >Thread-55897::DEBUG::2014-05-16 18:21:10,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55897::DEBUG::2014-05-16 18:21:10,333::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55897::DEBUG::2014-05-16 18:21:10,333::task::974::TaskManager.Task::(_decref) Task=`9278964a-5c66-4020-b103-ec75742b1d9e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:21:11,034::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:11,101::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301873 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:13,113::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:13,184::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035383 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55900::DEBUG::2014-05-16 18:21:13,570::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55900::DEBUG::2014-05-16 18:21:13,570::task::579::TaskManager.Task::(_updateState) Task=`bff6ad8b-b944-410e-b381-2a8445e91523`::moving from state init -> state preparing >Thread-55900::INFO::2014-05-16 18:21:13,571::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55900::INFO::2014-05-16 18:21:13,571::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55900::DEBUG::2014-05-16 18:21:13,571::task::1168::TaskManager.Task::(prepare) Task=`bff6ad8b-b944-410e-b381-2a8445e91523`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55900::DEBUG::2014-05-16 18:21:13,571::task::579::TaskManager.Task::(_updateState) Task=`bff6ad8b-b944-410e-b381-2a8445e91523`::moving from state preparing -> state finished >Thread-55900::DEBUG::2014-05-16 18:21:13,571::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55900::DEBUG::2014-05-16 18:21:13,571::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55900::DEBUG::2014-05-16 18:21:13,572::task::974::TaskManager.Task::(_decref) Task=`bff6ad8b-b944-410e-b381-2a8445e91523`::ref 0 aborting False >Thread-55901::DEBUG::2014-05-16 18:21:13,589::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55901::DEBUG::2014-05-16 18:21:13,590::task::579::TaskManager.Task::(_updateState) Task=`a06e0b15-08c8-46f9-88d0-40743227ad6c`::moving from state init -> state preparing >Thread-55901::INFO::2014-05-16 18:21:13,590::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55901::DEBUG::2014-05-16 18:21:13,590::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`71c03c28-bb79-4c7d-9d16-432a363d34a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55901::DEBUG::2014-05-16 18:21:13,590::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55901::DEBUG::2014-05-16 18:21:13,591::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55901::DEBUG::2014-05-16 18:21:13,591::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`71c03c28-bb79-4c7d-9d16-432a363d34a5`::Granted request >Thread-55901::DEBUG::2014-05-16 18:21:13,591::task::811::TaskManager.Task::(resourceAcquired) Task=`a06e0b15-08c8-46f9-88d0-40743227ad6c`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55901::DEBUG::2014-05-16 18:21:13,591::task::974::TaskManager.Task::(_decref) Task=`a06e0b15-08c8-46f9-88d0-40743227ad6c`::ref 1 aborting False >Thread-55901::INFO::2014-05-16 18:21:13,592::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55901::DEBUG::2014-05-16 18:21:13,592::task::1168::TaskManager.Task::(prepare) Task=`a06e0b15-08c8-46f9-88d0-40743227ad6c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55901::DEBUG::2014-05-16 18:21:13,592::task::579::TaskManager.Task::(_updateState) Task=`a06e0b15-08c8-46f9-88d0-40743227ad6c`::moving from state preparing -> state finished >Thread-55901::DEBUG::2014-05-16 18:21:13,592::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55901::DEBUG::2014-05-16 18:21:13,592::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55901::DEBUG::2014-05-16 18:21:13,592::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55901::DEBUG::2014-05-16 18:21:13,593::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55901::DEBUG::2014-05-16 18:21:13,593::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55901::DEBUG::2014-05-16 18:21:13,593::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55901::DEBUG::2014-05-16 18:21:13,593::task::974::TaskManager.Task::(_decref) Task=`a06e0b15-08c8-46f9-88d0-40743227ad6c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:21:15,195::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:15,263::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310441 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:21:15,351::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:21:15,362::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000840052 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:17,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:17,341::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311003 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:19,353::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:19,424::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351816 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:21,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:21,507::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348699 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:23,519::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:23,601::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342563 s, 29.9 MB/s\n'; <rc> = 0 >Thread-55905::DEBUG::2014-05-16 18:21:23,681::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55905::DEBUG::2014-05-16 18:21:23,682::task::579::TaskManager.Task::(_updateState) Task=`e204f0a0-914c-489f-9fc9-2821f2cd966a`::moving from state init -> state preparing >Thread-55905::INFO::2014-05-16 18:21:23,682::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55905::INFO::2014-05-16 18:21:23,682::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55905::DEBUG::2014-05-16 18:21:23,682::task::1168::TaskManager.Task::(prepare) Task=`e204f0a0-914c-489f-9fc9-2821f2cd966a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55905::DEBUG::2014-05-16 18:21:23,683::task::579::TaskManager.Task::(_updateState) Task=`e204f0a0-914c-489f-9fc9-2821f2cd966a`::moving from state preparing -> state finished >Thread-55905::DEBUG::2014-05-16 18:21:23,683::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55905::DEBUG::2014-05-16 18:21:23,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55905::DEBUG::2014-05-16 18:21:23,683::task::974::TaskManager.Task::(_decref) Task=`e204f0a0-914c-489f-9fc9-2821f2cd966a`::ref 0 aborting False >Thread-55906::DEBUG::2014-05-16 18:21:23,694::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55906::DEBUG::2014-05-16 18:21:23,694::task::579::TaskManager.Task::(_updateState) Task=`036b6f71-5f8f-40f1-8afa-5ab0880ed03e`::moving from state init -> state preparing >Thread-55906::INFO::2014-05-16 18:21:23,694::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55906::DEBUG::2014-05-16 18:21:23,695::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ebef5371-4b66-4b51-81ee-559926921872`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55906::DEBUG::2014-05-16 18:21:23,695::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55906::DEBUG::2014-05-16 18:21:23,695::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55906::DEBUG::2014-05-16 18:21:23,695::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ebef5371-4b66-4b51-81ee-559926921872`::Granted request >Thread-55906::DEBUG::2014-05-16 18:21:23,696::task::811::TaskManager.Task::(resourceAcquired) Task=`036b6f71-5f8f-40f1-8afa-5ab0880ed03e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55906::DEBUG::2014-05-16 18:21:23,696::task::974::TaskManager.Task::(_decref) Task=`036b6f71-5f8f-40f1-8afa-5ab0880ed03e`::ref 1 aborting False >Thread-55906::INFO::2014-05-16 18:21:23,697::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55906::DEBUG::2014-05-16 18:21:23,697::task::1168::TaskManager.Task::(prepare) Task=`036b6f71-5f8f-40f1-8afa-5ab0880ed03e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55906::DEBUG::2014-05-16 18:21:23,697::task::579::TaskManager.Task::(_updateState) Task=`036b6f71-5f8f-40f1-8afa-5ab0880ed03e`::moving from state preparing -> state finished >Thread-55906::DEBUG::2014-05-16 18:21:23,697::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55906::DEBUG::2014-05-16 18:21:23,697::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55906::DEBUG::2014-05-16 18:21:23,697::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55906::DEBUG::2014-05-16 18:21:23,698::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55906::DEBUG::2014-05-16 18:21:23,698::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55906::DEBUG::2014-05-16 18:21:23,698::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55906::DEBUG::2014-05-16 18:21:23,698::task::974::TaskManager.Task::(_decref) Task=`036b6f71-5f8f-40f1-8afa-5ab0880ed03e`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:21:25,399::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:21:25,410::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105911 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:25,616::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55907::DEBUG::2014-05-16 18:21:25,647::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5414530.000000 / 8.008307 / 262500000.000000 = 0.257567 >Thread-55907::DEBUG::2014-05-16 18:21:25,649::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066157018655759832, 'statsAge': 1.1257359981536865, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25756731108774555, 'rxDropped': 0} >Thread-55907::DEBUG::2014-05-16 18:21:25,651::task::579::TaskManager.Task::(_updateState) Task=`2f539f89-6a63-4931-a80a-b47a0a4814f1`::moving from state init -> state preparing >Thread-55907::INFO::2014-05-16 18:21:25,652::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55907::INFO::2014-05-16 18:21:25,654::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105911', 'lastCheck': '0.2', 'valid': True}} >Thread-55907::DEBUG::2014-05-16 18:21:25,655::task::1168::TaskManager.Task::(prepare) Task=`2f539f89-6a63-4931-a80a-b47a0a4814f1`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105911', 'lastCheck': '0.2', 'valid': True}} >Thread-55907::DEBUG::2014-05-16 18:21:25,657::task::579::TaskManager.Task::(_updateState) Task=`2f539f89-6a63-4931-a80a-b47a0a4814f1`::moving from state preparing -> state finished >Thread-55907::DEBUG::2014-05-16 18:21:25,658::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55907::DEBUG::2014-05-16 18:21:25,659::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55907::DEBUG::2014-05-16 18:21:25,661::task::974::TaskManager.Task::(_decref) Task=`2f539f89-6a63-4931-a80a-b47a0a4814f1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:21:25,733::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0732328 s, 14.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:27,745::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:27,815::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352034 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:29,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:29,895::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311408 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:31,907::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:31,975::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310263 s, 33.0 MB/s\n'; <rc> = 0 >Thread-55911::DEBUG::2014-05-16 18:21:33,741::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [db6c4f8] >Thread-55911::DEBUG::2014-05-16 18:21:33,742::task::579::TaskManager.Task::(_updateState) Task=`74ee1152-6121-4dda-85c1-f119c2462338`::moving from state init -> state preparing >Thread-55911::INFO::2014-05-16 18:21:33,742::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55911::INFO::2014-05-16 18:21:33,742::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55911::DEBUG::2014-05-16 18:21:33,742::task::1168::TaskManager.Task::(prepare) Task=`74ee1152-6121-4dda-85c1-f119c2462338`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55911::DEBUG::2014-05-16 18:21:33,743::task::579::TaskManager.Task::(_updateState) Task=`74ee1152-6121-4dda-85c1-f119c2462338`::moving from state preparing -> state finished >Thread-55911::DEBUG::2014-05-16 18:21:33,743::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55911::DEBUG::2014-05-16 18:21:33,743::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55911::DEBUG::2014-05-16 18:21:33,743::task::974::TaskManager.Task::(_decref) Task=`74ee1152-6121-4dda-85c1-f119c2462338`::ref 0 aborting False >Thread-55912::DEBUG::2014-05-16 18:21:33,763::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [db6c4f8] >Thread-55912::DEBUG::2014-05-16 18:21:33,764::task::579::TaskManager.Task::(_updateState) Task=`e041dcba-c8e2-48b5-be02-765b47943a8e`::moving from state init -> state preparing >Thread-55912::INFO::2014-05-16 18:21:33,764::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55912::DEBUG::2014-05-16 18:21:33,764::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`abb5ddda-7b8a-4f77-a9b0-6a83bb1cec65`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55912::DEBUG::2014-05-16 18:21:33,764::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55912::DEBUG::2014-05-16 18:21:33,765::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55912::DEBUG::2014-05-16 18:21:33,765::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`abb5ddda-7b8a-4f77-a9b0-6a83bb1cec65`::Granted request >Thread-55912::DEBUG::2014-05-16 18:21:33,766::task::811::TaskManager.Task::(resourceAcquired) Task=`e041dcba-c8e2-48b5-be02-765b47943a8e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55912::DEBUG::2014-05-16 18:21:33,766::task::974::TaskManager.Task::(_decref) Task=`e041dcba-c8e2-48b5-be02-765b47943a8e`::ref 1 aborting False >Thread-55912::INFO::2014-05-16 18:21:33,767::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55912::DEBUG::2014-05-16 18:21:33,767::task::1168::TaskManager.Task::(prepare) Task=`e041dcba-c8e2-48b5-be02-765b47943a8e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55912::DEBUG::2014-05-16 18:21:33,767::task::579::TaskManager.Task::(_updateState) Task=`e041dcba-c8e2-48b5-be02-765b47943a8e`::moving from state preparing -> state finished >Thread-55912::DEBUG::2014-05-16 18:21:33,767::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55912::DEBUG::2014-05-16 18:21:33,768::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55912::DEBUG::2014-05-16 18:21:33,768::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55912::DEBUG::2014-05-16 18:21:33,768::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55912::DEBUG::2014-05-16 18:21:33,768::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55912::DEBUG::2014-05-16 18:21:33,768::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55912::DEBUG::2014-05-16 18:21:33,769::task::974::TaskManager.Task::(_decref) Task=`e041dcba-c8e2-48b5-be02-765b47943a8e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:21:33,986::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:34,058::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357464 s, 28.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:21:35,445::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:21:35,455::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001015 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:36,070::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:36,140::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347811 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:38,152::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:38,224::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358152 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:40,236::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:40,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354943 s, 28.8 MB/s\n'; <rc> = 0 >Thread-55915::DEBUG::2014-05-16 18:21:40,854::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4335081.000000 / 8.008712 / 262500000.000000 = 0.206208 >Thread-55915::DEBUG::2014-05-16 18:21:40,854::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053831852943972552, 'statsAge': 0.31705594062805176, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20620786683061718, 'rxDropped': 0} >Thread-55915::DEBUG::2014-05-16 18:21:40,855::task::579::TaskManager.Task::(_updateState) Task=`428f0f06-61fe-4844-a89f-ebaeafdaba80`::moving from state init -> state preparing >Thread-55915::INFO::2014-05-16 18:21:40,856::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55915::INFO::2014-05-16 18:21:40,856::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.001015', 'lastCheck': '5.4', 'valid': True}} >Thread-55915::DEBUG::2014-05-16 18:21:40,856::task::1168::TaskManager.Task::(prepare) Task=`428f0f06-61fe-4844-a89f-ebaeafdaba80`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.001015', 'lastCheck': '5.4', 'valid': True}} >Thread-55915::DEBUG::2014-05-16 18:21:40,856::task::579::TaskManager.Task::(_updateState) Task=`428f0f06-61fe-4844-a89f-ebaeafdaba80`::moving from state preparing -> state finished >Thread-55915::DEBUG::2014-05-16 18:21:40,856::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55915::DEBUG::2014-05-16 18:21:40,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55915::DEBUG::2014-05-16 18:21:40,856::task::974::TaskManager.Task::(_decref) Task=`428f0f06-61fe-4844-a89f-ebaeafdaba80`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:21:42,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:42,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309065 s, 33.1 MB/s\n'; <rc> = 0 >Thread-55917::DEBUG::2014-05-16 18:21:43,814::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55917::DEBUG::2014-05-16 18:21:43,814::task::579::TaskManager.Task::(_updateState) Task=`0751e29e-c651-4242-b640-e86b1cc55dfd`::moving from state init -> state preparing >Thread-55917::INFO::2014-05-16 18:21:43,815::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55917::INFO::2014-05-16 18:21:43,815::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55917::DEBUG::2014-05-16 18:21:43,815::task::1168::TaskManager.Task::(prepare) Task=`0751e29e-c651-4242-b640-e86b1cc55dfd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55917::DEBUG::2014-05-16 18:21:43,815::task::579::TaskManager.Task::(_updateState) Task=`0751e29e-c651-4242-b640-e86b1cc55dfd`::moving from state preparing -> state finished >Thread-55917::DEBUG::2014-05-16 18:21:43,815::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55917::DEBUG::2014-05-16 18:21:43,815::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55917::DEBUG::2014-05-16 18:21:43,816::task::974::TaskManager.Task::(_decref) Task=`0751e29e-c651-4242-b640-e86b1cc55dfd`::ref 0 aborting False >Thread-55918::DEBUG::2014-05-16 18:21:43,845::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55918::DEBUG::2014-05-16 18:21:43,846::task::579::TaskManager.Task::(_updateState) Task=`c052b81b-4190-40be-a6a3-518a752a831d`::moving from state init -> state preparing >Thread-55918::INFO::2014-05-16 18:21:43,846::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55918::DEBUG::2014-05-16 18:21:43,846::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`013f0b07-a16f-4cff-875e-a455b95e66c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55918::DEBUG::2014-05-16 18:21:43,846::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55918::DEBUG::2014-05-16 18:21:43,847::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55918::DEBUG::2014-05-16 18:21:43,847::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`013f0b07-a16f-4cff-875e-a455b95e66c3`::Granted request >Thread-55918::DEBUG::2014-05-16 18:21:43,847::task::811::TaskManager.Task::(resourceAcquired) Task=`c052b81b-4190-40be-a6a3-518a752a831d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55918::DEBUG::2014-05-16 18:21:43,847::task::974::TaskManager.Task::(_decref) Task=`c052b81b-4190-40be-a6a3-518a752a831d`::ref 1 aborting False >Thread-55918::INFO::2014-05-16 18:21:43,848::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55918::DEBUG::2014-05-16 18:21:43,848::task::1168::TaskManager.Task::(prepare) Task=`c052b81b-4190-40be-a6a3-518a752a831d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55918::DEBUG::2014-05-16 18:21:43,848::task::579::TaskManager.Task::(_updateState) Task=`c052b81b-4190-40be-a6a3-518a752a831d`::moving from state preparing -> state finished >Thread-55918::DEBUG::2014-05-16 18:21:43,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55918::DEBUG::2014-05-16 18:21:43,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55918::DEBUG::2014-05-16 18:21:43,848::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55918::DEBUG::2014-05-16 18:21:43,849::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55918::DEBUG::2014-05-16 18:21:43,849::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55918::DEBUG::2014-05-16 18:21:43,849::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55918::DEBUG::2014-05-16 18:21:43,849::task::974::TaskManager.Task::(_decref) Task=`c052b81b-4190-40be-a6a3-518a752a831d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:21:44,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:44,464::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308573 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:21:45,474::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 18:21:45,474::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:21:45,492::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:21:45,500::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000708656 s, 2.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:21:45,501::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000708656 s, 2.9 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 18:21:45,501::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 18:21:45,501::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 18:21:45,501::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:21:45,502::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:21:45,502::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:21:45,502::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:21:45,502::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:21:45,503::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:21:45,503::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:21:45,783::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:21:45,785::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:21:45,785::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 18:21:45,786::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 18:21:45,786::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 18:21:45,786::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 18:21:45,787::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:21:45,934::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:21:45,954::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:21:45,964::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00056309 s, 7.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:46,476::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:46,547::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315658 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:48,561::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:48,634::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355766 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:50,645::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:50,712::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306522 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:52,724::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:52,800::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304447 s, 33.6 MB/s\n'; <rc> = 0 >Thread-55923::DEBUG::2014-05-16 18:21:53,912::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55923::DEBUG::2014-05-16 18:21:53,912::task::579::TaskManager.Task::(_updateState) Task=`603191f2-be7e-4cd8-89d7-c34de2090e3d`::moving from state init -> state preparing >Thread-55923::INFO::2014-05-16 18:21:53,912::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55923::INFO::2014-05-16 18:21:53,913::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55923::DEBUG::2014-05-16 18:21:53,913::task::1168::TaskManager.Task::(prepare) Task=`603191f2-be7e-4cd8-89d7-c34de2090e3d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55923::DEBUG::2014-05-16 18:21:53,913::task::579::TaskManager.Task::(_updateState) Task=`603191f2-be7e-4cd8-89d7-c34de2090e3d`::moving from state preparing -> state finished >Thread-55923::DEBUG::2014-05-16 18:21:53,913::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55923::DEBUG::2014-05-16 18:21:53,913::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55923::DEBUG::2014-05-16 18:21:53,913::task::974::TaskManager.Task::(_decref) Task=`603191f2-be7e-4cd8-89d7-c34de2090e3d`::ref 0 aborting False >Thread-55924::DEBUG::2014-05-16 18:21:53,928::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55924::DEBUG::2014-05-16 18:21:53,928::task::579::TaskManager.Task::(_updateState) Task=`f0a9406b-9b7b-41e2-9322-c4f87e2d09d8`::moving from state init -> state preparing >Thread-55924::INFO::2014-05-16 18:21:53,928::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55924::DEBUG::2014-05-16 18:21:53,929::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`755e6156-670f-4427-9bac-fdbe348393cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55924::DEBUG::2014-05-16 18:21:53,929::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55924::DEBUG::2014-05-16 18:21:53,929::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55924::DEBUG::2014-05-16 18:21:53,929::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`755e6156-670f-4427-9bac-fdbe348393cd`::Granted request >Thread-55924::DEBUG::2014-05-16 18:21:53,929::task::811::TaskManager.Task::(resourceAcquired) Task=`f0a9406b-9b7b-41e2-9322-c4f87e2d09d8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55924::DEBUG::2014-05-16 18:21:53,930::task::974::TaskManager.Task::(_decref) Task=`f0a9406b-9b7b-41e2-9322-c4f87e2d09d8`::ref 1 aborting False >Thread-55924::INFO::2014-05-16 18:21:53,930::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55924::DEBUG::2014-05-16 18:21:53,930::task::1168::TaskManager.Task::(prepare) Task=`f0a9406b-9b7b-41e2-9322-c4f87e2d09d8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55924::DEBUG::2014-05-16 18:21:53,931::task::579::TaskManager.Task::(_updateState) Task=`f0a9406b-9b7b-41e2-9322-c4f87e2d09d8`::moving from state preparing -> state finished >Thread-55924::DEBUG::2014-05-16 18:21:53,931::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55924::DEBUG::2014-05-16 18:21:53,931::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55924::DEBUG::2014-05-16 18:21:53,931::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55924::DEBUG::2014-05-16 18:21:53,931::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55924::DEBUG::2014-05-16 18:21:53,931::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55924::DEBUG::2014-05-16 18:21:53,932::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55924::DEBUG::2014-05-16 18:21:53,932::task::974::TaskManager.Task::(_decref) Task=`f0a9406b-9b7b-41e2-9322-c4f87e2d09d8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:21:54,812::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:54,884::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361203 s, 28.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:21:55,998::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:21:56,009::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000835466 s, 4.9 MB/s\n'; <rc> = 0 >Thread-55925::DEBUG::2014-05-16 18:21:56,042::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4433542.000000 / 8.012171 / 262500000.000000 = 0.210800 >Thread-55925::DEBUG::2014-05-16 18:21:56,042::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0056371380636220788, 'statsAge': 1.4861199855804443, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.21080034045940588, 'rxDropped': 0} >Thread-55925::DEBUG::2014-05-16 18:21:56,043::task::579::TaskManager.Task::(_updateState) Task=`ccee4245-5233-4fd0-a943-8d57e343833e`::moving from state init -> state preparing >Thread-55925::INFO::2014-05-16 18:21:56,043::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55925::INFO::2014-05-16 18:21:56,043::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000835466', 'lastCheck': '0.0', 'valid': True}} >Thread-55925::DEBUG::2014-05-16 18:21:56,043::task::1168::TaskManager.Task::(prepare) Task=`ccee4245-5233-4fd0-a943-8d57e343833e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000835466', 'lastCheck': '0.0', 'valid': True}} >Thread-55925::DEBUG::2014-05-16 18:21:56,043::task::579::TaskManager.Task::(_updateState) Task=`ccee4245-5233-4fd0-a943-8d57e343833e`::moving from state preparing -> state finished >Thread-55925::DEBUG::2014-05-16 18:21:56,044::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55925::DEBUG::2014-05-16 18:21:56,044::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55925::DEBUG::2014-05-16 18:21:56,044::task::974::TaskManager.Task::(_decref) Task=`ccee4245-5233-4fd0-a943-8d57e343833e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:21:56,896::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:56,967::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343878 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:21:58,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:21:59,048::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311616 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:01,060::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:01,133::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360833 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:03,144::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:03,215::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348005 s, 29.4 MB/s\n'; <rc> = 0 >Thread-55929::DEBUG::2014-05-16 18:22:04,176::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55929::DEBUG::2014-05-16 18:22:04,176::task::579::TaskManager.Task::(_updateState) Task=`84f29458-7ed2-4393-bb7a-16f76f73490d`::moving from state init -> state preparing >Thread-55929::INFO::2014-05-16 18:22:04,176::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55929::INFO::2014-05-16 18:22:04,177::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55929::DEBUG::2014-05-16 18:22:04,177::task::1168::TaskManager.Task::(prepare) Task=`84f29458-7ed2-4393-bb7a-16f76f73490d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55929::DEBUG::2014-05-16 18:22:04,177::task::579::TaskManager.Task::(_updateState) Task=`84f29458-7ed2-4393-bb7a-16f76f73490d`::moving from state preparing -> state finished >Thread-55929::DEBUG::2014-05-16 18:22:04,177::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55929::DEBUG::2014-05-16 18:22:04,177::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55929::DEBUG::2014-05-16 18:22:04,178::task::974::TaskManager.Task::(_decref) Task=`84f29458-7ed2-4393-bb7a-16f76f73490d`::ref 0 aborting False >Thread-55930::DEBUG::2014-05-16 18:22:04,194::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55930::DEBUG::2014-05-16 18:22:04,194::task::579::TaskManager.Task::(_updateState) Task=`80029c8d-60c5-407b-97ce-4b3b5ff4a00e`::moving from state init -> state preparing >Thread-55930::INFO::2014-05-16 18:22:04,194::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55930::DEBUG::2014-05-16 18:22:04,195::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b5f462c0-8cfc-44c3-800e-a06467e56af7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55930::DEBUG::2014-05-16 18:22:04,195::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55930::DEBUG::2014-05-16 18:22:04,195::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55930::DEBUG::2014-05-16 18:22:04,195::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b5f462c0-8cfc-44c3-800e-a06467e56af7`::Granted request >Thread-55930::DEBUG::2014-05-16 18:22:04,195::task::811::TaskManager.Task::(resourceAcquired) Task=`80029c8d-60c5-407b-97ce-4b3b5ff4a00e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55930::DEBUG::2014-05-16 18:22:04,196::task::974::TaskManager.Task::(_decref) Task=`80029c8d-60c5-407b-97ce-4b3b5ff4a00e`::ref 1 aborting False >Thread-55930::INFO::2014-05-16 18:22:04,196::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55930::DEBUG::2014-05-16 18:22:04,196::task::1168::TaskManager.Task::(prepare) Task=`80029c8d-60c5-407b-97ce-4b3b5ff4a00e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55930::DEBUG::2014-05-16 18:22:04,197::task::579::TaskManager.Task::(_updateState) Task=`80029c8d-60c5-407b-97ce-4b3b5ff4a00e`::moving from state preparing -> state finished >Thread-55930::DEBUG::2014-05-16 18:22:04,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55930::DEBUG::2014-05-16 18:22:04,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55930::DEBUG::2014-05-16 18:22:04,197::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55930::DEBUG::2014-05-16 18:22:04,197::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55930::DEBUG::2014-05-16 18:22:04,197::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55930::DEBUG::2014-05-16 18:22:04,198::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55930::DEBUG::2014-05-16 18:22:04,198::task::974::TaskManager.Task::(_decref) Task=`80029c8d-60c5-407b-97ce-4b3b5ff4a00e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:22:05,227::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:05,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304451 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:22:06,046::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:22:06,056::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678822 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:07,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:07,376::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347382 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:09,388::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:09,460::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363297 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:11,472::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:11,540::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309991 s, 33.0 MB/s\n'; <rc> = 0 >Thread-55933::DEBUG::2014-05-16 18:22:11,771::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5415802.000000 / 8.008402 / 262500000.000000 = 0.257625 >Thread-55933::DEBUG::2014-05-16 18:22:11,771::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066485410885377665, 'statsAge': 1.1979730129241943, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25762475941491503, 'rxDropped': 0} >Thread-55933::DEBUG::2014-05-16 18:22:11,771::task::579::TaskManager.Task::(_updateState) Task=`541d2db1-7aff-4cfb-b41e-0d45129685ad`::moving from state init -> state preparing >Thread-55933::INFO::2014-05-16 18:22:11,772::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55933::INFO::2014-05-16 18:22:11,772::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678822', 'lastCheck': '5.7', 'valid': True}} >Thread-55933::DEBUG::2014-05-16 18:22:11,772::task::1168::TaskManager.Task::(prepare) Task=`541d2db1-7aff-4cfb-b41e-0d45129685ad`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678822', 'lastCheck': '5.7', 'valid': True}} >Thread-55933::DEBUG::2014-05-16 18:22:11,772::task::579::TaskManager.Task::(_updateState) Task=`541d2db1-7aff-4cfb-b41e-0d45129685ad`::moving from state preparing -> state finished >Thread-55933::DEBUG::2014-05-16 18:22:11,772::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55933::DEBUG::2014-05-16 18:22:11,772::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55933::DEBUG::2014-05-16 18:22:11,773::task::974::TaskManager.Task::(_decref) Task=`541d2db1-7aff-4cfb-b41e-0d45129685ad`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:22:13,551::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:13,619::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313648 s, 32.6 MB/s\n'; <rc> = 0 >Thread-55935::DEBUG::2014-05-16 18:22:14,236::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55935::DEBUG::2014-05-16 18:22:14,237::task::579::TaskManager.Task::(_updateState) Task=`16a53820-9803-48e7-9f1f-5a25ef56781a`::moving from state init -> state preparing >Thread-55935::INFO::2014-05-16 18:22:14,237::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55935::INFO::2014-05-16 18:22:14,237::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55935::DEBUG::2014-05-16 18:22:14,237::task::1168::TaskManager.Task::(prepare) Task=`16a53820-9803-48e7-9f1f-5a25ef56781a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55935::DEBUG::2014-05-16 18:22:14,237::task::579::TaskManager.Task::(_updateState) Task=`16a53820-9803-48e7-9f1f-5a25ef56781a`::moving from state preparing -> state finished >Thread-55935::DEBUG::2014-05-16 18:22:14,238::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55935::DEBUG::2014-05-16 18:22:14,238::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55935::DEBUG::2014-05-16 18:22:14,238::task::974::TaskManager.Task::(_decref) Task=`16a53820-9803-48e7-9f1f-5a25ef56781a`::ref 0 aborting False >Thread-55936::DEBUG::2014-05-16 18:22:14,255::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55936::DEBUG::2014-05-16 18:22:14,255::task::579::TaskManager.Task::(_updateState) Task=`e01967d5-b521-466f-a89d-d166ff9762e5`::moving from state init -> state preparing >Thread-55936::INFO::2014-05-16 18:22:14,255::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55936::DEBUG::2014-05-16 18:22:14,256::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a53c8f18-5cc0-41f0-8c4e-9637b7b13546`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55936::DEBUG::2014-05-16 18:22:14,256::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55936::DEBUG::2014-05-16 18:22:14,256::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55936::DEBUG::2014-05-16 18:22:14,256::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a53c8f18-5cc0-41f0-8c4e-9637b7b13546`::Granted request >Thread-55936::DEBUG::2014-05-16 18:22:14,256::task::811::TaskManager.Task::(resourceAcquired) Task=`e01967d5-b521-466f-a89d-d166ff9762e5`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55936::DEBUG::2014-05-16 18:22:14,257::task::974::TaskManager.Task::(_decref) Task=`e01967d5-b521-466f-a89d-d166ff9762e5`::ref 1 aborting False >Thread-55936::INFO::2014-05-16 18:22:14,257::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55936::DEBUG::2014-05-16 18:22:14,257::task::1168::TaskManager.Task::(prepare) Task=`e01967d5-b521-466f-a89d-d166ff9762e5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55936::DEBUG::2014-05-16 18:22:14,258::task::579::TaskManager.Task::(_updateState) Task=`e01967d5-b521-466f-a89d-d166ff9762e5`::moving from state preparing -> state finished >Thread-55936::DEBUG::2014-05-16 18:22:14,258::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55936::DEBUG::2014-05-16 18:22:14,258::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55936::DEBUG::2014-05-16 18:22:14,258::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55936::DEBUG::2014-05-16 18:22:14,258::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55936::DEBUG::2014-05-16 18:22:14,258::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55936::DEBUG::2014-05-16 18:22:14,259::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55936::DEBUG::2014-05-16 18:22:14,259::task::974::TaskManager.Task::(_decref) Task=`e01967d5-b521-466f-a89d-d166ff9762e5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:22:15,630::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:15,701::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035097 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:22:16,093::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:22:16,104::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000839533 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:17,713::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:17,779::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030326 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:19,791::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:19,859::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321579 s, 31.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:21,871::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:21,941::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349509 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:23,953::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:24,031::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400247 s, 25.6 MB/s\n'; <rc> = 0 >Thread-55941::DEBUG::2014-05-16 18:22:24,304::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55941::DEBUG::2014-05-16 18:22:24,304::task::579::TaskManager.Task::(_updateState) Task=`104543ca-d6d9-4fa8-8542-fabeae8e8f4d`::moving from state init -> state preparing >Thread-55941::INFO::2014-05-16 18:22:24,305::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55941::INFO::2014-05-16 18:22:24,305::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55941::DEBUG::2014-05-16 18:22:24,305::task::1168::TaskManager.Task::(prepare) Task=`104543ca-d6d9-4fa8-8542-fabeae8e8f4d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55941::DEBUG::2014-05-16 18:22:24,305::task::579::TaskManager.Task::(_updateState) Task=`104543ca-d6d9-4fa8-8542-fabeae8e8f4d`::moving from state preparing -> state finished >Thread-55941::DEBUG::2014-05-16 18:22:24,305::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55941::DEBUG::2014-05-16 18:22:24,306::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55941::DEBUG::2014-05-16 18:22:24,306::task::974::TaskManager.Task::(_decref) Task=`104543ca-d6d9-4fa8-8542-fabeae8e8f4d`::ref 0 aborting False >Thread-55942::DEBUG::2014-05-16 18:22:24,323::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55942::DEBUG::2014-05-16 18:22:24,324::task::579::TaskManager.Task::(_updateState) Task=`8ec50320-8de5-458b-a278-4f89c372307c`::moving from state init -> state preparing >Thread-55942::INFO::2014-05-16 18:22:24,324::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55942::DEBUG::2014-05-16 18:22:24,324::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`606b01e4-a901-4f50-8d6d-8c90a5dda14c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55942::DEBUG::2014-05-16 18:22:24,324::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55942::DEBUG::2014-05-16 18:22:24,325::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55942::DEBUG::2014-05-16 18:22:24,325::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`606b01e4-a901-4f50-8d6d-8c90a5dda14c`::Granted request >Thread-55942::DEBUG::2014-05-16 18:22:24,326::task::811::TaskManager.Task::(resourceAcquired) Task=`8ec50320-8de5-458b-a278-4f89c372307c`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55942::DEBUG::2014-05-16 18:22:24,326::task::974::TaskManager.Task::(_decref) Task=`8ec50320-8de5-458b-a278-4f89c372307c`::ref 1 aborting False >Thread-55942::INFO::2014-05-16 18:22:24,327::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55942::DEBUG::2014-05-16 18:22:24,327::task::1168::TaskManager.Task::(prepare) Task=`8ec50320-8de5-458b-a278-4f89c372307c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55942::DEBUG::2014-05-16 18:22:24,327::task::579::TaskManager.Task::(_updateState) Task=`8ec50320-8de5-458b-a278-4f89c372307c`::moving from state preparing -> state finished >Thread-55942::DEBUG::2014-05-16 18:22:24,327::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55942::DEBUG::2014-05-16 18:22:24,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55942::DEBUG::2014-05-16 18:22:24,328::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55942::DEBUG::2014-05-16 18:22:24,328::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55942::DEBUG::2014-05-16 18:22:24,328::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55942::DEBUG::2014-05-16 18:22:24,328::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55942::DEBUG::2014-05-16 18:22:24,328::task::974::TaskManager.Task::(_decref) Task=`8ec50320-8de5-458b-a278-4f89c372307c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:22:26,043::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:26,110::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305027 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:22:26,142::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:22:26,152::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737561 s, 5.6 MB/s\n'; <rc> = 0 >Thread-55943::DEBUG::2014-05-16 18:22:26,996::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4342605.000000 / 8.008408 / 262500000.000000 = 0.206574 >Thread-55943::DEBUG::2014-05-16 18:22:26,996::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0055642473315609389, 'statsAge': 0.40680909156799316, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20657360978074404, 'rxDropped': 0} >Thread-55943::DEBUG::2014-05-16 18:22:26,997::task::579::TaskManager.Task::(_updateState) Task=`0c5ccc7f-60bb-4b34-ad0c-ff10be42cb59`::moving from state init -> state preparing >Thread-55943::INFO::2014-05-16 18:22:26,997::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55943::INFO::2014-05-16 18:22:26,997::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737561', 'lastCheck': '0.8', 'valid': True}} >Thread-55943::DEBUG::2014-05-16 18:22:26,997::task::1168::TaskManager.Task::(prepare) Task=`0c5ccc7f-60bb-4b34-ad0c-ff10be42cb59`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737561', 'lastCheck': '0.8', 'valid': True}} >Thread-55943::DEBUG::2014-05-16 18:22:26,997::task::579::TaskManager.Task::(_updateState) Task=`0c5ccc7f-60bb-4b34-ad0c-ff10be42cb59`::moving from state preparing -> state finished >Thread-55943::DEBUG::2014-05-16 18:22:26,998::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55943::DEBUG::2014-05-16 18:22:26,998::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55943::DEBUG::2014-05-16 18:22:26,998::task::974::TaskManager.Task::(_decref) Task=`0c5ccc7f-60bb-4b34-ad0c-ff10be42cb59`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:22:28,122::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:28,193::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348673 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:30,204::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:30,271::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313668 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:32,283::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:32,350::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307264 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:34,362::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55947::DEBUG::2014-05-16 18:22:34,362::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55947::DEBUG::2014-05-16 18:22:34,371::task::579::TaskManager.Task::(_updateState) Task=`2f2e4245-c9fe-4ad9-b1d4-38e43a2b37c6`::moving from state init -> state preparing >Thread-55947::INFO::2014-05-16 18:22:34,372::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55947::INFO::2014-05-16 18:22:34,372::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55947::DEBUG::2014-05-16 18:22:34,372::task::1168::TaskManager.Task::(prepare) Task=`2f2e4245-c9fe-4ad9-b1d4-38e43a2b37c6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55947::DEBUG::2014-05-16 18:22:34,372::task::579::TaskManager.Task::(_updateState) Task=`2f2e4245-c9fe-4ad9-b1d4-38e43a2b37c6`::moving from state preparing -> state finished >Thread-55947::DEBUG::2014-05-16 18:22:34,373::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55947::DEBUG::2014-05-16 18:22:34,373::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55947::DEBUG::2014-05-16 18:22:34,373::task::974::TaskManager.Task::(_decref) Task=`2f2e4245-c9fe-4ad9-b1d4-38e43a2b37c6`::ref 0 aborting False >Thread-55948::DEBUG::2014-05-16 18:22:34,393::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55948::DEBUG::2014-05-16 18:22:34,394::task::579::TaskManager.Task::(_updateState) Task=`4ab6119d-3c46-49bc-9ca0-80a752764bd7`::moving from state init -> state preparing >Thread-55948::INFO::2014-05-16 18:22:34,395::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55948::DEBUG::2014-05-16 18:22:34,397::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c2b7bcb0-a5f4-4ccd-991c-2acb4d088906`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55948::DEBUG::2014-05-16 18:22:34,398::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55948::DEBUG::2014-05-16 18:22:34,399::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55948::DEBUG::2014-05-16 18:22:34,400::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c2b7bcb0-a5f4-4ccd-991c-2acb4d088906`::Granted request >Thread-55948::DEBUG::2014-05-16 18:22:34,402::task::811::TaskManager.Task::(resourceAcquired) Task=`4ab6119d-3c46-49bc-9ca0-80a752764bd7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55948::DEBUG::2014-05-16 18:22:34,403::task::974::TaskManager.Task::(_decref) Task=`4ab6119d-3c46-49bc-9ca0-80a752764bd7`::ref 1 aborting False >Thread-55948::INFO::2014-05-16 18:22:34,407::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55948::DEBUG::2014-05-16 18:22:34,407::task::1168::TaskManager.Task::(prepare) Task=`4ab6119d-3c46-49bc-9ca0-80a752764bd7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55948::DEBUG::2014-05-16 18:22:34,408::task::579::TaskManager.Task::(_updateState) Task=`4ab6119d-3c46-49bc-9ca0-80a752764bd7`::moving from state preparing -> state finished >Thread-55948::DEBUG::2014-05-16 18:22:34,409::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55948::DEBUG::2014-05-16 18:22:34,410::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55948::DEBUG::2014-05-16 18:22:34,411::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55948::DEBUG::2014-05-16 18:22:34,412::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55948::DEBUG::2014-05-16 18:22:34,413::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55948::DEBUG::2014-05-16 18:22:34,414::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55948::DEBUG::2014-05-16 18:22:34,415::task::974::TaskManager.Task::(_decref) Task=`4ab6119d-3c46-49bc-9ca0-80a752764bd7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:22:34,463::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0629432 s, 16.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:22:36,187::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:22:36,197::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104846 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:36,474::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:36,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355968 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:38,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:38,632::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353951 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:40,643::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:40,710::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306076 s, 33.5 MB/s\n'; <rc> = 0 >Thread-55951::DEBUG::2014-05-16 18:22:42,204::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318801.000000 / 8.011189 / 262500000.000000 = 0.205370 >Thread-55951::DEBUG::2014-05-16 18:22:42,204::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053671598735245754, 'statsAge': 1.5970897674560547, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20536994922332111, 'rxDropped': 0} >Thread-55951::DEBUG::2014-05-16 18:22:42,205::task::579::TaskManager.Task::(_updateState) Task=`8cc2a4e9-8cd4-441e-8e31-9cc73c720354`::moving from state init -> state preparing >Thread-55951::INFO::2014-05-16 18:22:42,205::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55951::INFO::2014-05-16 18:22:42,205::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104846', 'lastCheck': '6.0', 'valid': True}} >Thread-55951::DEBUG::2014-05-16 18:22:42,205::task::1168::TaskManager.Task::(prepare) Task=`8cc2a4e9-8cd4-441e-8e31-9cc73c720354`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104846', 'lastCheck': '6.0', 'valid': True}} >Thread-55951::DEBUG::2014-05-16 18:22:42,205::task::579::TaskManager.Task::(_updateState) Task=`8cc2a4e9-8cd4-441e-8e31-9cc73c720354`::moving from state preparing -> state finished >Thread-55951::DEBUG::2014-05-16 18:22:42,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55951::DEBUG::2014-05-16 18:22:42,206::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55951::DEBUG::2014-05-16 18:22:42,206::task::974::TaskManager.Task::(_decref) Task=`8cc2a4e9-8cd4-441e-8e31-9cc73c720354`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:22:42,722::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:42,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354329 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55953::DEBUG::2014-05-16 18:22:44,451::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55953::DEBUG::2014-05-16 18:22:44,451::task::579::TaskManager.Task::(_updateState) Task=`f938f94a-3335-4ceb-9783-dd75e8a711ec`::moving from state init -> state preparing >Thread-55953::INFO::2014-05-16 18:22:44,451::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55953::INFO::2014-05-16 18:22:44,452::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55953::DEBUG::2014-05-16 18:22:44,452::task::1168::TaskManager.Task::(prepare) Task=`f938f94a-3335-4ceb-9783-dd75e8a711ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55953::DEBUG::2014-05-16 18:22:44,452::task::579::TaskManager.Task::(_updateState) Task=`f938f94a-3335-4ceb-9783-dd75e8a711ec`::moving from state preparing -> state finished >Thread-55953::DEBUG::2014-05-16 18:22:44,452::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55953::DEBUG::2014-05-16 18:22:44,452::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55953::DEBUG::2014-05-16 18:22:44,452::task::974::TaskManager.Task::(_decref) Task=`f938f94a-3335-4ceb-9783-dd75e8a711ec`::ref 0 aborting False >Thread-55954::DEBUG::2014-05-16 18:22:44,462::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55954::DEBUG::2014-05-16 18:22:44,463::task::579::TaskManager.Task::(_updateState) Task=`8e7a23ac-623d-4184-985d-de53d4b3f435`::moving from state init -> state preparing >Thread-55954::INFO::2014-05-16 18:22:44,463::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55954::DEBUG::2014-05-16 18:22:44,463::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4e823492-8ec4-49c8-8a15-6d4ea2a39625`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55954::DEBUG::2014-05-16 18:22:44,463::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55954::DEBUG::2014-05-16 18:22:44,463::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55954::DEBUG::2014-05-16 18:22:44,464::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4e823492-8ec4-49c8-8a15-6d4ea2a39625`::Granted request >Thread-55954::DEBUG::2014-05-16 18:22:44,464::task::811::TaskManager.Task::(resourceAcquired) Task=`8e7a23ac-623d-4184-985d-de53d4b3f435`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55954::DEBUG::2014-05-16 18:22:44,464::task::974::TaskManager.Task::(_decref) Task=`8e7a23ac-623d-4184-985d-de53d4b3f435`::ref 1 aborting False >Thread-55954::INFO::2014-05-16 18:22:44,465::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55954::DEBUG::2014-05-16 18:22:44,465::task::1168::TaskManager.Task::(prepare) Task=`8e7a23ac-623d-4184-985d-de53d4b3f435`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55954::DEBUG::2014-05-16 18:22:44,465::task::579::TaskManager.Task::(_updateState) Task=`8e7a23ac-623d-4184-985d-de53d4b3f435`::moving from state preparing -> state finished >Thread-55954::DEBUG::2014-05-16 18:22:44,465::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55954::DEBUG::2014-05-16 18:22:44,465::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55954::DEBUG::2014-05-16 18:22:44,465::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55954::DEBUG::2014-05-16 18:22:44,466::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55954::DEBUG::2014-05-16 18:22:44,466::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55954::DEBUG::2014-05-16 18:22:44,466::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55954::DEBUG::2014-05-16 18:22:44,466::task::974::TaskManager.Task::(_decref) Task=`8e7a23ac-623d-4184-985d-de53d4b3f435`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:22:44,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:44,872::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307872 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:22:46,234::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:22:46,244::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000800288 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:46,884::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:46,949::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306418 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:48,961::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:49,033::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357202 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:51,045::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:51,113::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307212 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:53,125::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:53,196::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354302 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55959::DEBUG::2014-05-16 18:22:54,504::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55959::DEBUG::2014-05-16 18:22:54,505::task::579::TaskManager.Task::(_updateState) Task=`95ae9925-e781-49c4-b76d-a44232002f37`::moving from state init -> state preparing >Thread-55959::INFO::2014-05-16 18:22:54,505::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55959::INFO::2014-05-16 18:22:54,505::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55959::DEBUG::2014-05-16 18:22:54,505::task::1168::TaskManager.Task::(prepare) Task=`95ae9925-e781-49c4-b76d-a44232002f37`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55959::DEBUG::2014-05-16 18:22:54,506::task::579::TaskManager.Task::(_updateState) Task=`95ae9925-e781-49c4-b76d-a44232002f37`::moving from state preparing -> state finished >Thread-55959::DEBUG::2014-05-16 18:22:54,506::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55959::DEBUG::2014-05-16 18:22:54,506::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55959::DEBUG::2014-05-16 18:22:54,506::task::974::TaskManager.Task::(_decref) Task=`95ae9925-e781-49c4-b76d-a44232002f37`::ref 0 aborting False >Thread-55960::DEBUG::2014-05-16 18:22:54,525::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55960::DEBUG::2014-05-16 18:22:54,525::task::579::TaskManager.Task::(_updateState) Task=`5ffe37c6-fcbc-4942-a438-8a3cce5f5148`::moving from state init -> state preparing >Thread-55960::INFO::2014-05-16 18:22:54,525::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55960::DEBUG::2014-05-16 18:22:54,526::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b9d5c77d-d494-450e-b129-7d4729b4d1ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55960::DEBUG::2014-05-16 18:22:54,526::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55960::DEBUG::2014-05-16 18:22:54,526::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55960::DEBUG::2014-05-16 18:22:54,526::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b9d5c77d-d494-450e-b129-7d4729b4d1ed`::Granted request >Thread-55960::DEBUG::2014-05-16 18:22:54,527::task::811::TaskManager.Task::(resourceAcquired) Task=`5ffe37c6-fcbc-4942-a438-8a3cce5f5148`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55960::DEBUG::2014-05-16 18:22:54,527::task::974::TaskManager.Task::(_decref) Task=`5ffe37c6-fcbc-4942-a438-8a3cce5f5148`::ref 1 aborting False >Thread-55960::INFO::2014-05-16 18:22:54,527::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55960::DEBUG::2014-05-16 18:22:54,527::task::1168::TaskManager.Task::(prepare) Task=`5ffe37c6-fcbc-4942-a438-8a3cce5f5148`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55960::DEBUG::2014-05-16 18:22:54,528::task::579::TaskManager.Task::(_updateState) Task=`5ffe37c6-fcbc-4942-a438-8a3cce5f5148`::moving from state preparing -> state finished >Thread-55960::DEBUG::2014-05-16 18:22:54,528::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55960::DEBUG::2014-05-16 18:22:54,528::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55960::DEBUG::2014-05-16 18:22:54,528::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55960::DEBUG::2014-05-16 18:22:54,528::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55960::DEBUG::2014-05-16 18:22:54,529::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55960::DEBUG::2014-05-16 18:22:54,529::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55960::DEBUG::2014-05-16 18:22:54,529::task::974::TaskManager.Task::(_decref) Task=`5ffe37c6-fcbc-4942-a438-8a3cce5f5148`::ref 0 aborting False >Thread-55961::DEBUG::2014-05-16 18:22:54,558::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [6ba031a4] >Thread-55961::DEBUG::2014-05-16 18:22:54,558::task::579::TaskManager.Task::(_updateState) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::moving from state init -> state preparing >Thread-55961::INFO::2014-05-16 18:22:54,558::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='f26629d9-43c3-42cd-a3e6-93cb35cb35c7', postZero='false', force='false') >Thread-55961::DEBUG::2014-05-16 18:22:54,559::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f26629d9-43c3-42cd-a3e6-93cb35cb35c7`ReqID=`eb434889-3b62-4486-a747-dd3e9e9f2e87`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1526' at 'deleteImage' >Thread-55961::DEBUG::2014-05-16 18:22:54,559::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f26629d9-43c3-42cd-a3e6-93cb35cb35c7' for lock type 'exclusive' >Thread-55961::DEBUG::2014-05-16 18:22:54,559::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f26629d9-43c3-42cd-a3e6-93cb35cb35c7' is free. Now locking as 'exclusive' (1 active user) >Thread-55961::DEBUG::2014-05-16 18:22:54,559::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f26629d9-43c3-42cd-a3e6-93cb35cb35c7`ReqID=`eb434889-3b62-4486-a747-dd3e9e9f2e87`::Granted request >Thread-55961::DEBUG::2014-05-16 18:22:54,560::task::811::TaskManager.Task::(resourceAcquired) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::_resourcesAcquired: Storage.f26629d9-43c3-42cd-a3e6-93cb35cb35c7 (exclusive) >Thread-55961::DEBUG::2014-05-16 18:22:54,560::task::974::TaskManager.Task::(_decref) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::ref 1 aborting False >Thread-55961::DEBUG::2014-05-16 18:22:54,560::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`26c32bd0-77af-486a-8f9f-9a72bf68ad7c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1527' at 'deleteImage' >Thread-55961::DEBUG::2014-05-16 18:22:54,560::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55961::DEBUG::2014-05-16 18:22:54,560::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55961::DEBUG::2014-05-16 18:22:54,561::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`26c32bd0-77af-486a-8f9f-9a72bf68ad7c`::Granted request >Thread-55961::DEBUG::2014-05-16 18:22:54,561::task::811::TaskManager.Task::(resourceAcquired) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55961::DEBUG::2014-05-16 18:22:54,561::task::974::TaskManager.Task::(_decref) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::ref 1 aborting False >Thread-55961::DEBUG::2014-05-16 18:22:54,561::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55961::DEBUG::2014-05-16 18:22:54,562::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55961::DEBUG::2014-05-16 18:22:54,707::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55961::DEBUG::2014-05-16 18:22:54,722::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55961::DEBUG::2014-05-16 18:22:54,723::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55961::DEBUG::2014-05-16 18:22:54,724::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n -a y --deltag IU_f26629d9-43c3-42cd-a3e6-93cb35cb35c7 --addtag IU__remove_me_f26629d9-43c3-42cd-a3e6-93cb35cb35c7 f79908bf-a757-4a71-9ab5-3a12ede5f65c/2b9374f4-1eca-47cb-a470-59600aae5d57' (cwd None) >Thread-55961::DEBUG::2014-05-16 18:22:55,003::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-55961::DEBUG::2014-05-16 18:22:55,003::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55961::DEBUG::2014-05-16 18:22:55,004::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55961::WARNING::2014-05-16 18:22:55,004::lvm::1108::Storage.LVM::(removeLVs) Removing active volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/2b9374f4-1eca-47cb-a470-59600aae5d57 >Thread-55961::DEBUG::2014-05-16 18:22:55,005::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n f79908bf-a757-4a71-9ab5-3a12ede5f65c/2b9374f4-1eca-47cb-a470-59600aae5d57' (cwd None) >Thread-55961::DEBUG::2014-05-16 18:22:55,181::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-55961::DEBUG::2014-05-16 18:22:55,182::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55961::DEBUG::2014-05-16 18:22:55,187::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55961::DEBUG::2014-05-16 18:22:55,188::blockSD::935::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7/2b9374f4-1eca-47cb-a470-59600aae5d57'] >Thread-55961::DEBUG::2014-05-16 18:22:55,188::blockSD::946::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/f26629d9-43c3-42cd-a3e6-93cb35cb35c7 >Thread-55961::DEBUG::2014-05-16 18:22:55,190::task::736::TaskManager.Task::(_save) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3eddba40-78ab-4c5f-9a56-3a49144b3674 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3eddba40-78ab-4c5f-9a56-3a49144b3674.temp >Thread-55961::DEBUG::2014-05-16 18:22:55,195::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_f26629d9-43c3-42cd-a3e6-93cb35cb35c7 for task 3eddba40-78ab-4c5f-9a56-3a49144b3674 >Thread-55961::INFO::2014-05-16 18:22:55,195::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-55961::DEBUG::2014-05-16 18:22:55,196::task::1163::TaskManager.Task::(prepare) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::Prepare: 1 jobs exist, move to acquiring >Thread-55961::DEBUG::2014-05-16 18:22:55,196::task::579::TaskManager.Task::(_updateState) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::moving from state preparing -> state acquiring >Thread-55961::DEBUG::2014-05-16 18:22:55,196::task::736::TaskManager.Task::(_save) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3eddba40-78ab-4c5f-9a56-3a49144b3674 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3eddba40-78ab-4c5f-9a56-3a49144b3674.temp >Thread-55961::DEBUG::2014-05-16 18:22:55,202::task::579::TaskManager.Task::(_updateState) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::moving from state acquiring -> state queued >Thread-55961::DEBUG::2014-05-16 18:22:55,203::task::736::TaskManager.Task::(_save) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3eddba40-78ab-4c5f-9a56-3a49144b3674 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3eddba40-78ab-4c5f-9a56-3a49144b3674.temp >Dummy-51::DEBUG::2014-05-16 18:22:55,208::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-55961::DEBUG::2014-05-16 18:22:55,216::taskManager::50::TaskManager::(_queueTask) queuing task: 3eddba40-78ab-4c5f-9a56-3a49144b3674 >f6678e65-9b8c-4a1f-b007-07a4afa22c99::DEBUG::2014-05-16 18:22:55,218::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,219::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 3eddba40-78ab-4c5f-9a56-3a49144b3674 running: <bound method Task.commit of <storage.task.Task instance at 0x7ff538408c68>> with: None >Thread-55961::DEBUG::2014-05-16 18:22:55,218::taskManager::56::TaskManager::(_queueTask) task queued: 3eddba40-78ab-4c5f-9a56-3a49144b3674 >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,219::task::1176::TaskManager.Task::(commit) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::committing task: 3eddba40-78ab-4c5f-9a56-3a49144b3674 >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,221::task::579::TaskManager.Task::(_updateState) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::moving from state queued -> state running >Thread-55961::DEBUG::2014-05-16 18:22:55,221::task::1165::TaskManager.Task::(prepare) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::returning >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,223::task::736::TaskManager.Task::(_save) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3eddba40-78ab-4c5f-9a56-3a49144b3674 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3eddba40-78ab-4c5f-9a56-3a49144b3674.temp >Thread-55961::DEBUG::2014-05-16 18:22:55,224::task::974::TaskManager.Task::(_decref) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::ref 1 aborting False >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,242::task::889::TaskManager.Task::(_runJobs) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::Task.run: running job 0: deleteImage_f26629d9-43c3-42cd-a3e6-93cb35cb35c7: <function <lambda> at 0x7ff5400d0b90> (args: () kwargs: {}) >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,243::task::315::TaskManager.Task::(run) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::Job.run: running deleteImage_f26629d9-43c3-42cd-a3e6-93cb35cb35c7: <function <lambda> at 0x7ff5400d0b90> (args: () kwargs: {}) callback None >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,244::task::579::TaskManager.Task::(_updateState) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::moving from state running -> state finished >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,246::task::736::TaskManager.Task::(_save) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3eddba40-78ab-4c5f-9a56-3a49144b3674 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/3eddba40-78ab-4c5f-9a56-3a49144b3674.temp >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,264::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>, 'Storage.f26629d9-43c3-42cd-a3e6-93cb35cb35c7': < ResourceRef 'Storage.f26629d9-43c3-42cd-a3e6-93cb35cb35c7', isValid: 'True' obj: 'None'>} >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,265::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,267::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,268::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,269::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,269::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,271::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f26629d9-43c3-42cd-a3e6-93cb35cb35c7' >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,272::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f26629d9-43c3-42cd-a3e6-93cb35cb35c7' (0 active users) >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,273::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f26629d9-43c3-42cd-a3e6-93cb35cb35c7' is free, finding out if anyone is waiting for it. >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,274::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f26629d9-43c3-42cd-a3e6-93cb35cb35c7', Clearing records. >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,275::task::897::TaskManager.Task::(_runJobs) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::Task.run: exit - success: result True >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,276::task::974::TaskManager.Task::(_decref) Task=`3eddba40-78ab-4c5f-9a56-3a49144b3674`::ref 0 aborting False >3eddba40-78ab-4c5f-9a56-3a49144b3674::DEBUG::2014-05-16 18:22:55,277::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-51::DEBUG::2014-05-16 18:22:55,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0740289 s, 13.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:22:56,265::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:22:56,265::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:22:56,421::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:22:56,422::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:22:56,443::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:22:56,453::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057551 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:22:57,331::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:57,402::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035418 s, 28.9 MB/s\n'; <rc> = 0 >Thread-55962::DEBUG::2014-05-16 18:22:57,427::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5064235.000000 / 8.013898 / 262500000.000000 = 0.240736 >Thread-55962::DEBUG::2014-05-16 18:22:57,427::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.023916261310318647, 'statsAge': 0.79850196838378906, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.24073583242935312, 'rxDropped': 0} >Thread-55962::DEBUG::2014-05-16 18:22:57,428::task::579::TaskManager.Task::(_updateState) Task=`246baf9e-b45e-4e65-bada-fe24c5256aa5`::moving from state init -> state preparing >Thread-55962::INFO::2014-05-16 18:22:57,428::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55962::INFO::2014-05-16 18:22:57,428::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057551', 'lastCheck': '1.0', 'valid': True}} >Thread-55962::DEBUG::2014-05-16 18:22:57,428::task::1168::TaskManager.Task::(prepare) Task=`246baf9e-b45e-4e65-bada-fe24c5256aa5`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057551', 'lastCheck': '1.0', 'valid': True}} >Thread-55962::DEBUG::2014-05-16 18:22:57,429::task::579::TaskManager.Task::(_updateState) Task=`246baf9e-b45e-4e65-bada-fe24c5256aa5`::moving from state preparing -> state finished >Thread-55962::DEBUG::2014-05-16 18:22:57,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55962::DEBUG::2014-05-16 18:22:57,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55962::DEBUG::2014-05-16 18:22:57,429::task::974::TaskManager.Task::(_decref) Task=`246baf9e-b45e-4e65-bada-fe24c5256aa5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:22:59,414::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:22:59,481::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306448 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:01,493::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:01,560::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303583 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:03,571::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:03,642::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353535 s, 29.0 MB/s\n'; <rc> = 0 >Thread-55966::DEBUG::2014-05-16 18:23:04,546::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55966::DEBUG::2014-05-16 18:23:04,547::task::579::TaskManager.Task::(_updateState) Task=`7a99d376-c436-475c-b00a-831ff56222f6`::moving from state init -> state preparing >Thread-55966::INFO::2014-05-16 18:23:04,547::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-55966::DEBUG::2014-05-16 18:23:04,547::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-55966::DEBUG::2014-05-16 18:23:04,547::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 3eddba40-78ab-4c5f-9a56-3a49144b3674 >Thread-55966::DEBUG::2014-05-16 18:23:04,548::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3eddba40-78ab-4c5f-9a56-3a49144b3674'} >Thread-55966::DEBUG::2014-05-16 18:23:04,548::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'3eddba40-78ab-4c5f-9a56-3a49144b3674': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3eddba40-78ab-4c5f-9a56-3a49144b3674'}} >Thread-55966::INFO::2014-05-16 18:23:04,548::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'3eddba40-78ab-4c5f-9a56-3a49144b3674': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3eddba40-78ab-4c5f-9a56-3a49144b3674'}}} >Thread-55966::DEBUG::2014-05-16 18:23:04,548::task::1168::TaskManager.Task::(prepare) Task=`7a99d376-c436-475c-b00a-831ff56222f6`::finished: {'allTasksStatus': {'3eddba40-78ab-4c5f-9a56-3a49144b3674': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3eddba40-78ab-4c5f-9a56-3a49144b3674'}}} >Thread-55966::DEBUG::2014-05-16 18:23:04,548::task::579::TaskManager.Task::(_updateState) Task=`7a99d376-c436-475c-b00a-831ff56222f6`::moving from state preparing -> state finished >Thread-55966::DEBUG::2014-05-16 18:23:04,548::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55966::DEBUG::2014-05-16 18:23:04,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55966::DEBUG::2014-05-16 18:23:04,549::task::974::TaskManager.Task::(_decref) Task=`7a99d376-c436-475c-b00a-831ff56222f6`::ref 0 aborting False >Thread-55967::DEBUG::2014-05-16 18:23:04,563::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55967::DEBUG::2014-05-16 18:23:04,563::task::579::TaskManager.Task::(_updateState) Task=`e640c72e-ecc8-4d2b-badc-266d19139193`::moving from state init -> state preparing >Thread-55967::INFO::2014-05-16 18:23:04,563::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55967::INFO::2014-05-16 18:23:04,563::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55967::DEBUG::2014-05-16 18:23:04,564::task::1168::TaskManager.Task::(prepare) Task=`e640c72e-ecc8-4d2b-badc-266d19139193`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55967::DEBUG::2014-05-16 18:23:04,564::task::579::TaskManager.Task::(_updateState) Task=`e640c72e-ecc8-4d2b-badc-266d19139193`::moving from state preparing -> state finished >Thread-55967::DEBUG::2014-05-16 18:23:04,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55967::DEBUG::2014-05-16 18:23:04,564::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55967::DEBUG::2014-05-16 18:23:04,564::task::974::TaskManager.Task::(_decref) Task=`e640c72e-ecc8-4d2b-badc-266d19139193`::ref 0 aborting False >Thread-55968::DEBUG::2014-05-16 18:23:04,582::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55968::DEBUG::2014-05-16 18:23:04,582::task::579::TaskManager.Task::(_updateState) Task=`6aa3bb43-a0ed-4cfd-838d-6c15add29f7d`::moving from state init -> state preparing >Thread-55968::INFO::2014-05-16 18:23:04,582::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55968::DEBUG::2014-05-16 18:23:04,583::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3689dfe2-278a-41b4-9e7b-0789ca539d77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55968::DEBUG::2014-05-16 18:23:04,583::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55968::DEBUG::2014-05-16 18:23:04,583::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55968::DEBUG::2014-05-16 18:23:04,583::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3689dfe2-278a-41b4-9e7b-0789ca539d77`::Granted request >Thread-55968::DEBUG::2014-05-16 18:23:04,583::task::811::TaskManager.Task::(resourceAcquired) Task=`6aa3bb43-a0ed-4cfd-838d-6c15add29f7d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55968::DEBUG::2014-05-16 18:23:04,583::task::974::TaskManager.Task::(_decref) Task=`6aa3bb43-a0ed-4cfd-838d-6c15add29f7d`::ref 1 aborting False >Thread-55968::INFO::2014-05-16 18:23:04,584::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55968::DEBUG::2014-05-16 18:23:04,584::task::1168::TaskManager.Task::(prepare) Task=`6aa3bb43-a0ed-4cfd-838d-6c15add29f7d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55968::DEBUG::2014-05-16 18:23:04,584::task::579::TaskManager.Task::(_updateState) Task=`6aa3bb43-a0ed-4cfd-838d-6c15add29f7d`::moving from state preparing -> state finished >Thread-55968::DEBUG::2014-05-16 18:23:04,584::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55968::DEBUG::2014-05-16 18:23:04,585::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55968::DEBUG::2014-05-16 18:23:04,585::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55968::DEBUG::2014-05-16 18:23:04,585::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55968::DEBUG::2014-05-16 18:23:04,585::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55968::DEBUG::2014-05-16 18:23:04,585::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55968::DEBUG::2014-05-16 18:23:04,585::task::974::TaskManager.Task::(_decref) Task=`6aa3bb43-a0ed-4cfd-838d-6c15add29f7d`::ref 0 aborting False >Thread-55969::DEBUG::2014-05-16 18:23:04,656::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55969::DEBUG::2014-05-16 18:23:04,657::task::579::TaskManager.Task::(_updateState) Task=`932b9ad3-405d-49e6-8f7c-f0828b69a0bb`::moving from state init -> state preparing >Thread-55969::INFO::2014-05-16 18:23:04,657::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='3eddba40-78ab-4c5f-9a56-3a49144b3674', spUUID=None, options=None) >Thread-55969::DEBUG::2014-05-16 18:23:04,657::taskManager::161::TaskManager::(clearTask) Entry. taskID: 3eddba40-78ab-4c5f-9a56-3a49144b3674 >Thread-55969::DEBUG::2014-05-16 18:23:04,658::taskManager::166::TaskManager::(clearTask) Return. >Thread-55969::INFO::2014-05-16 18:23:04,658::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-55969::DEBUG::2014-05-16 18:23:04,658::task::1168::TaskManager.Task::(prepare) Task=`932b9ad3-405d-49e6-8f7c-f0828b69a0bb`::finished: None >Thread-55969::DEBUG::2014-05-16 18:23:04,658::task::579::TaskManager.Task::(_updateState) Task=`932b9ad3-405d-49e6-8f7c-f0828b69a0bb`::moving from state preparing -> state finished >Thread-55969::DEBUG::2014-05-16 18:23:04,658::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55969::DEBUG::2014-05-16 18:23:04,658::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55969::DEBUG::2014-05-16 18:23:04,658::task::974::TaskManager.Task::(_decref) Task=`932b9ad3-405d-49e6-8f7c-f0828b69a0bb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:23:05,654::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:05,723::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302992 s, 33.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:23:06,491::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:23:06,501::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00076676 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:07,735::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:07,803::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306475 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:09,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:09,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355841 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:11,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:11,964::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305877 s, 33.5 MB/s\n'; <rc> = 0 >Thread-55972::DEBUG::2014-05-16 18:23:12,739::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4349593.000000 / 8.009300 / 262500000.000000 = 0.206883 >Thread-55972::DEBUG::2014-05-16 18:23:12,739::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0075952657478202948, 'statsAge': 0.092230081558227539, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20688297489985924, 'rxDropped': 0} >Thread-55972::DEBUG::2014-05-16 18:23:12,740::task::579::TaskManager.Task::(_updateState) Task=`5d88b609-6cb2-439b-b4a9-cfe25a2148b5`::moving from state init -> state preparing >Thread-55972::INFO::2014-05-16 18:23:12,741::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55972::INFO::2014-05-16 18:23:12,741::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00076676', 'lastCheck': '6.2', 'valid': True}} >Thread-55972::DEBUG::2014-05-16 18:23:12,741::task::1168::TaskManager.Task::(prepare) Task=`5d88b609-6cb2-439b-b4a9-cfe25a2148b5`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00076676', 'lastCheck': '6.2', 'valid': True}} >Thread-55972::DEBUG::2014-05-16 18:23:12,741::task::579::TaskManager.Task::(_updateState) Task=`5d88b609-6cb2-439b-b4a9-cfe25a2148b5`::moving from state preparing -> state finished >Thread-55972::DEBUG::2014-05-16 18:23:12,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55972::DEBUG::2014-05-16 18:23:12,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55972::DEBUG::2014-05-16 18:23:12,742::task::974::TaskManager.Task::(_decref) Task=`5d88b609-6cb2-439b-b4a9-cfe25a2148b5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:23:13,976::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:14,045::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319011 s, 32.1 MB/s\n'; <rc> = 0 >Thread-55974::DEBUG::2014-05-16 18:23:14,628::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55974::DEBUG::2014-05-16 18:23:14,629::task::579::TaskManager.Task::(_updateState) Task=`7cb08eb0-d8db-4417-94bc-7fd4f4c96451`::moving from state init -> state preparing >Thread-55974::INFO::2014-05-16 18:23:14,629::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55974::INFO::2014-05-16 18:23:14,629::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55974::DEBUG::2014-05-16 18:23:14,629::task::1168::TaskManager.Task::(prepare) Task=`7cb08eb0-d8db-4417-94bc-7fd4f4c96451`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55974::DEBUG::2014-05-16 18:23:14,629::task::579::TaskManager.Task::(_updateState) Task=`7cb08eb0-d8db-4417-94bc-7fd4f4c96451`::moving from state preparing -> state finished >Thread-55974::DEBUG::2014-05-16 18:23:14,630::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55974::DEBUG::2014-05-16 18:23:14,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55974::DEBUG::2014-05-16 18:23:14,630::task::974::TaskManager.Task::(_decref) Task=`7cb08eb0-d8db-4417-94bc-7fd4f4c96451`::ref 0 aborting False >Thread-55975::DEBUG::2014-05-16 18:23:14,639::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55975::DEBUG::2014-05-16 18:23:14,639::task::579::TaskManager.Task::(_updateState) Task=`db8dfe66-78f8-4204-b40b-2858bbde5a07`::moving from state init -> state preparing >Thread-55975::INFO::2014-05-16 18:23:14,639::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55975::DEBUG::2014-05-16 18:23:14,639::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`87bb375a-0954-4b94-979d-964b507d0aea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55975::DEBUG::2014-05-16 18:23:14,640::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55975::DEBUG::2014-05-16 18:23:14,640::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55975::DEBUG::2014-05-16 18:23:14,640::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`87bb375a-0954-4b94-979d-964b507d0aea`::Granted request >Thread-55975::DEBUG::2014-05-16 18:23:14,640::task::811::TaskManager.Task::(resourceAcquired) Task=`db8dfe66-78f8-4204-b40b-2858bbde5a07`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55975::DEBUG::2014-05-16 18:23:14,641::task::974::TaskManager.Task::(_decref) Task=`db8dfe66-78f8-4204-b40b-2858bbde5a07`::ref 1 aborting False >Thread-55975::INFO::2014-05-16 18:23:14,641::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55975::DEBUG::2014-05-16 18:23:14,641::task::1168::TaskManager.Task::(prepare) Task=`db8dfe66-78f8-4204-b40b-2858bbde5a07`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55975::DEBUG::2014-05-16 18:23:14,642::task::579::TaskManager.Task::(_updateState) Task=`db8dfe66-78f8-4204-b40b-2858bbde5a07`::moving from state preparing -> state finished >Thread-55975::DEBUG::2014-05-16 18:23:14,642::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55975::DEBUG::2014-05-16 18:23:14,642::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55975::DEBUG::2014-05-16 18:23:14,642::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55975::DEBUG::2014-05-16 18:23:14,642::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55975::DEBUG::2014-05-16 18:23:14,642::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55975::DEBUG::2014-05-16 18:23:14,643::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55975::DEBUG::2014-05-16 18:23:14,643::task::974::TaskManager.Task::(_decref) Task=`db8dfe66-78f8-4204-b40b-2858bbde5a07`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:23:16,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:16,128::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350855 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:23:16,536::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:23:16,546::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737197 s, 5.6 MB/s\n'; <rc> = 0 >Thread-55977::DEBUG::2014-05-16 18:23:17,450::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [4d50c181] >Thread-55977::DEBUG::2014-05-16 18:23:17,451::task::579::TaskManager.Task::(_updateState) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::moving from state init -> state preparing >Thread-55977::INFO::2014-05-16 18:23:17,451::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='8debca93-f8e9-426b-99d9-ca2a9f06cc30', size='34359738368', volFormat=4, preallocate=2, diskType=2, volUUID='96ce69ca-328f-44f9-801a-300e226dec20', desc='', srcImgUUID='7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', srcVolUUID='77c78124-ee6c-46b1-9112-a738f448beca') >Thread-55977::DEBUG::2014-05-16 18:23:17,452::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`96aaf0ca-edf7-4d25-b77a-dd2e47fc9dac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1484' at 'createVolume' >Thread-55977::DEBUG::2014-05-16 18:23:17,452::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55977::DEBUG::2014-05-16 18:23:17,452::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55977::DEBUG::2014-05-16 18:23:17,452::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`96aaf0ca-edf7-4d25-b77a-dd2e47fc9dac`::Granted request >Thread-55977::DEBUG::2014-05-16 18:23:17,452::task::811::TaskManager.Task::(resourceAcquired) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55977::DEBUG::2014-05-16 18:23:17,453::task::974::TaskManager.Task::(_decref) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::ref 1 aborting False >Thread-55977::DEBUG::2014-05-16 18:23:17,453::task::736::TaskManager.Task::(_save) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494.temp >Thread-55977::DEBUG::2014-05-16 18:23:17,459::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 5d173b85-99cc-4343-98e7-d54854aaf494 >Thread-55977::INFO::2014-05-16 18:23:17,459::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-55977::DEBUG::2014-05-16 18:23:17,459::task::1163::TaskManager.Task::(prepare) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::Prepare: 1 jobs exist, move to acquiring >Thread-55977::DEBUG::2014-05-16 18:23:17,459::task::579::TaskManager.Task::(_updateState) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::moving from state preparing -> state acquiring >Thread-55977::DEBUG::2014-05-16 18:23:17,460::task::736::TaskManager.Task::(_save) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494.temp >Thread-55977::DEBUG::2014-05-16 18:23:17,465::task::579::TaskManager.Task::(_updateState) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::moving from state acquiring -> state queued >Thread-55977::DEBUG::2014-05-16 18:23:17,465::task::736::TaskManager.Task::(_save) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494.temp >Thread-55977::DEBUG::2014-05-16 18:23:17,471::taskManager::50::TaskManager::(_queueTask) queuing task: 5d173b85-99cc-4343-98e7-d54854aaf494 >Thread-55977::DEBUG::2014-05-16 18:23:17,471::taskManager::56::TaskManager::(_queueTask) task queued: 5d173b85-99cc-4343-98e7-d54854aaf494 >Thread-8::DEBUG::2014-05-16 18:23:17,471::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-55977::DEBUG::2014-05-16 18:23:17,472::task::1165::TaskManager.Task::(prepare) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::returning >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,472::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 5d173b85-99cc-4343-98e7-d54854aaf494 running: <bound method Task.commit of <storage.task.Task instance at 0x7ff534332170>> with: None >Thread-55977::DEBUG::2014-05-16 18:23:17,472::task::974::TaskManager.Task::(_decref) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::ref 0 aborting False >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,473::task::1176::TaskManager.Task::(commit) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::committing task: 5d173b85-99cc-4343-98e7-d54854aaf494 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,474::task::579::TaskManager.Task::(_updateState) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::moving from state queued -> state running >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,474::task::736::TaskManager.Task::(_save) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494.temp >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,480::task::889::TaskManager.Task::(_runJobs) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x2b04510>> (args: ('f79908bf-a757-4a71-9ab5-3a12ede5f65c', '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 67108864, 4, 2, 2, '96ce69ca-328f-44f9-801a-300e226dec20', '', '7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', '77c78124-ee6c-46b1-9112-a738f448beca') kwargs: {}) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,480::task::315::TaskManager.Task::(run) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x2b04510>> (args: ('f79908bf-a757-4a71-9ab5-3a12ede5f65c', '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 67108864, 4, 2, 2, '96ce69ca-328f-44f9-801a-300e226dec20', '', '7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', '77c78124-ee6c-46b1-9112-a738f448beca') kwargs: {}) callback None >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,480::resourceManager::197::ResourceManager.Request::(__init__) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.8debca93-f8e9-426b-99d9-ca2a9f06cc30`ReqID=`458883ee-96fe-4443-85ae-2ae13b60e850`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1895' at 'createVolume' >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,480::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.8debca93-f8e9-426b-99d9-ca2a9f06cc30' for lock type 'exclusive' >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,481::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,481::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,630::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,645::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,645::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,645::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 8debca93-f8e9-426b-99d9-ca2a9f06cc30 does not exist in domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,645::resourceManager::600::ResourceManager::(registerResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.8debca93-f8e9-426b-99d9-ca2a9f06cc30' is free. Now locking as 'exclusive' (1 active user) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,646::resourceManager::237::ResourceManager.Request::(grant) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.8debca93-f8e9-426b-99d9-ca2a9f06cc30`ReqID=`458883ee-96fe-4443-85ae-2ae13b60e850`::Granted request >5d173b85-99cc-4343-98e7-d54854aaf494::INFO::2014-05-16 18:23:17,646::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30 for image's volumes >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,647::task::736::TaskManager.Task::(_save) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494.temp >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,671::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,680::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000545287 s, 939 kB/s\n'; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,680::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000545287 s, 939 kB/s'], size: 512 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,680::volume::300::Storage.Volume::(share) Share volume 77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,700::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,708::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000556117 s, 921 kB/s\n'; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,709::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000556117 s, 921 kB/s'], size: 512 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,710::task::736::TaskManager.Task::(_save) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494.temp >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,716::blockVolume::380::Storage.Volume::(_share) Share volume 77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,734::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,743::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000547776 s, 935 kB/s\n'; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,743::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000547776 s, 935 kB/s'], size: 512 >5d173b85-99cc-4343-98e7-d54854aaf494::INFO::2014-05-16 18:23:17,744::volume::446::Storage.Volume::(create) Creating volume 96ce69ca-328f-44f9-801a-300e226dec20 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,744::task::736::TaskManager.Task::(_save) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494.temp >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,752::task::736::TaskManager.Task::(_save) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494.temp >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,761::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 96ce69ca-328f-44f9-801a-300e226dec20 f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,963::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,964::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,964::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,964::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,965::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::WARNING::2014-05-16 18:23:17,966::utils::114::root::(rmFile) File: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20 already removed >5d173b85-99cc-4343-98e7-d54854aaf494::INFO::2014-05-16 18:23:17,967::blockVolume::196::Storage.Volume::(_create) Request to create snapshot 8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20 of volume 7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96/77c78124-ee6c-46b1-9112-a738f448beca >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:17,968::task::736::TaskManager.Task::(_save) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494.temp >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,000::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,009::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000600193 s, 853 kB/s\n'; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,009::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000600193 s, 853 kB/s'], size: 512 >5d173b85-99cc-4343-98e7-d54854aaf494::INFO::2014-05-16 18:23:18,009::volume::793::Storage.Volume::(prepare) Volume: preparing volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,029::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,037::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00047701 s, 1.1 MB/s\n'; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,037::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00047701 s, 1.1 MB/s'], size: 512 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,038::resourceManager::197::ResourceManager.Request::(__init__) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca`ReqID=`e30afca4-91e1-43dd-a2dc-cd4cf6b5d940`::Request was made in '/usr/share/vdsm/storage/volume.py' line '810' at 'prepare' >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,038::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' for lock type 'shared' >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,038::resourceManager::600::ResourceManager::(registerResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' is free. Now locking as 'shared' (1 active user) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,039::resourceManager::237::ResourceManager.Request::(grant) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca`ReqID=`e30afca4-91e1-43dd-a2dc-cd4cf6b5d940`::Granted request >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,057::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,067::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00240617 s, 213 kB/s\n'; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,068::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00240617 s, 213 kB/s'], size: 512 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,068::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,086::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,094::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000609495 s, 840 kB/s\n'; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,094::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000609495 s, 840 kB/s'], size: 512 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,114::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,122::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000490645 s, 1.0 MB/s\n'; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,122::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000490645 s, 1.0 MB/s'], size: 512 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,123::volume::1058::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../8debca93-f8e9-426b-99d9-ca2a9f06cc30/77c78124-ee6c-46b1-9112-a738f448beca /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20' (cwd /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30) >Dummy-51::DEBUG::2014-05-16 18:23:18,139::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,176::volume::1058::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::INFO::2014-05-16 18:23:18,178::blockVolume::420::Storage.Volume::(teardown) Tearing down volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca justme False >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,178::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,180::resourceManager::634::ResourceManager::(releaseResource) Released resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' (0 active users) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,181::resourceManager::640::ResourceManager::(releaseResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' is free, finding out if anyone is waiting for it. >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,186::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:18,245::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0687631 s, 14.9 MB/s\n'; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,497::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,498::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,498::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,498::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca', Clearing records. >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,498::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,499::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,650::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,669::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,669::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,670::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,670::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,820::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,835::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,835::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::WARNING::2014-05-16 18:23:18,835::blockSD::743::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv f79908bf-a757-4a71-9ab5-3a12ede5f65c/96ce69ca-328f-44f9-801a-300e226dec20 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,835::blockSD::766::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 15 in VG f79908bf-a757-4a71-9ab5-3a12ede5f65c >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:18,836::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_15 --addtag IU_8debca93-f8e9-426b-99d9-ca2a9f06cc30 --addtag PU_77c78124-ee6c-46b1-9112-a738f448beca f79908bf-a757-4a71-9ab5-3a12ede5f65c/96ce69ca-328f-44f9-801a-300e226dec20' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,015::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,016::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,016::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,017::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/96ce69ca-328f-44f9-801a-300e226dec20' (cwd None) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,177::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,178::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,178::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,179::task::736::TaskManager.Task::(_save) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494.temp >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,208::blockVolume::622::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=96ce69ca-328f-44f9-801a-300e226dec20 sdUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c, metaId=('f79908bf-a757-4a71-9ab5-3a12ede5f65c', 15) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,222::task::736::TaskManager.Task::(_save) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494.temp >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,233::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.8debca93-f8e9-426b-99d9-ca2a9f06cc30' >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,233::resourceManager::634::ResourceManager::(releaseResource) Released resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.8debca93-f8e9-426b-99d9-ca2a9f06cc30' (0 active users) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,233::resourceManager::640::ResourceManager::(releaseResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.8debca93-f8e9-426b-99d9-ca2a9f06cc30' is free, finding out if anyone is waiting for it. >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,234::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.8debca93-f8e9-426b-99d9-ca2a9f06cc30', Clearing records. >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,234::task::579::TaskManager.Task::(_updateState) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::moving from state running -> state finished >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,235::task::736::TaskManager.Task::(_save) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/5d173b85-99cc-4343-98e7-d54854aaf494.temp >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,244::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,245::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,245::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,245::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,245::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,246::task::897::TaskManager.Task::(_runJobs) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::Task.run: exit - success: result {'uuid': '96ce69ca-328f-44f9-801a-300e226dec20'} >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,246::task::974::TaskManager.Task::(_decref) Task=`5d173b85-99cc-4343-98e7-d54854aaf494`::ref 0 aborting False >5d173b85-99cc-4343-98e7-d54854aaf494::DEBUG::2014-05-16 18:23:19,246::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-51::DEBUG::2014-05-16 18:23:20,257::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:20,325::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310532 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:22,336::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:22,407::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351317 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:24,419::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:24,492::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369013 s, 27.7 MB/s\n'; <rc> = 0 >Thread-55980::DEBUG::2014-05-16 18:23:24,609::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55980::DEBUG::2014-05-16 18:23:24,610::task::579::TaskManager.Task::(_updateState) Task=`017a5d9f-ca44-4504-9b52-a7f4b771f8da`::moving from state init -> state preparing >Thread-55980::INFO::2014-05-16 18:23:24,610::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-55980::DEBUG::2014-05-16 18:23:24,610::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-55980::DEBUG::2014-05-16 18:23:24,610::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5d173b85-99cc-4343-98e7-d54854aaf494 >Thread-55980::DEBUG::2014-05-16 18:23:24,610::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5d173b85-99cc-4343-98e7-d54854aaf494'} >Thread-55980::DEBUG::2014-05-16 18:23:24,610::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'5d173b85-99cc-4343-98e7-d54854aaf494': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5d173b85-99cc-4343-98e7-d54854aaf494'}} >Thread-55980::INFO::2014-05-16 18:23:24,611::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'5d173b85-99cc-4343-98e7-d54854aaf494': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5d173b85-99cc-4343-98e7-d54854aaf494'}}} >Thread-55980::DEBUG::2014-05-16 18:23:24,611::task::1168::TaskManager.Task::(prepare) Task=`017a5d9f-ca44-4504-9b52-a7f4b771f8da`::finished: {'allTasksStatus': {'5d173b85-99cc-4343-98e7-d54854aaf494': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5d173b85-99cc-4343-98e7-d54854aaf494'}}} >Thread-55980::DEBUG::2014-05-16 18:23:24,611::task::579::TaskManager.Task::(_updateState) Task=`017a5d9f-ca44-4504-9b52-a7f4b771f8da`::moving from state preparing -> state finished >Thread-55980::DEBUG::2014-05-16 18:23:24,611::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55980::DEBUG::2014-05-16 18:23:24,611::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55980::DEBUG::2014-05-16 18:23:24,611::task::974::TaskManager.Task::(_decref) Task=`017a5d9f-ca44-4504-9b52-a7f4b771f8da`::ref 0 aborting False >Thread-55981::DEBUG::2014-05-16 18:23:24,672::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55981::DEBUG::2014-05-16 18:23:24,672::task::579::TaskManager.Task::(_updateState) Task=`e96de79b-da83-4f43-82ca-81fe2d79d88b`::moving from state init -> state preparing >Thread-55981::INFO::2014-05-16 18:23:24,672::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55981::INFO::2014-05-16 18:23:24,673::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55981::DEBUG::2014-05-16 18:23:24,673::task::1168::TaskManager.Task::(prepare) Task=`e96de79b-da83-4f43-82ca-81fe2d79d88b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55981::DEBUG::2014-05-16 18:23:24,673::task::579::TaskManager.Task::(_updateState) Task=`e96de79b-da83-4f43-82ca-81fe2d79d88b`::moving from state preparing -> state finished >Thread-55981::DEBUG::2014-05-16 18:23:24,673::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55981::DEBUG::2014-05-16 18:23:24,673::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55981::DEBUG::2014-05-16 18:23:24,673::task::974::TaskManager.Task::(_decref) Task=`e96de79b-da83-4f43-82ca-81fe2d79d88b`::ref 0 aborting False >Thread-55982::DEBUG::2014-05-16 18:23:24,695::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55982::DEBUG::2014-05-16 18:23:24,695::task::579::TaskManager.Task::(_updateState) Task=`4e9f7e67-3abf-410d-a1d0-77e1d6a3b15f`::moving from state init -> state preparing >Thread-55982::INFO::2014-05-16 18:23:24,696::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55982::DEBUG::2014-05-16 18:23:24,696::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0a760111-8f38-4b24-ac18-831aa8dc6126`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55982::DEBUG::2014-05-16 18:23:24,696::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55982::DEBUG::2014-05-16 18:23:24,696::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55982::DEBUG::2014-05-16 18:23:24,696::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0a760111-8f38-4b24-ac18-831aa8dc6126`::Granted request >Thread-55982::DEBUG::2014-05-16 18:23:24,697::task::811::TaskManager.Task::(resourceAcquired) Task=`4e9f7e67-3abf-410d-a1d0-77e1d6a3b15f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55982::DEBUG::2014-05-16 18:23:24,697::task::974::TaskManager.Task::(_decref) Task=`4e9f7e67-3abf-410d-a1d0-77e1d6a3b15f`::ref 1 aborting False >Thread-55982::DEBUG::2014-05-16 18:23:24,697::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-55982::DEBUG::2014-05-16 18:23:24,698::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55982::DEBUG::2014-05-16 18:23:24,848::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55982::DEBUG::2014-05-16 18:23:24,850::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-55982::INFO::2014-05-16 18:23:24,851::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55982::DEBUG::2014-05-16 18:23:24,851::task::1168::TaskManager.Task::(prepare) Task=`4e9f7e67-3abf-410d-a1d0-77e1d6a3b15f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55982::DEBUG::2014-05-16 18:23:24,851::task::579::TaskManager.Task::(_updateState) Task=`4e9f7e67-3abf-410d-a1d0-77e1d6a3b15f`::moving from state preparing -> state finished >Thread-55982::DEBUG::2014-05-16 18:23:24,851::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55982::DEBUG::2014-05-16 18:23:24,851::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55982::DEBUG::2014-05-16 18:23:24,852::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55982::DEBUG::2014-05-16 18:23:24,852::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55982::DEBUG::2014-05-16 18:23:24,852::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55982::DEBUG::2014-05-16 18:23:24,852::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55982::DEBUG::2014-05-16 18:23:24,853::task::974::TaskManager.Task::(_decref) Task=`4e9f7e67-3abf-410d-a1d0-77e1d6a3b15f`::ref 0 aborting False >Thread-55983::DEBUG::2014-05-16 18:23:24,907::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [4d50c181] >Thread-55983::DEBUG::2014-05-16 18:23:24,908::task::579::TaskManager.Task::(_updateState) Task=`2fe4823a-93f6-4e63-a1be-cec967e7caab`::moving from state init -> state preparing >Thread-55983::INFO::2014-05-16 18:23:24,908::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='8debca93-f8e9-426b-99d9-ca2a9f06cc30', volUUID='96ce69ca-328f-44f9-801a-300e226dec20', options=None) >Thread-55983::DEBUG::2014-05-16 18:23:24,908::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`29392141-bc71-4ab4-8d78-8db5f2dbaec2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3104' at 'getVolumeInfo' >Thread-55983::DEBUG::2014-05-16 18:23:24,908::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55983::DEBUG::2014-05-16 18:23:24,909::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55983::DEBUG::2014-05-16 18:23:24,909::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`29392141-bc71-4ab4-8d78-8db5f2dbaec2`::Granted request >Thread-55983::DEBUG::2014-05-16 18:23:24,909::task::811::TaskManager.Task::(resourceAcquired) Task=`2fe4823a-93f6-4e63-a1be-cec967e7caab`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55983::DEBUG::2014-05-16 18:23:24,909::task::974::TaskManager.Task::(_decref) Task=`2fe4823a-93f6-4e63-a1be-cec967e7caab`::ref 1 aborting False >Thread-55983::DEBUG::2014-05-16 18:23:24,909::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55983::DEBUG::2014-05-16 18:23:24,910::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55983::DEBUG::2014-05-16 18:23:25,053::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55983::DEBUG::2014-05-16 18:23:25,069::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55983::DEBUG::2014-05-16 18:23:25,069::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55983::INFO::2014-05-16 18:23:25,069::volume::883::Storage.Volume::(getInfo) Info request: sdUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c imgUUID=8debca93-f8e9-426b-99d9-ca2a9f06cc30 volUUID = 96ce69ca-328f-44f9-801a-300e226dec20 >Thread-55983::DEBUG::2014-05-16 18:23:25,087::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-55983::DEBUG::2014-05-16 18:23:25,096::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000533319 s, 960 kB/s\n'; <rc> = 0 >Thread-55983::DEBUG::2014-05-16 18:23:25,097::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000533319 s, 960 kB/s'], size: 512 >Thread-55983::DEBUG::2014-05-16 18:23:25,116::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-55983::DEBUG::2014-05-16 18:23:25,125::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000536105 s, 955 kB/s\n'; <rc> = 0 >Thread-55983::DEBUG::2014-05-16 18:23:25,125::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000536105 s, 955 kB/s'], size: 512 >Thread-55983::DEBUG::2014-05-16 18:23:25,125::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55983::DEBUG::2014-05-16 18:23:25,126::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55983::DEBUG::2014-05-16 18:23:25,270::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55983::DEBUG::2014-05-16 18:23:25,284::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55983::DEBUG::2014-05-16 18:23:25,285::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55983::INFO::2014-05-16 18:23:25,285::volume::912::Storage.Volume::(getInfo) f79908bf-a757-4a71-9ab5-3a12ede5f65c/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20 info is {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 'ctime': '1400264599', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400264599', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '96ce69ca-328f-44f9-801a-300e226dec20', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-55983::INFO::2014-05-16 18:23:25,285::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 'ctime': '1400264599', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400264599', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '96ce69ca-328f-44f9-801a-300e226dec20', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-55983::DEBUG::2014-05-16 18:23:25,285::task::1168::TaskManager.Task::(prepare) Task=`2fe4823a-93f6-4e63-a1be-cec967e7caab`::finished: {'info': {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 'ctime': '1400264599', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400264599', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '96ce69ca-328f-44f9-801a-300e226dec20', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-55983::DEBUG::2014-05-16 18:23:25,286::task::579::TaskManager.Task::(_updateState) Task=`2fe4823a-93f6-4e63-a1be-cec967e7caab`::moving from state preparing -> state finished >Thread-55983::DEBUG::2014-05-16 18:23:25,286::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55983::DEBUG::2014-05-16 18:23:25,286::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55983::DEBUG::2014-05-16 18:23:25,286::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55983::DEBUG::2014-05-16 18:23:25,287::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55983::DEBUG::2014-05-16 18:23:25,287::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55983::DEBUG::2014-05-16 18:23:25,287::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55983::DEBUG::2014-05-16 18:23:25,287::task::974::TaskManager.Task::(_decref) Task=`2fe4823a-93f6-4e63-a1be-cec967e7caab`::ref 0 aborting False >Thread-55985::DEBUG::2014-05-16 18:23:25,377::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55985::DEBUG::2014-05-16 18:23:25,377::task::579::TaskManager.Task::(_updateState) Task=`1122506e-d70a-46de-a450-6fb2cefff46d`::moving from state init -> state preparing >Thread-55985::INFO::2014-05-16 18:23:25,378::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='5d173b85-99cc-4343-98e7-d54854aaf494', spUUID=None, options=None) >Thread-55985::DEBUG::2014-05-16 18:23:25,378::taskManager::161::TaskManager::(clearTask) Entry. taskID: 5d173b85-99cc-4343-98e7-d54854aaf494 >Thread-55985::DEBUG::2014-05-16 18:23:25,379::taskManager::166::TaskManager::(clearTask) Return. >Thread-55985::INFO::2014-05-16 18:23:25,379::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-55985::DEBUG::2014-05-16 18:23:25,379::task::1168::TaskManager.Task::(prepare) Task=`1122506e-d70a-46de-a450-6fb2cefff46d`::finished: None >Thread-55985::DEBUG::2014-05-16 18:23:25,379::task::579::TaskManager.Task::(_updateState) Task=`1122506e-d70a-46de-a450-6fb2cefff46d`::moving from state preparing -> state finished >Thread-55985::DEBUG::2014-05-16 18:23:25,379::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55985::DEBUG::2014-05-16 18:23:25,379::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55985::DEBUG::2014-05-16 18:23:25,380::task::974::TaskManager.Task::(_decref) Task=`1122506e-d70a-46de-a450-6fb2cefff46d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:23:26,504::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:26,621::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299033 s, 34.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:23:26,720::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:23:26,751::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730236 s, 5.6 MB/s\n'; <rc> = 0 >Thread-55986::DEBUG::2014-05-16 18:23:27,967::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 6548827.000000 / 8.016032 / 262500000.000000 = 0.311225 >Thread-55986::DEBUG::2014-05-16 18:23:27,967::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.094211010887459326, 'statsAge': 1.297652006149292, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.31122521019871285, 'rxDropped': 0} >Thread-55986::DEBUG::2014-05-16 18:23:27,968::task::579::TaskManager.Task::(_updateState) Task=`4ab01816-ff16-4d84-bb42-3ef03f8d0be6`::moving from state init -> state preparing >Thread-55986::INFO::2014-05-16 18:23:27,968::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-55986::INFO::2014-05-16 18:23:27,968::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730236', 'lastCheck': '1.1', 'valid': True}} >Thread-55986::DEBUG::2014-05-16 18:23:27,968::task::1168::TaskManager.Task::(prepare) Task=`4ab01816-ff16-4d84-bb42-3ef03f8d0be6`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730236', 'lastCheck': '1.1', 'valid': True}} >Thread-55986::DEBUG::2014-05-16 18:23:27,969::task::579::TaskManager.Task::(_updateState) Task=`4ab01816-ff16-4d84-bb42-3ef03f8d0be6`::moving from state preparing -> state finished >Thread-55986::DEBUG::2014-05-16 18:23:27,969::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55986::DEBUG::2014-05-16 18:23:27,969::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55986::DEBUG::2014-05-16 18:23:27,969::task::974::TaskManager.Task::(_decref) Task=`4ab01816-ff16-4d84-bb42-3ef03f8d0be6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:23:28,881::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:28,949::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320781 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:30,960::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:31,170::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.111963 s, 9.1 MB/s\n'; <rc> = 0 >Thread-55989::DEBUG::2014-05-16 18:23:31,214::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [1f860571] >Thread-55989::DEBUG::2014-05-16 18:23:31,215::task::579::TaskManager.Task::(_updateState) Task=`4f9ccf32-b9ca-468e-81dc-e3f0699a203a`::moving from state init -> state preparing >Thread-55989::INFO::2014-05-16 18:23:31,215::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55989::DEBUG::2014-05-16 18:23:31,216::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`138b5c65-a67b-4f25-853c-57726b452362`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55989::DEBUG::2014-05-16 18:23:31,216::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55989::DEBUG::2014-05-16 18:23:31,216::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55989::DEBUG::2014-05-16 18:23:31,216::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`138b5c65-a67b-4f25-853c-57726b452362`::Granted request >Thread-55989::DEBUG::2014-05-16 18:23:31,216::task::811::TaskManager.Task::(resourceAcquired) Task=`4f9ccf32-b9ca-468e-81dc-e3f0699a203a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55989::DEBUG::2014-05-16 18:23:31,217::task::974::TaskManager.Task::(_decref) Task=`4f9ccf32-b9ca-468e-81dc-e3f0699a203a`::ref 1 aborting False >Thread-55989::INFO::2014-05-16 18:23:31,217::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55989::DEBUG::2014-05-16 18:23:31,217::task::1168::TaskManager.Task::(prepare) Task=`4f9ccf32-b9ca-468e-81dc-e3f0699a203a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55989::DEBUG::2014-05-16 18:23:31,218::task::579::TaskManager.Task::(_updateState) Task=`4f9ccf32-b9ca-468e-81dc-e3f0699a203a`::moving from state preparing -> state finished >Thread-55989::DEBUG::2014-05-16 18:23:31,218::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55989::DEBUG::2014-05-16 18:23:31,218::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55989::DEBUG::2014-05-16 18:23:31,218::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55989::DEBUG::2014-05-16 18:23:31,218::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55989::DEBUG::2014-05-16 18:23:31,219::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55989::DEBUG::2014-05-16 18:23:31,219::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55989::DEBUG::2014-05-16 18:23:31,219::task::974::TaskManager.Task::(_decref) Task=`4f9ccf32-b9ca-468e-81dc-e3f0699a203a`::ref 0 aborting False >Thread-55990::DEBUG::2014-05-16 18:23:31,723::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmCreate with ({'custom': {'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256device_e7cab51c-b92e-428e-814f-0ddd820eb5f2device_eafb6d7b-d238-4215-8dd9-3110f8682b84': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=eafb6d7b-d238-4215-8dd9-3110f8682b84, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=ba38fbdc-29ed-43d9-9a8c-27f0a280d256, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256device_e7cab51c-b92e-428e-814f-0ddd820eb5f2': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=e7cab51c-b92e-428e-814f-0ddd820eb5f2, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256device_e7cab51c-b92e-428e-814f-0ddd820eb5f2device_eafb6d7b-d238-4215-8dd9-3110f8682b84device_fa5a012d-31fd-4c49-bd70-3ea3bc126d46': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=fa5a012d-31fd-4c49-bd70-3ea3bc126d46, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=29734779-1d2f-4ffc-8330-e200f40d6e19, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}'}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'cpuType': 'Nehalem', 'vmId': '37e58ee2-45e5-4217-bbc7-48d663e746fe', 'devices': [{'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}}, 'readonly': 'true', 'deviceId': '091a103a-7cfc-4746-8a21-7c0bbfd9cfc0', 'path': '', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '2cb91d9e-a14f-4864-a290-62b347324446'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': '9b0303cb-298e-4007-8f9f-b55104343f8a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'volumeID': '96ce69ca-328f-44f9-801a-300e226dec20', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 'specParams': {}, 'readonly': 'false', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'optional': 'false', 'deviceId': '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'ff6de444-dd38-45df-a169-5c9770a41f28'}, {'specParams': {}, 'deviceId': '38da193f-786a-4380-946f-51968421bd8f', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '2', 'vmType': 'kvm', 'smartcardEnable': 'false', 'timeOffset': '3600', 'memSize': 2048, 'spiceSslCipherSuite': 'DEFAULT', 'smpCoresPerSocket': '1', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'memGuaranteedSize': 1024, 'vmName': 'bob', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} flowID [1f860571] >Thread-55990::INFO::2014-05-16 18:23:31,734::API::648::vds::(_getNetworkIp) network None: using 0 >Thread-55990::INFO::2014-05-16 18:23:31,734::clientIF::394::vds::(createVm) vmContainerLock acquired by vm 37e58ee2-45e5-4217-bbc7-48d663e746fe >Thread-55991::DEBUG::2014-05-16 18:23:31,736::vm::2156::vm.Vm::(_startUnderlyingVm) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Start >Thread-55990::DEBUG::2014-05-16 18:23:31,737::clientIF::407::vds::(createVm) Total desktops after creation of 37e58ee2-45e5-4217-bbc7-48d663e746fe is 1 >Thread-55991::DEBUG::2014-05-16 18:23:31,737::vm::2160::vm.Vm::(_startUnderlyingVm) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::_ongoingCreations acquired >Thread-55990::DEBUG::2014-05-16 18:23:31,737::BindingXMLRPC::982::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '37e58ee2-45e5-4217-bbc7-48d663e746fe', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256device_e7cab51c-b92e-428e-814f-0ddd820eb5f2device_eafb6d7b-d238-4215-8dd9-3110f8682b84': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=eafb6d7b-d238-4215-8dd9-3110f8682b84, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=ba38fbdc-29ed-43d9-9a8c-27f0a280d256, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256device_e7cab51c-b92e-428e-814f-0ddd820eb5f2': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=e7cab51c-b92e-428e-814f-0ddd820eb5f2, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256device_e7cab51c-b92e-428e-814f-0ddd820eb5f2device_eafb6d7b-d238-4215-8dd9-3110f8682b84device_fa5a012d-31fd-4c49-bd70-3ea3bc126d46': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=fa5a012d-31fd-4c49-bd70-3ea3bc126d46, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=29734779-1d2f-4ffc-8330-e200f40d6e19, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}}, 'readonly': 'true', 'deviceId': '091a103a-7cfc-4746-8a21-7c0bbfd9cfc0', 'path': '', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '2cb91d9e-a14f-4864-a290-62b347324446'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': '9b0303cb-298e-4007-8f9f-b55104343f8a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'volumeID': '96ce69ca-328f-44f9-801a-300e226dec20', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 'specParams': {}, 'readonly': 'false', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'optional': 'false', 'deviceId': '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'ff6de444-dd38-45df-a169-5c9770a41f28'}, {'specParams': {}, 'deviceId': '38da193f-786a-4380-946f-51968421bd8f', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'bob', 'display': 'qxl', 'nice': '0'}} >Thread-55991::INFO::2014-05-16 18:23:31,737::vm::3011::vm.Vm::(_run) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::VM wrapper has started >Thread-55991::DEBUG::2014-05-16 18:23:31,739::task::579::TaskManager.Task::(_updateState) Task=`858d0571-936f-422a-8920-3ae3a41f5892`::moving from state init -> state preparing >Thread-55991::INFO::2014-05-16 18:23:31,739::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='8debca93-f8e9-426b-99d9-ca2a9f06cc30', volUUID='96ce69ca-328f-44f9-801a-300e226dec20', options=None) >Thread-55991::INFO::2014-05-16 18:23:31,739::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55991::DEBUG::2014-05-16 18:23:31,739::task::1168::TaskManager.Task::(prepare) Task=`858d0571-936f-422a-8920-3ae3a41f5892`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55991::DEBUG::2014-05-16 18:23:31,739::task::579::TaskManager.Task::(_updateState) Task=`858d0571-936f-422a-8920-3ae3a41f5892`::moving from state preparing -> state finished >Thread-55991::DEBUG::2014-05-16 18:23:31,739::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55991::DEBUG::2014-05-16 18:23:31,740::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55991::DEBUG::2014-05-16 18:23:31,740::task::974::TaskManager.Task::(_decref) Task=`858d0571-936f-422a-8920-3ae3a41f5892`::ref 0 aborting False >Thread-55991::INFO::2014-05-16 18:23:31,814::clientIF::353::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/37e58ee2-45e5-4217-bbc7-48d663e746fe.5956d5b3620f98211d0b1903abc90c25.img >Thread-55991::INFO::2014-05-16 18:23:31,814::clientIF::353::vds::(prepareVolumePath) prepared volume path: >Thread-55991::DEBUG::2014-05-16 18:23:31,815::task::579::TaskManager.Task::(_updateState) Task=`34952c93-546c-4496-b843-9aac4b0d3db5`::moving from state init -> state preparing >Thread-55991::INFO::2014-05-16 18:23:31,815::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='8debca93-f8e9-426b-99d9-ca2a9f06cc30', leafUUID='96ce69ca-328f-44f9-801a-300e226dec20') >Thread-55991::DEBUG::2014-05-16 18:23:31,815::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`f61f5bb5-79ad-47df-8980-69cbcbbf119a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage' >Thread-55991::DEBUG::2014-05-16 18:23:31,816::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-55991::DEBUG::2014-05-16 18:23:31,816::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-55991::DEBUG::2014-05-16 18:23:31,816::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`f61f5bb5-79ad-47df-8980-69cbcbbf119a`::Granted request >Thread-55991::DEBUG::2014-05-16 18:23:31,816::task::811::TaskManager.Task::(resourceAcquired) Task=`34952c93-546c-4496-b843-9aac4b0d3db5`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-55991::DEBUG::2014-05-16 18:23:31,816::task::974::TaskManager.Task::(_decref) Task=`34952c93-546c-4496-b843-9aac4b0d3db5`::ref 1 aborting False >Thread-55991::DEBUG::2014-05-16 18:23:31,817::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55991::DEBUG::2014-05-16 18:23:31,817::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55991::DEBUG::2014-05-16 18:23:31,986::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55991::DEBUG::2014-05-16 18:23:32,002::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55991::DEBUG::2014-05-16 18:23:32,002::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55991::DEBUG::2014-05-16 18:23:32,003::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca f79908bf-a757-4a71-9ab5-3a12ede5f65c/96ce69ca-328f-44f9-801a-300e226dec20' (cwd None) >Thread-55991::DEBUG::2014-05-16 18:23:32,218::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55991::DEBUG::2014-05-16 18:23:32,219::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55991::DEBUG::2014-05-16 18:23:32,219::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55991::DEBUG::2014-05-16 18:23:32,220::blockSD::1039::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30 >Thread-55991::DEBUG::2014-05-16 18:23:32,221::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-55991::DEBUG::2014-05-16 18:23:32,221::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-55991::DEBUG::2014-05-16 18:23:32,370::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55991::DEBUG::2014-05-16 18:23:32,385::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-55991::DEBUG::2014-05-16 18:23:32,385::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-55991::INFO::2014-05-16 18:23:32,386::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20', 'volumeID': '96ce69ca-328f-44f9-801a-300e226dec20', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}, 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20', 'imgVolumesInfo': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20', 'volumeID': '96ce69ca-328f-44f9-801a-300e226dec20', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}]} >Thread-55991::DEBUG::2014-05-16 18:23:32,386::task::1168::TaskManager.Task::(prepare) Task=`34952c93-546c-4496-b843-9aac4b0d3db5`::finished: {'info': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20', 'volumeID': '96ce69ca-328f-44f9-801a-300e226dec20', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}, 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20', 'imgVolumesInfo': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20', 'volumeID': '96ce69ca-328f-44f9-801a-300e226dec20', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}]} >Thread-55991::DEBUG::2014-05-16 18:23:32,386::task::579::TaskManager.Task::(_updateState) Task=`34952c93-546c-4496-b843-9aac4b0d3db5`::moving from state preparing -> state finished >Thread-55991::DEBUG::2014-05-16 18:23:32,387::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-55991::DEBUG::2014-05-16 18:23:32,387::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55991::DEBUG::2014-05-16 18:23:32,387::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-55991::DEBUG::2014-05-16 18:23:32,387::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-55991::DEBUG::2014-05-16 18:23:32,388::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-55991::DEBUG::2014-05-16 18:23:32,388::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-55991::DEBUG::2014-05-16 18:23:32,388::task::974::TaskManager.Task::(_decref) Task=`34952c93-546c-4496-b843-9aac4b0d3db5`::ref 0 aborting False >Thread-55991::INFO::2014-05-16 18:23:32,388::clientIF::353::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20 >Thread-55991::DEBUG::2014-05-16 18:23:32,404::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-55991::DEBUG::2014-05-16 18:23:32,477::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-55991::INFO::2014-05-16 18:23:32,477::hooks::100::root::(_runHooksDir) >Thread-55991::DEBUG::2014-05-16 18:23:32,477::vm::3073::vm.Vm::(_run) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>bob</name> > <uuid>37e58ee2-45e5-4217-bbc7-48d663e746fe</uuid> > <memory>2097152</memory> > <currentMemory>2097152</currentMemory> > <vcpu>2</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/37e58ee2-45e5-4217-bbc7-48d663e746fe.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/37e58ee2-45e5-4217-bbc7-48d663e746fe.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <controller model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" type="qxl" vram="32768"/> > </video> > <disk device="floppy" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/37e58ee2-45e5-4217-bbc7-48d663e746fe.5956d5b3620f98211d0b1903abc90c25.img" startupPolicy="optional"/> > <target bus="fdc" dev="fda"/> > <readonly/> > <serial/> > <readonly/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20"/> > <target bus="virtio" dev="vda"/> > <serial>8debca93-f8e9-426b-99d9-ca2a9f06cc30</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > <memballoon model="virtio"/> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140407.0.el6ev</entry> > <entry name="serial">44454C4C-3500-1054-8036-C6C04F5A5131</entry> > <entry name="uuid">37e58ee2-45e5-4217-bbc7-48d663e746fe</entry> > </system> > </sysinfo> > <clock adjustment="3600" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Nehalem</model> > <topology cores="1" sockets="2" threads="1"/> > </cpu> ></domain> > >libvirtEventLoop::DEBUG::2014-05-16 18:23:32,940::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::event Started detail 0 opaque None >Thread-55991::DEBUG::2014-05-16 18:23:33,014::sampling::285::vm.Vm::(start) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Start statistics collection >Thread-55993::DEBUG::2014-05-16 18:23:33,014::sampling::314::vm.Vm::(run) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Stats thread started >Thread-55993::DEBUG::2014-05-16 18:23:33,021::task::579::TaskManager.Task::(_updateState) Task=`466684cd-ff29-4216-a079-d370e2da101b`::moving from state init -> state preparing >Thread-55991::DEBUG::2014-05-16 18:23:33,021::vmChannels::194::vds::(register) Add fileno 15 to listener's channels. >Thread-55993::INFO::2014-05-16 18:23:33,025::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='8debca93-f8e9-426b-99d9-ca2a9f06cc30', volUUID='96ce69ca-328f-44f9-801a-300e226dec20', options=None) >Thread-55993::INFO::2014-05-16 18:23:33,027::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55993::DEBUG::2014-05-16 18:23:33,027::task::1168::TaskManager.Task::(prepare) Task=`466684cd-ff29-4216-a079-d370e2da101b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-55993::DEBUG::2014-05-16 18:23:33,028::task::579::TaskManager.Task::(_updateState) Task=`466684cd-ff29-4216-a079-d370e2da101b`::moving from state preparing -> state finished >Thread-55993::DEBUG::2014-05-16 18:23:33,028::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55993::DEBUG::2014-05-16 18:23:33,028::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55993::DEBUG::2014-05-16 18:23:33,028::task::974::TaskManager.Task::(_decref) Task=`466684cd-ff29-4216-a079-d370e2da101b`::ref 0 aborting False >Thread-55991::WARNING::2014-05-16 18:23:33,027::vm::3578::vm.Vm::(_readPauseCode) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::_readPauseCode unsupported by libvirt vm >Thread-55991::DEBUG::2014-05-16 18:23:33,035::vm::2177::vm.Vm::(_startUnderlyingVm) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::_ongoingCreations released >Dummy-51::DEBUG::2014-05-16 18:23:33,182::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:33,289::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0516342 s, 19.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-05-16 18:23:33,463::vmChannels::102::vds::(_do_add_channels) fileno 15 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-05-16 18:23:33,463::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 15. >VM Channels Listener::DEBUG::2014-05-16 18:23:33,463::guestIF::147::vm.Vm::(_connect) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Attempting connection to /var/lib/libvirt/qemu/channels/37e58ee2-45e5-4217-bbc7-48d663e746fe.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-05-16 18:23:33,468::guestIF::150::vm.Vm::(_connect) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Connected to /var/lib/libvirt/qemu/channels/37e58ee2-45e5-4217-bbc7-48d663e746fe.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-05-16 18:23:33,468::vmChannels::144::vds::(_handle_unconnected) Connecting to fileno 15 succeeded. >Thread-55995::DEBUG::2014-05-16 18:23:34,493::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('37e58ee2-45e5-4217-bbc7-48d663e746fe',) {} >Thread-55995::DEBUG::2014-05-16 18:23:34,494::vm::600::vm.Vm::(_getCpuStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-55995::DEBUG::2014-05-16 18:23:34,494::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda stats not available >Thread-55995::DEBUG::2014-05-16 18:23:34,494::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc stats not available >Thread-55995::DEBUG::2014-05-16 18:23:34,494::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda stats not available >Thread-55995::DEBUG::2014-05-16 18:23:34,494::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda latency not available >Thread-55995::DEBUG::2014-05-16 18:23:34,494::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc latency not available >Thread-55995::DEBUG::2014-05-16 18:23:34,495::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda latency not available >Thread-55995::DEBUG::2014-05-16 18:23:34,497::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '5039', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '7923552399760490076', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '37e58ee2-45e5-4217-bbc7-48d663e746fe', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.48', 'elapsedTime': '2', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-55997::DEBUG::2014-05-16 18:23:34,999::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55997::DEBUG::2014-05-16 18:23:35,000::task::579::TaskManager.Task::(_updateState) Task=`3894209c-a0fc-4676-b83c-89fec13ea8f0`::moving from state init -> state preparing >Thread-55997::INFO::2014-05-16 18:23:35,000::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55997::INFO::2014-05-16 18:23:35,000::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55997::DEBUG::2014-05-16 18:23:35,000::task::1168::TaskManager.Task::(prepare) Task=`3894209c-a0fc-4676-b83c-89fec13ea8f0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-55997::DEBUG::2014-05-16 18:23:35,001::task::579::TaskManager.Task::(_updateState) Task=`3894209c-a0fc-4676-b83c-89fec13ea8f0`::moving from state preparing -> state finished >Thread-55997::DEBUG::2014-05-16 18:23:35,001::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55997::DEBUG::2014-05-16 18:23:35,001::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55997::DEBUG::2014-05-16 18:23:35,001::task::974::TaskManager.Task::(_decref) Task=`3894209c-a0fc-4676-b83c-89fec13ea8f0`::ref 0 aborting False >Thread-55998::DEBUG::2014-05-16 18:23:35,009::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-55998::DEBUG::2014-05-16 18:23:35,009::task::579::TaskManager.Task::(_updateState) Task=`14ab2483-6392-4efe-a8c8-be18279814a4`::moving from state init -> state preparing >Thread-55998::INFO::2014-05-16 18:23:35,009::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-55998::DEBUG::2014-05-16 18:23:35,010::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bfe3a16d-abc3-43c4-9b7a-94da7586488e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-55998::DEBUG::2014-05-16 18:23:35,010::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-55998::DEBUG::2014-05-16 18:23:35,010::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-55998::DEBUG::2014-05-16 18:23:35,010::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bfe3a16d-abc3-43c4-9b7a-94da7586488e`::Granted request >Thread-55998::DEBUG::2014-05-16 18:23:35,011::task::811::TaskManager.Task::(resourceAcquired) Task=`14ab2483-6392-4efe-a8c8-be18279814a4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-55998::DEBUG::2014-05-16 18:23:35,011::task::974::TaskManager.Task::(_decref) Task=`14ab2483-6392-4efe-a8c8-be18279814a4`::ref 1 aborting False >Thread-55998::INFO::2014-05-16 18:23:35,011::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55998::DEBUG::2014-05-16 18:23:35,011::task::1168::TaskManager.Task::(prepare) Task=`14ab2483-6392-4efe-a8c8-be18279814a4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-55998::DEBUG::2014-05-16 18:23:35,012::task::579::TaskManager.Task::(_updateState) Task=`14ab2483-6392-4efe-a8c8-be18279814a4`::moving from state preparing -> state finished >Thread-55998::DEBUG::2014-05-16 18:23:35,012::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-55998::DEBUG::2014-05-16 18:23:35,012::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55998::DEBUG::2014-05-16 18:23:35,012::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-55998::DEBUG::2014-05-16 18:23:35,012::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-55998::DEBUG::2014-05-16 18:23:35,012::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-55998::DEBUG::2014-05-16 18:23:35,012::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-55998::DEBUG::2014-05-16 18:23:35,013::task::974::TaskManager.Task::(_decref) Task=`14ab2483-6392-4efe-a8c8-be18279814a4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:23:35,302::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:35,370::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294119 s, 34.8 MB/s\n'; <rc> = 0 >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,296::vm::600::vm.Vm::(_getCpuStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,296::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,296::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,296::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,296::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,297::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,297::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,298::vm::600::vm.Vm::(_getCpuStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,298::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,298::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,299::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,299::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,299::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:36,299::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda latency not available >Thread-30::DEBUG::2014-05-16 18:23:36,902::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:23:36,913::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605097 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:37,382::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:37,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0515435 s, 19.9 MB/s\n'; <rc> = 0 >Thread-56000::DEBUG::2014-05-16 18:23:37,826::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('37e58ee2-45e5-4217-bbc7-48d663e746fe',) {} >Thread-56000::DEBUG::2014-05-16 18:23:37,827::vm::600::vm.Vm::(_getCpuStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-56000::DEBUG::2014-05-16 18:23:37,828::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda stats not available >Thread-56000::DEBUG::2014-05-16 18:23:37,828::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc stats not available >Thread-56000::DEBUG::2014-05-16 18:23:37,828::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda stats not available >Thread-56000::DEBUG::2014-05-16 18:23:37,828::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda latency not available >Thread-56000::DEBUG::2014-05-16 18:23:37,828::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc latency not available >Thread-56000::DEBUG::2014-05-16 18:23:37,829::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda latency not available >Thread-56000::DEBUG::2014-05-16 18:23:37,830::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '5039', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '7923552399760490076', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '37e58ee2-45e5-4217-bbc7-48d663e746fe', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.75', 'elapsedTime': '6', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Dummy-51::DEBUG::2014-05-16 18:23:39,514::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:39,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348516 s, 29.4 MB/s\n'; <rc> = 0 >Thread-56002::DEBUG::2014-05-16 18:23:40,982::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('37e58ee2-45e5-4217-bbc7-48d663e746fe',) {} >Thread-56002::DEBUG::2014-05-16 18:23:40,983::vm::600::vm.Vm::(_getCpuStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-56002::DEBUG::2014-05-16 18:23:40,983::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda stats not available >Thread-56002::DEBUG::2014-05-16 18:23:40,983::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc stats not available >Thread-56002::DEBUG::2014-05-16 18:23:40,983::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda stats not available >Thread-56002::DEBUG::2014-05-16 18:23:40,983::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda latency not available >Thread-56002::DEBUG::2014-05-16 18:23:40,983::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc latency not available >Thread-56002::DEBUG::2014-05-16 18:23:40,984::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda latency not available >Thread-56002::DEBUG::2014-05-16 18:23:40,985::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '5039', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '7923552399760490076', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '37e58ee2-45e5-4217-bbc7-48d663e746fe', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.90', 'elapsedTime': '9', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,305::vm::600::vm.Vm::(_getCpuStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,305::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,306::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,306::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,306::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,306::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,306::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,307::vm::600::vm.Vm::(_getCpuStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,308::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,308::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,308::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,308::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,309::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:23:41,309::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda latency not available >Dummy-51::DEBUG::2014-05-16 18:23:41,600::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:41,685::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409412 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:43,698::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:43,783::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396465 s, 25.8 MB/s\n'; <rc> = 0 >Thread-56003::DEBUG::2014-05-16 18:23:44,083::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 62497963.000000 / 8.011756 / 262500000.000000 = 2.971727 >Thread-56003::DEBUG::2014-05-16 18:23:44,083::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.16021299670830857, 'statsAge': 1.3836750984191895, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 2.9717265450951875, 'rxDropped': 0} >Thread-56003::DEBUG::2014-05-16 18:23:44,085::task::579::TaskManager.Task::(_updateState) Task=`f5abd8ce-2be2-459e-b86f-14a5f28bdec2`::moving from state init -> state preparing >Thread-56003::INFO::2014-05-16 18:23:44,085::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56003::INFO::2014-05-16 18:23:44,085::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605097', 'lastCheck': '7.2', 'valid': True}} >Thread-56003::DEBUG::2014-05-16 18:23:44,085::task::1168::TaskManager.Task::(prepare) Task=`f5abd8ce-2be2-459e-b86f-14a5f28bdec2`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605097', 'lastCheck': '7.2', 'valid': True}} >Thread-56003::DEBUG::2014-05-16 18:23:44,086::task::579::TaskManager.Task::(_updateState) Task=`f5abd8ce-2be2-459e-b86f-14a5f28bdec2`::moving from state preparing -> state finished >Thread-56003::DEBUG::2014-05-16 18:23:44,086::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56003::DEBUG::2014-05-16 18:23:44,086::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56003::DEBUG::2014-05-16 18:23:44,086::task::974::TaskManager.Task::(_decref) Task=`f5abd8ce-2be2-459e-b86f-14a5f28bdec2`::ref 0 aborting False >Thread-56004::DEBUG::2014-05-16 18:23:44,148::vm::600::vm.Vm::(_getCpuStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-56004::DEBUG::2014-05-16 18:23:44,148::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda stats not available >Thread-56004::DEBUG::2014-05-16 18:23:44,148::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc stats not available >Thread-56004::DEBUG::2014-05-16 18:23:44,148::vm::656::vm.Vm::(_getDiskStats) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda stats not available >Thread-56004::DEBUG::2014-05-16 18:23:44,148::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk fda latency not available >Thread-56004::DEBUG::2014-05-16 18:23:44,148::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk hdc latency not available >Thread-56004::DEBUG::2014-05-16 18:23:44,149::vm::695::vm.Vm::(_getDiskLatency) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Disk vda latency not available >Thread-56005::DEBUG::2014-05-16 18:23:45,138::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56005::DEBUG::2014-05-16 18:23:45,138::task::579::TaskManager.Task::(_updateState) Task=`fee53c97-c93e-499c-a6b3-4eb7e17e0d75`::moving from state init -> state preparing >Thread-56005::INFO::2014-05-16 18:23:45,138::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56005::INFO::2014-05-16 18:23:45,139::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56005::DEBUG::2014-05-16 18:23:45,139::task::1168::TaskManager.Task::(prepare) Task=`fee53c97-c93e-499c-a6b3-4eb7e17e0d75`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56005::DEBUG::2014-05-16 18:23:45,139::task::579::TaskManager.Task::(_updateState) Task=`fee53c97-c93e-499c-a6b3-4eb7e17e0d75`::moving from state preparing -> state finished >Thread-56005::DEBUG::2014-05-16 18:23:45,139::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56005::DEBUG::2014-05-16 18:23:45,139::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56005::DEBUG::2014-05-16 18:23:45,140::task::974::TaskManager.Task::(_decref) Task=`fee53c97-c93e-499c-a6b3-4eb7e17e0d75`::ref 0 aborting False >Thread-56006::DEBUG::2014-05-16 18:23:45,157::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56006::DEBUG::2014-05-16 18:23:45,157::task::579::TaskManager.Task::(_updateState) Task=`f5405220-c7a0-4bd7-8078-72150a13cad6`::moving from state init -> state preparing >Thread-56006::INFO::2014-05-16 18:23:45,158::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56006::DEBUG::2014-05-16 18:23:45,158::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3833ae85-8359-40c2-b3da-ce72e34db1f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56006::DEBUG::2014-05-16 18:23:45,158::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56006::DEBUG::2014-05-16 18:23:45,158::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56006::DEBUG::2014-05-16 18:23:45,159::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3833ae85-8359-40c2-b3da-ce72e34db1f1`::Granted request >Thread-56006::DEBUG::2014-05-16 18:23:45,159::task::811::TaskManager.Task::(resourceAcquired) Task=`f5405220-c7a0-4bd7-8078-72150a13cad6`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56006::DEBUG::2014-05-16 18:23:45,159::task::974::TaskManager.Task::(_decref) Task=`f5405220-c7a0-4bd7-8078-72150a13cad6`::ref 1 aborting False >Thread-56006::INFO::2014-05-16 18:23:45,160::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56006::DEBUG::2014-05-16 18:23:45,160::task::1168::TaskManager.Task::(prepare) Task=`f5405220-c7a0-4bd7-8078-72150a13cad6`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56006::DEBUG::2014-05-16 18:23:45,160::task::579::TaskManager.Task::(_updateState) Task=`f5405220-c7a0-4bd7-8078-72150a13cad6`::moving from state preparing -> state finished >Thread-56006::DEBUG::2014-05-16 18:23:45,160::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56006::DEBUG::2014-05-16 18:23:45,160::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56006::DEBUG::2014-05-16 18:23:45,161::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56006::DEBUG::2014-05-16 18:23:45,161::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56006::DEBUG::2014-05-16 18:23:45,161::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56006::DEBUG::2014-05-16 18:23:45,161::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56006::DEBUG::2014-05-16 18:23:45,161::task::974::TaskManager.Task::(_decref) Task=`f5405220-c7a0-4bd7-8078-72150a13cad6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:23:45,796::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:45,868::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329823 s, 31.0 MB/s\n'; <rc> = 0 >Thread-56007::DEBUG::2014-05-16 18:23:45,990::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmDestroy with ('37e58ee2-45e5-4217-bbc7-48d663e746fe',) {} flowID [315d65f2] >Thread-56007::INFO::2014-05-16 18:23:45,990::API::324::vds::(destroy) vmContainerLock acquired by vm 37e58ee2-45e5-4217-bbc7-48d663e746fe >Thread-56007::DEBUG::2014-05-16 18:23:45,990::vm::4533::vm.Vm::(destroy) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::destroy Called >Thread-56007::INFO::2014-05-16 18:23:45,998::vm::4479::vm.Vm::(releaseVm) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Release VM resources >Thread-56007::DEBUG::2014-05-16 18:23:46,012::sampling::292::vm.Vm::(stop) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Stop statistics collection >Thread-55993::DEBUG::2014-05-16 18:23:46,013::sampling::323::vm.Vm::(run) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Stats thread finished >Thread-56007::DEBUG::2014-05-16 18:23:46,013::vmChannels::205::vds::(unregister) Delete fileno 15 from listener. >libvirtEventLoop::DEBUG::2014-05-16 18:23:46,443::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::event Stopped detail 1 opaque None >Thread-56007::WARNING::2014-05-16 18:23:46,442::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7ff5344499d0>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7ff5344499d0>> _deviceXML:<disk device="floppy" snapshot="no" type="file"><source file="/var/run/vdsm/payload/37e58ee2-45e5-4217-bbc7-48d663e746fe.5956d5b3620f98211d0b1903abc90c25.img" startupPolicy="optional"/><target bus="fdc" dev="fda"/><readonly/><serial></serial><readonly/></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7ff5344499d0>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7ff5344499d0>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7ff5344499d0>> address:{u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'} alias:fdc0-0-0 apparentsize:0 blockDev:False cache:none conf:{'status': 'Powering down', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '37e58ee2-45e5-4217-bbc7-48d663e746fe', 'pid': '5039', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256device_e7cab51c-b92e-428e-814f-0ddd820eb5f2device_eafb6d7b-d238-4215-8dd9-3110f8682b84': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=eafb6d7b-d238-4215-8dd9-3110f8682b84, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=ba38fbdc-29ed-43d9-9a8c-27f0a280d256, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256device_e7cab51c-b92e-428e-814f-0ddd820eb5f2': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=e7cab51c-b92e-428e-814f-0ddd820eb5f2, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256device_e7cab51c-b92e-428e-814f-0ddd820eb5f2device_eafb6d7b-d238-4215-8dd9-3110f8682b84device_fa5a012d-31fd-4c49-bd70-3ea3bc126d46': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=fa5a012d-31fd-4c49-bd70-3ea3bc126d46, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=29734779-1d2f-4ffc-8330-e200f40d6e19, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}'}, 'pauseCode': 'NOERR', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'alias': u'scsi0', 'specParams': {}, 'deviceId': '38da193f-786a-4380-946f-51968421bd8f', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': '2cb91d9e-a14f-4864-a290-62b347324446', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'index': '0', 'iface': 'fdc', 'name': u'fda', 'alias': u'fdc0-0-0', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}}, 'readonly': 'True', 'deviceId': '091a103a-7cfc-4746-8a21-7c0bbfd9cfc0', 'path': '/var/run/vdsm/payload/37e58ee2-45e5-4217-bbc7-48d663e746fe.5956d5b3620f98211d0b1903abc90c25.img', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'True', 'deviceId': '9b0303cb-298e-4007-8f9f-b55104343f8a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20', 'volumeID': '96ce69ca-328f-44f9-801a-300e226dec20', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk0', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'reqsize': '0', 'format': 'cow', 'deviceId': '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'bootOrder': u'1', 'volumeID': '96ce69ca-328f-44f9-801a-300e226dec20', 'specParams': {}, 'volumeChain': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20', 'volumeID': '96ce69ca-328f-44f9-801a-300e226dec20', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}]}, {'target': 2097152, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': 'ff6de444-dd38-45df-a169-5c9770a41f28', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'bob', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7ff5344499d0>> device:floppy deviceId:091a103a-7cfc-4746-8a21-7c0bbfd9cfc0 drv:raw extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7ff5344499d0>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7ff5344499d0>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7ff5344499d0>> hasVolumeLeases:False iface:fdc index:0 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7ff5344499d0>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7ff5344499d0>> log:<logUtils.SimpleLogAdapter instance at 0x7ff53840d290> name:fda networkDev:False path:/var/run/vdsm/payload/37e58ee2-45e5-4217-bbc7-48d663e746fe.5956d5b3620f98211d0b1903abc90c25.img readonly:True reqsize:0 serial: shared:false specParams:{'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}} transientDisk:False truesize:0 type:floppy volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath > File "/usr/share/vdsm/vm.py", line 1431, in __getitem__ >KeyError: 'domainID' >libvirtEventLoop::INFO::2014-05-16 18:23:46,445::vm::2238::vm.Vm::(_onQemuDeath) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::underlying process disconnected >Thread-56007::WARNING::2014-05-16 18:23:46,447::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7ff534449b10>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7ff534449b10>> _deviceXML:<disk device="cdrom" snapshot="no" type="file"><address bus="1" controller="0" target="0" type="drive" unit="0"/><source file="" startupPolicy="optional"/><target bus="ide" dev="hdc"/><readonly/><serial></serial></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7ff534449b10>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7ff534449b10>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7ff534449b10>> address:{u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'} alias:ide0-1-0 apparentsize:0 blockDev:False cache:none conf:{'status': 'Powering down', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '37e58ee2-45e5-4217-bbc7-48d663e746fe', 'pid': '5039', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256device_e7cab51c-b92e-428e-814f-0ddd820eb5f2device_eafb6d7b-d238-4215-8dd9-3110f8682b84': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=eafb6d7b-d238-4215-8dd9-3110f8682b84, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=ba38fbdc-29ed-43d9-9a8c-27f0a280d256, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256device_e7cab51c-b92e-428e-814f-0ddd820eb5f2': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=e7cab51c-b92e-428e-814f-0ddd820eb5f2, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19device_ba38fbdc-29ed-43d9-9a8c-27f0a280d256device_e7cab51c-b92e-428e-814f-0ddd820eb5f2device_eafb6d7b-d238-4215-8dd9-3110f8682b84device_fa5a012d-31fd-4c49-bd70-3ea3bc126d46': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=fa5a012d-31fd-4c49-bd70-3ea3bc126d46, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_29734779-1d2f-4ffc-8330-e200f40d6e19': 'VmDevice {vmId=37e58ee2-45e5-4217-bbc7-48d663e746fe, deviceId=29734779-1d2f-4ffc-8330-e200f40d6e19, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}'}, 'pauseCode': 'NOERR', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'alias': u'scsi0', 'specParams': {}, 'deviceId': '38da193f-786a-4380-946f-51968421bd8f', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': '2cb91d9e-a14f-4864-a290-62b347324446', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'index': '0', 'iface': 'fdc', 'name': u'fda', 'alias': u'fdc0-0-0', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}}, 'readonly': 'True', 'deviceId': '091a103a-7cfc-4746-8a21-7c0bbfd9cfc0', 'path': '/var/run/vdsm/payload/37e58ee2-45e5-4217-bbc7-48d663e746fe.5956d5b3620f98211d0b1903abc90c25.img', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'True', 'deviceId': '9b0303cb-298e-4007-8f9f-b55104343f8a', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20', 'volumeID': '96ce69ca-328f-44f9-801a-300e226dec20', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk0', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'reqsize': '0', 'format': 'cow', 'deviceId': '8debca93-f8e9-426b-99d9-ca2a9f06cc30', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'bootOrder': u'1', 'volumeID': '96ce69ca-328f-44f9-801a-300e226dec20', 'specParams': {}, 'volumeChain': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20', 'volumeID': '96ce69ca-328f-44f9-801a-300e226dec20', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': '8debca93-f8e9-426b-99d9-ca2a9f06cc30'}]}, {'target': 2097152, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': 'ff6de444-dd38-45df-a169-5c9770a41f28', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'bob', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7ff534449b10>> device:cdrom deviceId:9b0303cb-298e-4007-8f9f-b55104343f8a drv:raw extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7ff534449b10>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7ff534449b10>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7ff534449b10>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7ff534449b10>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7ff534449b10>> log:<logUtils.SimpleLogAdapter instance at 0x7ff53840d290> name:hdc networkDev:False path: readonly:True reqsize:0 serial: shared:false specParams:{'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'} transientDisk:False truesize:0 type:cdrom volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath > File "/usr/share/vdsm/vm.py", line 1431, in __getitem__ >KeyError: 'domainID' >Thread-56007::DEBUG::2014-05-16 18:23:46,450::task::579::TaskManager.Task::(_updateState) Task=`4ed087f6-522d-4015-ac68-53660d7a9e40`::moving from state init -> state preparing >Thread-56007::INFO::2014-05-16 18:23:46,450::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='8debca93-f8e9-426b-99d9-ca2a9f06cc30', volUUID=None) >Thread-56007::DEBUG::2014-05-16 18:23:46,451::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`d3d6b8a0-9a24-4e95-84f2-952058060731`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'teardownImage' >Thread-56007::DEBUG::2014-05-16 18:23:46,451::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-56007::DEBUG::2014-05-16 18:23:46,451::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-56007::DEBUG::2014-05-16 18:23:46,451::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`d3d6b8a0-9a24-4e95-84f2-952058060731`::Granted request >Thread-56007::DEBUG::2014-05-16 18:23:46,452::task::811::TaskManager.Task::(resourceAcquired) Task=`4ed087f6-522d-4015-ac68-53660d7a9e40`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-56007::DEBUG::2014-05-16 18:23:46,452::task::974::TaskManager.Task::(_decref) Task=`4ed087f6-522d-4015-ac68-53660d7a9e40`::ref 1 aborting False >Thread-56007::DEBUG::2014-05-16 18:23:46,453::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-56007::DEBUG::2014-05-16 18:23:46,453::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >VM Channels Listener::DEBUG::2014-05-16 18:23:46,484::vmChannels::112::vds::(_do_del_channels) fileno 15 was removed from listener. >Thread-56007::DEBUG::2014-05-16 18:23:46,620::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56007::DEBUG::2014-05-16 18:23:46,635::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-56007::DEBUG::2014-05-16 18:23:46,635::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-56007::DEBUG::2014-05-16 18:23:46,636::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/96ce69ca-328f-44f9-801a-300e226dec20' (cwd None) >Thread-56007::DEBUG::2014-05-16 18:23:46,807::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56007::DEBUG::2014-05-16 18:23:46,808::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-56007::DEBUG::2014-05-16 18:23:46,808::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-56007::INFO::2014-05-16 18:23:46,808::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-56007::DEBUG::2014-05-16 18:23:46,809::task::1168::TaskManager.Task::(prepare) Task=`4ed087f6-522d-4015-ac68-53660d7a9e40`::finished: None >Thread-56007::DEBUG::2014-05-16 18:23:46,809::task::579::TaskManager.Task::(_updateState) Task=`4ed087f6-522d-4015-ac68-53660d7a9e40`::moving from state preparing -> state finished >Thread-56007::DEBUG::2014-05-16 18:23:46,809::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-56007::DEBUG::2014-05-16 18:23:46,809::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56007::DEBUG::2014-05-16 18:23:46,809::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-56007::DEBUG::2014-05-16 18:23:46,810::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-56007::DEBUG::2014-05-16 18:23:46,810::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-56007::DEBUG::2014-05-16 18:23:46,810::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-56007::DEBUG::2014-05-16 18:23:46,810::task::974::TaskManager.Task::(_decref) Task=`4ed087f6-522d-4015-ac68-53660d7a9e40`::ref 0 aborting False >Thread-56007::DEBUG::2014-05-16 18:23:46,811::task::579::TaskManager.Task::(_updateState) Task=`cd03a5cf-e879-47d2-aa76-763f9990b8cf`::moving from state init -> state preparing >Thread-56007::INFO::2014-05-16 18:23:46,812::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='37e58ee2-45e5-4217-bbc7-48d663e746fe') >Thread-56007::INFO::2014-05-16 18:23:46,813::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-56007::DEBUG::2014-05-16 18:23:46,813::task::1168::TaskManager.Task::(prepare) Task=`cd03a5cf-e879-47d2-aa76-763f9990b8cf`::finished: None >Thread-56007::DEBUG::2014-05-16 18:23:46,814::task::579::TaskManager.Task::(_updateState) Task=`cd03a5cf-e879-47d2-aa76-763f9990b8cf`::moving from state preparing -> state finished >Thread-56007::DEBUG::2014-05-16 18:23:46,814::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56007::DEBUG::2014-05-16 18:23:46,814::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56007::DEBUG::2014-05-16 18:23:46,814::task::974::TaskManager.Task::(_decref) Task=`cd03a5cf-e879-47d2-aa76-763f9990b8cf`::ref 0 aborting False >Thread-56007::DEBUG::2014-05-16 18:23:46,815::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd' (cwd None) >Thread-30::DEBUG::2014-05-16 18:23:46,956::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:23:46,966::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060567 s, 6.8 MB/s\n'; <rc> = 0 >Thread-56007::DEBUG::2014-05-16 18:23:47,116::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56007::INFO::2014-05-16 18:23:47,116::hooks::100::root::(_runHooksDir) >Thread-56007::DEBUG::2014-05-16 18:23:47,117::vm::4527::vm.Vm::(deleteVm) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Total desktops after destroy of 37e58ee2-45e5-4217-bbc7-48d663e746fe is 0 >Thread-56007::DEBUG::2014-05-16 18:23:47,117::BindingXMLRPC::982::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >libvirtEventLoop::DEBUG::2014-05-16 18:23:47,118::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '37e58ee2-45e5-4217-bbc7-48d663e746fe' >libvirtEventLoop::DEBUG::2014-05-16 18:23:47,118::vm::2657::vm.Vm::(setDownStatus) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Changed state to Down: Admin shut down >libvirtEventLoop::DEBUG::2014-05-16 18:23:47,118::sampling::292::vm.Vm::(stop) vmId=`37e58ee2-45e5-4217-bbc7-48d663e746fe`::Stop statistics collection >libvirtEventLoop::DEBUG::2014-05-16 18:23:47,119::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '37e58ee2-45e5-4217-bbc7-48d663e746fe' >Dummy-51::DEBUG::2014-05-16 18:23:47,880::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:47,952::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03506 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:49,964::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:50,032::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310859 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:52,044::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:52,115::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345313 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:54,126::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:54,198::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352703 s, 29.0 MB/s\n'; <rc> = 0 >Thread-56012::DEBUG::2014-05-16 18:23:55,310::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56012::DEBUG::2014-05-16 18:23:55,310::task::579::TaskManager.Task::(_updateState) Task=`b57976b6-e818-4c11-8edd-6755ba19e712`::moving from state init -> state preparing >Thread-56012::INFO::2014-05-16 18:23:55,310::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56012::INFO::2014-05-16 18:23:55,311::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56012::DEBUG::2014-05-16 18:23:55,311::task::1168::TaskManager.Task::(prepare) Task=`b57976b6-e818-4c11-8edd-6755ba19e712`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56012::DEBUG::2014-05-16 18:23:55,311::task::579::TaskManager.Task::(_updateState) Task=`b57976b6-e818-4c11-8edd-6755ba19e712`::moving from state preparing -> state finished >Thread-56012::DEBUG::2014-05-16 18:23:55,311::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56012::DEBUG::2014-05-16 18:23:55,311::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56012::DEBUG::2014-05-16 18:23:55,311::task::974::TaskManager.Task::(_decref) Task=`b57976b6-e818-4c11-8edd-6755ba19e712`::ref 0 aborting False >Thread-56013::DEBUG::2014-05-16 18:23:55,323::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56013::DEBUG::2014-05-16 18:23:55,324::task::579::TaskManager.Task::(_updateState) Task=`9aa4dad0-2794-48ba-9135-65f39fb76d20`::moving from state init -> state preparing >Thread-56013::INFO::2014-05-16 18:23:55,324::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56013::DEBUG::2014-05-16 18:23:55,324::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`844ca997-17e1-4cb0-aa7d-13a9bb848064`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56013::DEBUG::2014-05-16 18:23:55,324::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56013::DEBUG::2014-05-16 18:23:55,325::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56013::DEBUG::2014-05-16 18:23:55,325::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`844ca997-17e1-4cb0-aa7d-13a9bb848064`::Granted request >Thread-56013::DEBUG::2014-05-16 18:23:55,325::task::811::TaskManager.Task::(resourceAcquired) Task=`9aa4dad0-2794-48ba-9135-65f39fb76d20`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56013::DEBUG::2014-05-16 18:23:55,325::task::974::TaskManager.Task::(_decref) Task=`9aa4dad0-2794-48ba-9135-65f39fb76d20`::ref 1 aborting False >Thread-56013::INFO::2014-05-16 18:23:55,326::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56013::DEBUG::2014-05-16 18:23:55,326::task::1168::TaskManager.Task::(prepare) Task=`9aa4dad0-2794-48ba-9135-65f39fb76d20`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56013::DEBUG::2014-05-16 18:23:55,326::task::579::TaskManager.Task::(_updateState) Task=`9aa4dad0-2794-48ba-9135-65f39fb76d20`::moving from state preparing -> state finished >Thread-56013::DEBUG::2014-05-16 18:23:55,327::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56013::DEBUG::2014-05-16 18:23:55,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56013::DEBUG::2014-05-16 18:23:55,327::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56013::DEBUG::2014-05-16 18:23:55,327::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56013::DEBUG::2014-05-16 18:23:55,327::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56013::DEBUG::2014-05-16 18:23:55,327::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56013::DEBUG::2014-05-16 18:23:55,328::task::974::TaskManager.Task::(_decref) Task=`9aa4dad0-2794-48ba-9135-65f39fb76d20`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:23:56,209::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:56,277::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310927 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:23:57,006::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:23:57,017::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00081464 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:23:58,289::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:23:58,361::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348876 s, 29.4 MB/s\n'; <rc> = 0 >Thread-56015::DEBUG::2014-05-16 18:23:59,524::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4327543.000000 / 8.008768 / 262500000.000000 = 0.205848 >Thread-56015::DEBUG::2014-05-16 18:23:59,525::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053633599578150372, 'statsAge': 0.80647706985473633, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20584787095732976, 'rxDropped': 0} >Thread-56015::DEBUG::2014-05-16 18:23:59,525::task::579::TaskManager.Task::(_updateState) Task=`ad98ed99-65c3-49d1-be78-db4d017abbe6`::moving from state init -> state preparing >Thread-56015::INFO::2014-05-16 18:23:59,525::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56015::INFO::2014-05-16 18:23:59,526::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00081464', 'lastCheck': '2.5', 'valid': True}} >Thread-56015::DEBUG::2014-05-16 18:23:59,526::task::1168::TaskManager.Task::(prepare) Task=`ad98ed99-65c3-49d1-be78-db4d017abbe6`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00081464', 'lastCheck': '2.5', 'valid': True}} >Thread-56015::DEBUG::2014-05-16 18:23:59,526::task::579::TaskManager.Task::(_updateState) Task=`ad98ed99-65c3-49d1-be78-db4d017abbe6`::moving from state preparing -> state finished >Thread-56015::DEBUG::2014-05-16 18:23:59,526::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56015::DEBUG::2014-05-16 18:23:59,526::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56015::DEBUG::2014-05-16 18:23:59,526::task::974::TaskManager.Task::(_decref) Task=`ad98ed99-65c3-49d1-be78-db4d017abbe6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:24:00,373::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:00,440::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315751 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:02,453::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:02,520::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303769 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:04,532::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:04,602::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334782 s, 30.6 MB/s\n'; <rc> = 0 >Thread-56018::DEBUG::2014-05-16 18:24:05,522::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56018::DEBUG::2014-05-16 18:24:05,522::task::579::TaskManager.Task::(_updateState) Task=`8779078d-0de4-4062-b941-0290abbe9304`::moving from state init -> state preparing >Thread-56018::INFO::2014-05-16 18:24:05,522::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56018::INFO::2014-05-16 18:24:05,523::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56018::DEBUG::2014-05-16 18:24:05,523::task::1168::TaskManager.Task::(prepare) Task=`8779078d-0de4-4062-b941-0290abbe9304`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56018::DEBUG::2014-05-16 18:24:05,523::task::579::TaskManager.Task::(_updateState) Task=`8779078d-0de4-4062-b941-0290abbe9304`::moving from state preparing -> state finished >Thread-56018::DEBUG::2014-05-16 18:24:05,523::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56018::DEBUG::2014-05-16 18:24:05,523::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56018::DEBUG::2014-05-16 18:24:05,523::task::974::TaskManager.Task::(_decref) Task=`8779078d-0de4-4062-b941-0290abbe9304`::ref 0 aborting False >Thread-56019::DEBUG::2014-05-16 18:24:05,549::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56019::DEBUG::2014-05-16 18:24:05,549::task::579::TaskManager.Task::(_updateState) Task=`3e027623-ce89-448b-ade1-11787e0b82d4`::moving from state init -> state preparing >Thread-56019::INFO::2014-05-16 18:24:05,550::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56019::DEBUG::2014-05-16 18:24:05,550::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`623bce57-ad06-4c8b-994e-fd4975a0e292`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56019::DEBUG::2014-05-16 18:24:05,550::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56019::DEBUG::2014-05-16 18:24:05,550::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56019::DEBUG::2014-05-16 18:24:05,551::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`623bce57-ad06-4c8b-994e-fd4975a0e292`::Granted request >Thread-56019::DEBUG::2014-05-16 18:24:05,551::task::811::TaskManager.Task::(resourceAcquired) Task=`3e027623-ce89-448b-ade1-11787e0b82d4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56019::DEBUG::2014-05-16 18:24:05,551::task::974::TaskManager.Task::(_decref) Task=`3e027623-ce89-448b-ade1-11787e0b82d4`::ref 1 aborting False >Thread-56019::INFO::2014-05-16 18:24:05,552::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56019::DEBUG::2014-05-16 18:24:05,552::task::1168::TaskManager.Task::(prepare) Task=`3e027623-ce89-448b-ade1-11787e0b82d4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56019::DEBUG::2014-05-16 18:24:05,552::task::579::TaskManager.Task::(_updateState) Task=`3e027623-ce89-448b-ade1-11787e0b82d4`::moving from state preparing -> state finished >Thread-56019::DEBUG::2014-05-16 18:24:05,552::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56019::DEBUG::2014-05-16 18:24:05,552::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56019::DEBUG::2014-05-16 18:24:05,553::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56019::DEBUG::2014-05-16 18:24:05,553::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56019::DEBUG::2014-05-16 18:24:05,553::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56019::DEBUG::2014-05-16 18:24:05,553::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56019::DEBUG::2014-05-16 18:24:05,553::task::974::TaskManager.Task::(_decref) Task=`3e027623-ce89-448b-ade1-11787e0b82d4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:24:06,613::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:06,685::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352159 s, 29.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:24:07,056::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:24:07,066::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000536577 s, 7.6 MB/s\n'; <rc> = 0 >Thread-56021::DEBUG::2014-05-16 18:24:08,193::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [55827e0f] >Thread-56021::DEBUG::2014-05-16 18:24:08,193::task::579::TaskManager.Task::(_updateState) Task=`c805544e-7609-45d3-a044-e243a0c47340`::moving from state init -> state preparing >Thread-56021::INFO::2014-05-16 18:24:08,193::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='8debca93-f8e9-426b-99d9-ca2a9f06cc30', postZero='false', force='false') >Thread-56021::DEBUG::2014-05-16 18:24:08,194::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.8debca93-f8e9-426b-99d9-ca2a9f06cc30`ReqID=`c7d73659-7f44-4b6d-a952-010f84aa4834`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1526' at 'deleteImage' >Thread-56021::DEBUG::2014-05-16 18:24:08,194::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.8debca93-f8e9-426b-99d9-ca2a9f06cc30' for lock type 'exclusive' >Thread-56021::DEBUG::2014-05-16 18:24:08,194::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.8debca93-f8e9-426b-99d9-ca2a9f06cc30' is free. Now locking as 'exclusive' (1 active user) >Thread-56021::DEBUG::2014-05-16 18:24:08,194::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.8debca93-f8e9-426b-99d9-ca2a9f06cc30`ReqID=`c7d73659-7f44-4b6d-a952-010f84aa4834`::Granted request >Thread-56021::DEBUG::2014-05-16 18:24:08,195::task::811::TaskManager.Task::(resourceAcquired) Task=`c805544e-7609-45d3-a044-e243a0c47340`::_resourcesAcquired: Storage.8debca93-f8e9-426b-99d9-ca2a9f06cc30 (exclusive) >Thread-56021::DEBUG::2014-05-16 18:24:08,195::task::974::TaskManager.Task::(_decref) Task=`c805544e-7609-45d3-a044-e243a0c47340`::ref 1 aborting False >Thread-56021::DEBUG::2014-05-16 18:24:08,195::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`1e416a4b-3f25-4077-9258-ad5bf2ea8733`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1527' at 'deleteImage' >Thread-56021::DEBUG::2014-05-16 18:24:08,195::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-56021::DEBUG::2014-05-16 18:24:08,195::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-56021::DEBUG::2014-05-16 18:24:08,195::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`1e416a4b-3f25-4077-9258-ad5bf2ea8733`::Granted request >Thread-56021::DEBUG::2014-05-16 18:24:08,196::task::811::TaskManager.Task::(resourceAcquired) Task=`c805544e-7609-45d3-a044-e243a0c47340`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-56021::DEBUG::2014-05-16 18:24:08,196::task::974::TaskManager.Task::(_decref) Task=`c805544e-7609-45d3-a044-e243a0c47340`::ref 1 aborting False >Thread-56021::DEBUG::2014-05-16 18:24:08,196::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-56021::DEBUG::2014-05-16 18:24:08,197::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-56021::DEBUG::2014-05-16 18:24:08,361::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56021::DEBUG::2014-05-16 18:24:08,377::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-56021::DEBUG::2014-05-16 18:24:08,377::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-56021::DEBUG::2014-05-16 18:24:08,378::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n -a y --deltag IU_8debca93-f8e9-426b-99d9-ca2a9f06cc30 --addtag IU__remove_me_8debca93-f8e9-426b-99d9-ca2a9f06cc30 f79908bf-a757-4a71-9ab5-3a12ede5f65c/96ce69ca-328f-44f9-801a-300e226dec20' (cwd None) >Thread-56021::DEBUG::2014-05-16 18:24:08,642::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-56021::DEBUG::2014-05-16 18:24:08,643::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-56021::DEBUG::2014-05-16 18:24:08,643::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-56021::WARNING::2014-05-16 18:24:08,643::lvm::1108::Storage.LVM::(removeLVs) Removing active volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/96ce69ca-328f-44f9-801a-300e226dec20 >Thread-56021::DEBUG::2014-05-16 18:24:08,644::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n f79908bf-a757-4a71-9ab5-3a12ede5f65c/96ce69ca-328f-44f9-801a-300e226dec20' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:08,696::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:08,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0447434 s, 22.9 MB/s\n'; <rc> = 0 >Thread-56021::DEBUG::2014-05-16 18:24:08,836::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-56021::DEBUG::2014-05-16 18:24:08,836::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-56021::DEBUG::2014-05-16 18:24:08,837::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-56021::DEBUG::2014-05-16 18:24:08,837::blockSD::935::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30/96ce69ca-328f-44f9-801a-300e226dec20'] >Thread-56021::DEBUG::2014-05-16 18:24:08,837::blockSD::946::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/8debca93-f8e9-426b-99d9-ca2a9f06cc30 >Thread-56021::DEBUG::2014-05-16 18:24:08,839::task::736::TaskManager.Task::(_save) Task=`c805544e-7609-45d3-a044-e243a0c47340`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c805544e-7609-45d3-a044-e243a0c47340 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c805544e-7609-45d3-a044-e243a0c47340.temp >Thread-56021::DEBUG::2014-05-16 18:24:08,844::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_8debca93-f8e9-426b-99d9-ca2a9f06cc30 for task c805544e-7609-45d3-a044-e243a0c47340 >Thread-56021::INFO::2014-05-16 18:24:08,845::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-56021::DEBUG::2014-05-16 18:24:08,845::task::1163::TaskManager.Task::(prepare) Task=`c805544e-7609-45d3-a044-e243a0c47340`::Prepare: 1 jobs exist, move to acquiring >Thread-56021::DEBUG::2014-05-16 18:24:08,845::task::579::TaskManager.Task::(_updateState) Task=`c805544e-7609-45d3-a044-e243a0c47340`::moving from state preparing -> state acquiring >Thread-56021::DEBUG::2014-05-16 18:24:08,845::task::736::TaskManager.Task::(_save) Task=`c805544e-7609-45d3-a044-e243a0c47340`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c805544e-7609-45d3-a044-e243a0c47340 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c805544e-7609-45d3-a044-e243a0c47340.temp >Thread-56021::DEBUG::2014-05-16 18:24:08,851::task::579::TaskManager.Task::(_updateState) Task=`c805544e-7609-45d3-a044-e243a0c47340`::moving from state acquiring -> state queued >Thread-56021::DEBUG::2014-05-16 18:24:08,852::task::736::TaskManager.Task::(_save) Task=`c805544e-7609-45d3-a044-e243a0c47340`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c805544e-7609-45d3-a044-e243a0c47340 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c805544e-7609-45d3-a044-e243a0c47340.temp >Thread-56021::DEBUG::2014-05-16 18:24:08,857::taskManager::50::TaskManager::(_queueTask) queuing task: c805544e-7609-45d3-a044-e243a0c47340 >Thread-56021::DEBUG::2014-05-16 18:24:08,857::taskManager::56::TaskManager::(_queueTask) task queued: c805544e-7609-45d3-a044-e243a0c47340 >Thread-4::DEBUG::2014-05-16 18:24:08,858::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-56021::DEBUG::2014-05-16 18:24:08,858::task::1165::TaskManager.Task::(prepare) Task=`c805544e-7609-45d3-a044-e243a0c47340`::returning >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,859::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: c805544e-7609-45d3-a044-e243a0c47340 running: <bound method Task.commit of <storage.task.Task instance at 0x2b22ea8>> with: None >Thread-56021::DEBUG::2014-05-16 18:24:08,859::task::974::TaskManager.Task::(_decref) Task=`c805544e-7609-45d3-a044-e243a0c47340`::ref 0 aborting False >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,860::task::1176::TaskManager.Task::(commit) Task=`c805544e-7609-45d3-a044-e243a0c47340`::committing task: c805544e-7609-45d3-a044-e243a0c47340 >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,861::task::579::TaskManager.Task::(_updateState) Task=`c805544e-7609-45d3-a044-e243a0c47340`::moving from state queued -> state running >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,861::task::736::TaskManager.Task::(_save) Task=`c805544e-7609-45d3-a044-e243a0c47340`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c805544e-7609-45d3-a044-e243a0c47340 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c805544e-7609-45d3-a044-e243a0c47340.temp >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,866::task::889::TaskManager.Task::(_runJobs) Task=`c805544e-7609-45d3-a044-e243a0c47340`::Task.run: running job 0: deleteImage_8debca93-f8e9-426b-99d9-ca2a9f06cc30: <function <lambda> at 0x7ff5384a92a8> (args: () kwargs: {}) >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,867::task::315::TaskManager.Task::(run) Task=`c805544e-7609-45d3-a044-e243a0c47340`::Job.run: running deleteImage_8debca93-f8e9-426b-99d9-ca2a9f06cc30: <function <lambda> at 0x7ff5384a92a8> (args: () kwargs: {}) callback None >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,867::task::579::TaskManager.Task::(_updateState) Task=`c805544e-7609-45d3-a044-e243a0c47340`::moving from state running -> state finished >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,867::task::736::TaskManager.Task::(_save) Task=`c805544e-7609-45d3-a044-e243a0c47340`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c805544e-7609-45d3-a044-e243a0c47340 temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/c805544e-7609-45d3-a044-e243a0c47340.temp >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,873::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>, 'Storage.8debca93-f8e9-426b-99d9-ca2a9f06cc30': < ResourceRef 'Storage.8debca93-f8e9-426b-99d9-ca2a9f06cc30', isValid: 'True' obj: 'None'>} >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,874::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,874::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,874::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,874::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,874::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.8debca93-f8e9-426b-99d9-ca2a9f06cc30' >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,875::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.8debca93-f8e9-426b-99d9-ca2a9f06cc30' (0 active users) >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,875::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.8debca93-f8e9-426b-99d9-ca2a9f06cc30' is free, finding out if anyone is waiting for it. >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,875::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8debca93-f8e9-426b-99d9-ca2a9f06cc30', Clearing records. >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,875::task::897::TaskManager.Task::(_runJobs) Task=`c805544e-7609-45d3-a044-e243a0c47340`::Task.run: exit - success: result True >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,875::task::974::TaskManager.Task::(_decref) Task=`c805544e-7609-45d3-a044-e243a0c47340`::ref 0 aborting False >c805544e-7609-45d3-a044-e243a0c47340::DEBUG::2014-05-16 18:24:08,875::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-51::DEBUG::2014-05-16 18:24:10,792::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:10,859::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308102 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:12,871::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:12,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351585 s, 29.1 MB/s\n'; <rc> = 0 >Thread-56024::DEBUG::2014-05-16 18:24:14,660::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56024::DEBUG::2014-05-16 18:24:14,661::task::579::TaskManager.Task::(_updateState) Task=`dfff5959-77f2-4ad4-8904-20b8e2622d33`::moving from state init -> state preparing >Thread-56024::INFO::2014-05-16 18:24:14,661::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-56024::DEBUG::2014-05-16 18:24:14,661::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-56024::DEBUG::2014-05-16 18:24:14,661::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c805544e-7609-45d3-a044-e243a0c47340 >Thread-56024::DEBUG::2014-05-16 18:24:14,662::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c805544e-7609-45d3-a044-e243a0c47340'} >Thread-56024::DEBUG::2014-05-16 18:24:14,662::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'c805544e-7609-45d3-a044-e243a0c47340': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c805544e-7609-45d3-a044-e243a0c47340'}} >Thread-56024::INFO::2014-05-16 18:24:14,662::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'c805544e-7609-45d3-a044-e243a0c47340': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c805544e-7609-45d3-a044-e243a0c47340'}}} >Thread-56024::DEBUG::2014-05-16 18:24:14,662::task::1168::TaskManager.Task::(prepare) Task=`dfff5959-77f2-4ad4-8904-20b8e2622d33`::finished: {'allTasksStatus': {'c805544e-7609-45d3-a044-e243a0c47340': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c805544e-7609-45d3-a044-e243a0c47340'}}} >Thread-56024::DEBUG::2014-05-16 18:24:14,662::task::579::TaskManager.Task::(_updateState) Task=`dfff5959-77f2-4ad4-8904-20b8e2622d33`::moving from state preparing -> state finished >Thread-56024::DEBUG::2014-05-16 18:24:14,662::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56024::DEBUG::2014-05-16 18:24:14,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56024::DEBUG::2014-05-16 18:24:14,663::task::974::TaskManager.Task::(_decref) Task=`dfff5959-77f2-4ad4-8904-20b8e2622d33`::ref 0 aborting False >Thread-56025::DEBUG::2014-05-16 18:24:14,722::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56025::DEBUG::2014-05-16 18:24:14,723::task::579::TaskManager.Task::(_updateState) Task=`e634c53a-8cd8-48eb-9ba5-d2014bc98eed`::moving from state init -> state preparing >Thread-56025::INFO::2014-05-16 18:24:14,723::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='c805544e-7609-45d3-a044-e243a0c47340', spUUID=None, options=None) >Thread-56025::DEBUG::2014-05-16 18:24:14,723::taskManager::161::TaskManager::(clearTask) Entry. taskID: c805544e-7609-45d3-a044-e243a0c47340 >Thread-56025::DEBUG::2014-05-16 18:24:14,724::taskManager::166::TaskManager::(clearTask) Return. >Thread-56025::INFO::2014-05-16 18:24:14,724::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-56025::DEBUG::2014-05-16 18:24:14,724::task::1168::TaskManager.Task::(prepare) Task=`e634c53a-8cd8-48eb-9ba5-d2014bc98eed`::finished: None >Thread-56025::DEBUG::2014-05-16 18:24:14,724::task::579::TaskManager.Task::(_updateState) Task=`e634c53a-8cd8-48eb-9ba5-d2014bc98eed`::moving from state preparing -> state finished >Thread-56025::DEBUG::2014-05-16 18:24:14,724::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56025::DEBUG::2014-05-16 18:24:14,725::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56025::DEBUG::2014-05-16 18:24:14,725::task::974::TaskManager.Task::(_decref) Task=`e634c53a-8cd8-48eb-9ba5-d2014bc98eed`::ref 0 aborting False >Thread-56026::DEBUG::2014-05-16 18:24:14,747::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 6171653.000000 / 8.011655 / 262500000.000000 = 0.293461 >Thread-56026::DEBUG::2014-05-16 18:24:14,747::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.025129389331178229, 'statsAge': 0.0087120532989501953, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.29346069915557671, 'rxDropped': 0} >Thread-56026::DEBUG::2014-05-16 18:24:14,747::task::579::TaskManager.Task::(_updateState) Task=`6eec768a-23e8-46e2-ab91-d065fa926435`::moving from state init -> state preparing >Thread-56026::INFO::2014-05-16 18:24:14,748::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56026::INFO::2014-05-16 18:24:14,748::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536577', 'lastCheck': '7.7', 'valid': True}} >Thread-56026::DEBUG::2014-05-16 18:24:14,748::task::1168::TaskManager.Task::(prepare) Task=`6eec768a-23e8-46e2-ab91-d065fa926435`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536577', 'lastCheck': '7.7', 'valid': True}} >Thread-56026::DEBUG::2014-05-16 18:24:14,748::task::579::TaskManager.Task::(_updateState) Task=`6eec768a-23e8-46e2-ab91-d065fa926435`::moving from state preparing -> state finished >Thread-56026::DEBUG::2014-05-16 18:24:14,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56026::DEBUG::2014-05-16 18:24:14,748::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56026::DEBUG::2014-05-16 18:24:14,749::task::974::TaskManager.Task::(_decref) Task=`6eec768a-23e8-46e2-ab91-d065fa926435`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:24:14,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:15,026::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354907 s, 28.9 MB/s\n'; <rc> = 0 >Thread-56028::DEBUG::2014-05-16 18:24:16,014::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56028::DEBUG::2014-05-16 18:24:16,014::task::579::TaskManager.Task::(_updateState) Task=`edeebb53-25cb-44b2-b3a6-878f957b7001`::moving from state init -> state preparing >Thread-56028::INFO::2014-05-16 18:24:16,014::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56028::INFO::2014-05-16 18:24:16,014::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56028::DEBUG::2014-05-16 18:24:16,015::task::1168::TaskManager.Task::(prepare) Task=`edeebb53-25cb-44b2-b3a6-878f957b7001`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56028::DEBUG::2014-05-16 18:24:16,015::task::579::TaskManager.Task::(_updateState) Task=`edeebb53-25cb-44b2-b3a6-878f957b7001`::moving from state preparing -> state finished >Thread-56028::DEBUG::2014-05-16 18:24:16,015::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56028::DEBUG::2014-05-16 18:24:16,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56028::DEBUG::2014-05-16 18:24:16,015::task::974::TaskManager.Task::(_decref) Task=`edeebb53-25cb-44b2-b3a6-878f957b7001`::ref 0 aborting False >Thread-56029::DEBUG::2014-05-16 18:24:16,061::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56029::DEBUG::2014-05-16 18:24:16,062::task::579::TaskManager.Task::(_updateState) Task=`1f1c7558-1c13-427f-8122-57d3548b5b10`::moving from state init -> state preparing >Thread-56029::INFO::2014-05-16 18:24:16,062::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56029::DEBUG::2014-05-16 18:24:16,062::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`74c3711c-4bea-4e29-a261-28792c6f5fd4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56029::DEBUG::2014-05-16 18:24:16,062::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56029::DEBUG::2014-05-16 18:24:16,063::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56029::DEBUG::2014-05-16 18:24:16,063::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`74c3711c-4bea-4e29-a261-28792c6f5fd4`::Granted request >Thread-56029::DEBUG::2014-05-16 18:24:16,063::task::811::TaskManager.Task::(resourceAcquired) Task=`1f1c7558-1c13-427f-8122-57d3548b5b10`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56029::DEBUG::2014-05-16 18:24:16,063::task::974::TaskManager.Task::(_decref) Task=`1f1c7558-1c13-427f-8122-57d3548b5b10`::ref 1 aborting False >Thread-56029::DEBUG::2014-05-16 18:24:16,064::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-56029::DEBUG::2014-05-16 18:24:16,064::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-56029::DEBUG::2014-05-16 18:24:16,215::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56029::DEBUG::2014-05-16 18:24:16,217::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-56029::INFO::2014-05-16 18:24:16,217::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56029::DEBUG::2014-05-16 18:24:16,218::task::1168::TaskManager.Task::(prepare) Task=`1f1c7558-1c13-427f-8122-57d3548b5b10`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56029::DEBUG::2014-05-16 18:24:16,218::task::579::TaskManager.Task::(_updateState) Task=`1f1c7558-1c13-427f-8122-57d3548b5b10`::moving from state preparing -> state finished >Thread-56029::DEBUG::2014-05-16 18:24:16,218::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56029::DEBUG::2014-05-16 18:24:16,218::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56029::DEBUG::2014-05-16 18:24:16,219::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56029::DEBUG::2014-05-16 18:24:16,219::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56029::DEBUG::2014-05-16 18:24:16,219::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56029::DEBUG::2014-05-16 18:24:16,219::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56029::DEBUG::2014-05-16 18:24:16,219::task::974::TaskManager.Task::(_decref) Task=`1f1c7558-1c13-427f-8122-57d3548b5b10`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:24:17,038::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 18:24:17,209::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:24:17,235::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643302 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:17,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313199 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:19,350::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:19,429::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.04375 s, 23.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:21,441::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:21,508::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304053 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:23,520::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:23,587::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308062 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:25,598::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:25,665::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312194 s, 32.8 MB/s\n'; <rc> = 0 >Thread-56033::DEBUG::2014-05-16 18:24:26,274::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56033::DEBUG::2014-05-16 18:24:26,274::task::579::TaskManager.Task::(_updateState) Task=`7f953513-9e01-431a-bdb0-43ec228a85f7`::moving from state init -> state preparing >Thread-56033::INFO::2014-05-16 18:24:26,275::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56033::INFO::2014-05-16 18:24:26,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56033::DEBUG::2014-05-16 18:24:26,275::task::1168::TaskManager.Task::(prepare) Task=`7f953513-9e01-431a-bdb0-43ec228a85f7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56033::DEBUG::2014-05-16 18:24:26,275::task::579::TaskManager.Task::(_updateState) Task=`7f953513-9e01-431a-bdb0-43ec228a85f7`::moving from state preparing -> state finished >Thread-56033::DEBUG::2014-05-16 18:24:26,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56033::DEBUG::2014-05-16 18:24:26,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56033::DEBUG::2014-05-16 18:24:26,276::task::974::TaskManager.Task::(_decref) Task=`7f953513-9e01-431a-bdb0-43ec228a85f7`::ref 0 aborting False >Thread-56034::DEBUG::2014-05-16 18:24:26,287::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56034::DEBUG::2014-05-16 18:24:26,287::task::579::TaskManager.Task::(_updateState) Task=`580c655c-1f0c-4e15-914f-37a5ac96d685`::moving from state init -> state preparing >Thread-56034::INFO::2014-05-16 18:24:26,287::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56034::DEBUG::2014-05-16 18:24:26,288::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9b3c4708-4985-4a5d-b15c-4c51cd1f3c7c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56034::DEBUG::2014-05-16 18:24:26,288::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56034::DEBUG::2014-05-16 18:24:26,288::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56034::DEBUG::2014-05-16 18:24:26,288::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9b3c4708-4985-4a5d-b15c-4c51cd1f3c7c`::Granted request >Thread-56034::DEBUG::2014-05-16 18:24:26,288::task::811::TaskManager.Task::(resourceAcquired) Task=`580c655c-1f0c-4e15-914f-37a5ac96d685`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56034::DEBUG::2014-05-16 18:24:26,289::task::974::TaskManager.Task::(_decref) Task=`580c655c-1f0c-4e15-914f-37a5ac96d685`::ref 1 aborting False >Thread-56034::INFO::2014-05-16 18:24:26,289::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56034::DEBUG::2014-05-16 18:24:26,289::task::1168::TaskManager.Task::(prepare) Task=`580c655c-1f0c-4e15-914f-37a5ac96d685`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56034::DEBUG::2014-05-16 18:24:26,290::task::579::TaskManager.Task::(_updateState) Task=`580c655c-1f0c-4e15-914f-37a5ac96d685`::moving from state preparing -> state finished >Thread-56034::DEBUG::2014-05-16 18:24:26,290::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56034::DEBUG::2014-05-16 18:24:26,290::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56034::DEBUG::2014-05-16 18:24:26,290::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56034::DEBUG::2014-05-16 18:24:26,290::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56034::DEBUG::2014-05-16 18:24:26,291::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56034::DEBUG::2014-05-16 18:24:26,291::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56034::DEBUG::2014-05-16 18:24:26,291::task::974::TaskManager.Task::(_decref) Task=`580c655c-1f0c-4e15-914f-37a5ac96d685`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:24:27,356::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:24:27,367::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109574 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:27,677::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:27,749::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348537 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:29,760::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:29,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03593 s, 28.5 MB/s\n'; <rc> = 0 >Thread-56036::DEBUG::2014-05-16 18:24:29,920::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5425446.000000 / 8.008519 / 262500000.000000 = 0.258080 >Thread-56036::DEBUG::2014-05-16 18:24:29,920::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0087598148213298543, 'statsAge': 1.1655609607696533, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25807975087495538, 'rxDropped': 0} >Thread-56036::DEBUG::2014-05-16 18:24:29,921::task::579::TaskManager.Task::(_updateState) Task=`0607300f-f3f5-46ce-8b07-f4cdc0d6c896`::moving from state init -> state preparing >Thread-56036::INFO::2014-05-16 18:24:29,921::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56036::INFO::2014-05-16 18:24:29,921::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109574', 'lastCheck': '2.5', 'valid': True}} >Thread-56036::DEBUG::2014-05-16 18:24:29,921::task::1168::TaskManager.Task::(prepare) Task=`0607300f-f3f5-46ce-8b07-f4cdc0d6c896`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109574', 'lastCheck': '2.5', 'valid': True}} >Thread-56036::DEBUG::2014-05-16 18:24:29,921::task::579::TaskManager.Task::(_updateState) Task=`0607300f-f3f5-46ce-8b07-f4cdc0d6c896`::moving from state preparing -> state finished >Thread-56036::DEBUG::2014-05-16 18:24:29,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56036::DEBUG::2014-05-16 18:24:29,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56036::DEBUG::2014-05-16 18:24:29,922::task::974::TaskManager.Task::(_decref) Task=`0607300f-f3f5-46ce-8b07-f4cdc0d6c896`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:24:31,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:31,912::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310622 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:33,924::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:33,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352054 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:36,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:36,075::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312909 s, 32.7 MB/s\n'; <rc> = 0 >Thread-56040::DEBUG::2014-05-16 18:24:36,353::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56040::DEBUG::2014-05-16 18:24:36,354::task::579::TaskManager.Task::(_updateState) Task=`b3a1a8b0-92b8-4def-95f5-3a16c91d72ca`::moving from state init -> state preparing >Thread-56040::INFO::2014-05-16 18:24:36,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56040::INFO::2014-05-16 18:24:36,354::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56040::DEBUG::2014-05-16 18:24:36,354::task::1168::TaskManager.Task::(prepare) Task=`b3a1a8b0-92b8-4def-95f5-3a16c91d72ca`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56040::DEBUG::2014-05-16 18:24:36,354::task::579::TaskManager.Task::(_updateState) Task=`b3a1a8b0-92b8-4def-95f5-3a16c91d72ca`::moving from state preparing -> state finished >Thread-56040::DEBUG::2014-05-16 18:24:36,355::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56040::DEBUG::2014-05-16 18:24:36,355::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56040::DEBUG::2014-05-16 18:24:36,355::task::974::TaskManager.Task::(_decref) Task=`b3a1a8b0-92b8-4def-95f5-3a16c91d72ca`::ref 0 aborting False >Thread-56041::DEBUG::2014-05-16 18:24:36,370::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56041::DEBUG::2014-05-16 18:24:36,371::task::579::TaskManager.Task::(_updateState) Task=`e64f32ad-54c8-457c-91b7-ef977abaa766`::moving from state init -> state preparing >Thread-56041::INFO::2014-05-16 18:24:36,371::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56041::DEBUG::2014-05-16 18:24:36,371::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c9a12196-2a2e-445c-91b8-b1286e073ab8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56041::DEBUG::2014-05-16 18:24:36,371::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56041::DEBUG::2014-05-16 18:24:36,372::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56041::DEBUG::2014-05-16 18:24:36,372::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c9a12196-2a2e-445c-91b8-b1286e073ab8`::Granted request >Thread-56041::DEBUG::2014-05-16 18:24:36,372::task::811::TaskManager.Task::(resourceAcquired) Task=`e64f32ad-54c8-457c-91b7-ef977abaa766`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56041::DEBUG::2014-05-16 18:24:36,372::task::974::TaskManager.Task::(_decref) Task=`e64f32ad-54c8-457c-91b7-ef977abaa766`::ref 1 aborting False >Thread-56041::INFO::2014-05-16 18:24:36,373::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56041::DEBUG::2014-05-16 18:24:36,373::task::1168::TaskManager.Task::(prepare) Task=`e64f32ad-54c8-457c-91b7-ef977abaa766`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '113413980160', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56041::DEBUG::2014-05-16 18:24:36,373::task::579::TaskManager.Task::(_updateState) Task=`e64f32ad-54c8-457c-91b7-ef977abaa766`::moving from state preparing -> state finished >Thread-56041::DEBUG::2014-05-16 18:24:36,373::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56041::DEBUG::2014-05-16 18:24:36,374::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56041::DEBUG::2014-05-16 18:24:36,374::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56041::DEBUG::2014-05-16 18:24:36,374::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56041::DEBUG::2014-05-16 18:24:36,374::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56041::DEBUG::2014-05-16 18:24:36,374::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56041::DEBUG::2014-05-16 18:24:36,375::task::974::TaskManager.Task::(_decref) Task=`e64f32ad-54c8-457c-91b7-ef977abaa766`::ref 0 aborting False >Thread-56042::DEBUG::2014-05-16 18:24:36,681::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [78b26f3e] >Thread-56042::DEBUG::2014-05-16 18:24:36,681::task::579::TaskManager.Task::(_updateState) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::moving from state init -> state preparing >Thread-56042::INFO::2014-05-16 18:24:36,682::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', size='34359738368', volFormat=4, preallocate=2, diskType=2, volUUID='1726da34-4348-43ad-bdfa-94241ff48c13', desc='', srcImgUUID='7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', srcVolUUID='77c78124-ee6c-46b1-9112-a738f448beca') >Thread-56042::DEBUG::2014-05-16 18:24:36,682::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`ddc640cf-891a-407e-833d-82f9c4e53913`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1484' at 'createVolume' >Thread-56042::DEBUG::2014-05-16 18:24:36,682::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-56042::DEBUG::2014-05-16 18:24:36,682::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-56042::DEBUG::2014-05-16 18:24:36,683::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`ddc640cf-891a-407e-833d-82f9c4e53913`::Granted request >Thread-56042::DEBUG::2014-05-16 18:24:36,684::task::811::TaskManager.Task::(resourceAcquired) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-56042::DEBUG::2014-05-16 18:24:36,684::task::974::TaskManager.Task::(_decref) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::ref 1 aborting False >Thread-56042::DEBUG::2014-05-16 18:24:36,685::task::736::TaskManager.Task::(_save) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af.temp >Thread-56042::DEBUG::2014-05-16 18:24:36,691::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 4c648dc4-dc77-4720-b492-6672cfa088af >Thread-56042::INFO::2014-05-16 18:24:36,691::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-56042::DEBUG::2014-05-16 18:24:36,691::task::1163::TaskManager.Task::(prepare) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::Prepare: 1 jobs exist, move to acquiring >Thread-56042::DEBUG::2014-05-16 18:24:36,692::task::579::TaskManager.Task::(_updateState) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::moving from state preparing -> state acquiring >Thread-56042::DEBUG::2014-05-16 18:24:36,692::task::736::TaskManager.Task::(_save) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af.temp >Thread-56042::DEBUG::2014-05-16 18:24:36,697::task::579::TaskManager.Task::(_updateState) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::moving from state acquiring -> state queued >Thread-56042::DEBUG::2014-05-16 18:24:36,698::task::736::TaskManager.Task::(_save) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af.temp >Thread-56042::DEBUG::2014-05-16 18:24:36,703::taskManager::50::TaskManager::(_queueTask) queuing task: 4c648dc4-dc77-4720-b492-6672cfa088af >Thread-56042::DEBUG::2014-05-16 18:24:36,703::taskManager::56::TaskManager::(_queueTask) task queued: 4c648dc4-dc77-4720-b492-6672cfa088af >aa57e6cf-6fa1-4a5c-8b7c-78f3a9b1524d::DEBUG::2014-05-16 18:24:36,704::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-56042::DEBUG::2014-05-16 18:24:36,704::task::1165::TaskManager.Task::(prepare) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::returning >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,704::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 4c648dc4-dc77-4720-b492-6672cfa088af running: <bound method Task.commit of <storage.task.Task instance at 0x7ff5384905f0>> with: None >Thread-56042::DEBUG::2014-05-16 18:24:36,705::task::974::TaskManager.Task::(_decref) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::ref 0 aborting False >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,705::task::1176::TaskManager.Task::(commit) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::committing task: 4c648dc4-dc77-4720-b492-6672cfa088af >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,706::task::579::TaskManager.Task::(_updateState) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::moving from state queued -> state running >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,707::task::736::TaskManager.Task::(_save) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af.temp >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,712::task::889::TaskManager.Task::(_runJobs) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x2b04510>> (args: ('f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 67108864, 4, 2, 2, '1726da34-4348-43ad-bdfa-94241ff48c13', '', '7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', '77c78124-ee6c-46b1-9112-a738f448beca') kwargs: {}) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,712::task::315::TaskManager.Task::(run) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x2b04510>> (args: ('f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 67108864, 4, 2, 2, '1726da34-4348-43ad-bdfa-94241ff48c13', '', '7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96', '77c78124-ee6c-46b1-9112-a738f448beca') kwargs: {}) callback None >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,712::resourceManager::197::ResourceManager.Request::(__init__) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.a0a67101-ebc7-4fa0-9e63-bf4c38fd0572`ReqID=`9cf73ede-7ab0-429a-9141-d8d785254d95`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1895' at 'createVolume' >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,713::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.a0a67101-ebc7-4fa0-9e63-bf4c38fd0572' for lock type 'exclusive' >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,713::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,714::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,864::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,878::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,878::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,878::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image a0a67101-ebc7-4fa0-9e63-bf4c38fd0572 does not exist in domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,879::resourceManager::600::ResourceManager::(registerResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.a0a67101-ebc7-4fa0-9e63-bf4c38fd0572' is free. Now locking as 'exclusive' (1 active user) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,879::resourceManager::237::ResourceManager.Request::(grant) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.a0a67101-ebc7-4fa0-9e63-bf4c38fd0572`ReqID=`9cf73ede-7ab0-429a-9141-d8d785254d95`::Granted request >4c648dc4-dc77-4720-b492-6672cfa088af::INFO::2014-05-16 18:24:36,880::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572 for image's volumes >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,880::task::736::TaskManager.Task::(_save) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af.temp >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,905::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,914::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000488042 s, 1.0 MB/s\n'; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,915::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000488042 s, 1.0 MB/s'], size: 512 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,915::volume::300::Storage.Volume::(share) Share volume 77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,935::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,944::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000530377 s, 965 kB/s\n'; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,944::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000530377 s, 965 kB/s'], size: 512 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,945::task::736::TaskManager.Task::(_save) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af.temp >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,952::blockVolume::380::Storage.Volume::(_share) Share volume 77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,970::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,978::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000511248 s, 1.0 MB/s\n'; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,978::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000511248 s, 1.0 MB/s'], size: 512 >4c648dc4-dc77-4720-b492-6672cfa088af::INFO::2014-05-16 18:24:36,979::volume::446::Storage.Volume::(create) Creating volume 1726da34-4348-43ad-bdfa-94241ff48c13 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,979::task::736::TaskManager.Task::(_save) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af.temp >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,987::task::736::TaskManager.Task::(_save) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af.temp >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:36,996::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name 1726da34-4348-43ad-bdfa-94241ff48c13 f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,192::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,192::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,192::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,193::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,193::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::WARNING::2014-05-16 18:24:37,193::utils::114::root::(rmFile) File: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13 already removed >4c648dc4-dc77-4720-b492-6672cfa088af::INFO::2014-05-16 18:24:37,195::blockVolume::196::Storage.Volume::(_create) Request to create snapshot a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13 of volume 7ba1ce2a-96dd-4a4c-ac62-57204f7d2b96/77c78124-ee6c-46b1-9112-a738f448beca >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,195::task::736::TaskManager.Task::(_save) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af.temp >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,229::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,239::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000471413 s, 1.1 MB/s\n'; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,239::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000471413 s, 1.1 MB/s'], size: 512 >4c648dc4-dc77-4720-b492-6672cfa088af::INFO::2014-05-16 18:24:37,239::volume::793::Storage.Volume::(prepare) Volume: preparing volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,259::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,268::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000540591 s, 947 kB/s\n'; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,268::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000540591 s, 947 kB/s'], size: 512 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,269::resourceManager::197::ResourceManager.Request::(__init__) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca`ReqID=`6cc02111-1655-40d0-8311-f27e4161655e`::Request was made in '/usr/share/vdsm/storage/volume.py' line '810' at 'prepare' >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,269::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' for lock type 'shared' >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,271::resourceManager::600::ResourceManager::(registerResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' is free. Now locking as 'shared' (1 active user) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,271::resourceManager::237::ResourceManager.Request::(grant) ResName=`f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca`ReqID=`6cc02111-1655-40d0-8311-f27e4161655e`::Granted request >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,289::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,298::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000497679 s, 1.0 MB/s\n'; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,298::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000497679 s, 1.0 MB/s'], size: 512 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,299::volume::270::Storage.Volume::(clone) Volume.clone: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/77c78124-ee6c-46b1-9112-a738f448beca to /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,317::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,326::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000537945 s, 952 kB/s\n'; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,326::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000537945 s, 952 kB/s'], size: 512 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,345::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=8 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,353::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000498101 s, 1.0 MB/s\n'; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,353::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000498101 s, 1.0 MB/s'], size: 512 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,354::volume::1058::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 -F raw -b ../a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/77c78124-ee6c-46b1-9112-a738f448beca /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13' (cwd /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572) >Thread-30::DEBUG::2014-05-16 18:24:37,391::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:24:37,392::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,401::volume::1058::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::INFO::2014-05-16 18:24:37,402::blockVolume::420::Storage.Volume::(teardown) Tearing down volume f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca justme False >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,402::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,403::resourceManager::634::ResourceManager::(releaseResource) Released resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' (0 active users) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,403::resourceManager::640::ResourceManager::(releaseResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca' is free, finding out if anyone is waiting for it. >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,404::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca' (cwd None) >Thread-30::DEBUG::2014-05-16 18:24:37,562::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:24:37,564::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:24:37,584::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:24:37,595::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000537173 s, 7.6 MB/s\n'; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,629::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,629::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,630::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,630::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS.77c78124-ee6c-46b1-9112-a738f448beca', Clearing records. >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,630::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,631::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,775::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,789::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,790::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,790::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,791::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,934::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,949::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,949::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::WARNING::2014-05-16 18:24:37,949::blockSD::743::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv f79908bf-a757-4a71-9ab5-3a12ede5f65c/1726da34-4348-43ad-bdfa-94241ff48c13 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,949::blockSD::766::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 15 in VG f79908bf-a757-4a71-9ab5-3a12ede5f65c >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:37,950::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_15 --addtag IU_a0a67101-ebc7-4fa0-9e63-bf4c38fd0572 --addtag PU_77c78124-ee6c-46b1-9112-a738f448beca f79908bf-a757-4a71-9ab5-3a12ede5f65c/1726da34-4348-43ad-bdfa-94241ff48c13' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:38,086::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,147::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,150::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,152::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,158::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/1726da34-4348-43ad-bdfa-94241ff48c13' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:38,197::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467782 s, 21.9 MB/s\n'; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,316::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,316::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,317::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,317::task::736::TaskManager.Task::(_save) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af.temp >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,347::blockVolume::622::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=1726da34-4348-43ad-bdfa-94241ff48c13 sdUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c, metaId=('f79908bf-a757-4a71-9ab5-3a12ede5f65c', 15) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,362::task::736::TaskManager.Task::(_save) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af.temp >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,372::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.a0a67101-ebc7-4fa0-9e63-bf4c38fd0572' >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,373::resourceManager::634::ResourceManager::(releaseResource) Released resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.a0a67101-ebc7-4fa0-9e63-bf4c38fd0572' (0 active users) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,373::resourceManager::640::ResourceManager::(releaseResource) Resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.a0a67101-ebc7-4fa0-9e63-bf4c38fd0572' is free, finding out if anyone is waiting for it. >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,373::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS.a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', Clearing records. >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,373::task::579::TaskManager.Task::(_updateState) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::moving from state running -> state finished >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,374::task::736::TaskManager.Task::(_save) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::_save: orig /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af temp /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/master/tasks/4c648dc4-dc77-4720-b492-6672cfa088af.temp >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,385::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,385::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,385::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,385::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,386::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,386::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,386::task::897::TaskManager.Task::(_runJobs) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::Task.run: exit - success: result {'uuid': '1726da34-4348-43ad-bdfa-94241ff48c13'} >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,386::task::974::TaskManager.Task::(_decref) Task=`4c648dc4-dc77-4720-b492-6672cfa088af`::ref 0 aborting False >4c648dc4-dc77-4720-b492-6672cfa088af::DEBUG::2014-05-16 18:24:38,387::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-51::DEBUG::2014-05-16 18:24:40,209::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:40,282::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360761 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:42,294::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:42,361::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306885 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:44,373::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:44,446::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351864 s, 29.1 MB/s\n'; <rc> = 0 >Thread-56045::DEBUG::2014-05-16 18:24:44,706::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56045::DEBUG::2014-05-16 18:24:44,707::task::579::TaskManager.Task::(_updateState) Task=`6f3ed20f-f3ac-4b16-a670-28a7fa93306c`::moving from state init -> state preparing >Thread-56045::INFO::2014-05-16 18:24:44,707::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-56045::DEBUG::2014-05-16 18:24:44,707::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-56045::DEBUG::2014-05-16 18:24:44,707::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 4c648dc4-dc77-4720-b492-6672cfa088af >Thread-56045::DEBUG::2014-05-16 18:24:44,707::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '4c648dc4-dc77-4720-b492-6672cfa088af'} >Thread-56045::DEBUG::2014-05-16 18:24:44,708::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'4c648dc4-dc77-4720-b492-6672cfa088af': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '4c648dc4-dc77-4720-b492-6672cfa088af'}} >Thread-56045::INFO::2014-05-16 18:24:44,708::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4c648dc4-dc77-4720-b492-6672cfa088af': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '4c648dc4-dc77-4720-b492-6672cfa088af'}}} >Thread-56045::DEBUG::2014-05-16 18:24:44,708::task::1168::TaskManager.Task::(prepare) Task=`6f3ed20f-f3ac-4b16-a670-28a7fa93306c`::finished: {'allTasksStatus': {'4c648dc4-dc77-4720-b492-6672cfa088af': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '4c648dc4-dc77-4720-b492-6672cfa088af'}}} >Thread-56045::DEBUG::2014-05-16 18:24:44,708::task::579::TaskManager.Task::(_updateState) Task=`6f3ed20f-f3ac-4b16-a670-28a7fa93306c`::moving from state preparing -> state finished >Thread-56045::DEBUG::2014-05-16 18:24:44,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56045::DEBUG::2014-05-16 18:24:44,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56045::DEBUG::2014-05-16 18:24:44,708::task::974::TaskManager.Task::(_decref) Task=`6f3ed20f-f3ac-4b16-a670-28a7fa93306c`::ref 0 aborting False >Thread-56046::DEBUG::2014-05-16 18:24:45,039::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [78b26f3e] >Thread-56046::DEBUG::2014-05-16 18:24:45,040::task::579::TaskManager.Task::(_updateState) Task=`3d64795d-4b71-48d7-857f-614e7d49fa40`::moving from state init -> state preparing >Thread-56046::INFO::2014-05-16 18:24:45,040::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', volUUID='1726da34-4348-43ad-bdfa-94241ff48c13', options=None) >Thread-56046::DEBUG::2014-05-16 18:24:45,040::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`b7ab3d43-31df-4f19-9c20-7231feaa7aa1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3104' at 'getVolumeInfo' >Thread-56046::DEBUG::2014-05-16 18:24:45,040::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-56046::DEBUG::2014-05-16 18:24:45,041::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-56046::DEBUG::2014-05-16 18:24:45,041::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`b7ab3d43-31df-4f19-9c20-7231feaa7aa1`::Granted request >Thread-56046::DEBUG::2014-05-16 18:24:45,041::task::811::TaskManager.Task::(resourceAcquired) Task=`3d64795d-4b71-48d7-857f-614e7d49fa40`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-56046::DEBUG::2014-05-16 18:24:45,041::task::974::TaskManager.Task::(_decref) Task=`3d64795d-4b71-48d7-857f-614e7d49fa40`::ref 1 aborting False >Thread-56046::DEBUG::2014-05-16 18:24:45,042::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-56046::DEBUG::2014-05-16 18:24:45,042::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-56046::DEBUG::2014-05-16 18:24:45,190::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56046::DEBUG::2014-05-16 18:24:45,206::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-56046::DEBUG::2014-05-16 18:24:45,206::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-56046::INFO::2014-05-16 18:24:45,206::volume::883::Storage.Volume::(getInfo) Info request: sdUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c imgUUID=a0a67101-ebc7-4fa0-9e63-bf4c38fd0572 volUUID = 1726da34-4348-43ad-bdfa-94241ff48c13 >Thread-56046::DEBUG::2014-05-16 18:24:45,225::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-56046::DEBUG::2014-05-16 18:24:45,234::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000542808 s, 943 kB/s\n'; <rc> = 0 >Thread-56046::DEBUG::2014-05-16 18:24:45,234::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000542808 s, 943 kB/s'], size: 512 >Thread-56046::DEBUG::2014-05-16 18:24:45,253::blockVolume::590::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=15 bs=512 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-56046::DEBUG::2014-05-16 18:24:45,261::blockVolume::590::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00051651 s, 991 kB/s\n'; <rc> = 0 >Thread-56046::DEBUG::2014-05-16 18:24:45,261::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00051651 s, 991 kB/s'], size: 512 >Thread-56046::DEBUG::2014-05-16 18:24:45,262::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-56046::DEBUG::2014-05-16 18:24:45,262::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-56046::DEBUG::2014-05-16 18:24:45,406::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56046::DEBUG::2014-05-16 18:24:45,424::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-56046::DEBUG::2014-05-16 18:24:45,426::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-56047::DEBUG::2014-05-16 18:24:45,427::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 6480141.000000 / 8.009311 / 262500000.000000 = 0.308219 >Thread-56047::DEBUG::2014-05-16 18:24:45,428::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.10725688120906267, 'statsAge': 0.65320014953613281, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.30821941549637638, 'rxDropped': 0} >Thread-56046::INFO::2014-05-16 18:24:45,429::volume::912::Storage.Volume::(getInfo) f79908bf-a757-4a71-9ab5-3a12ede5f65c/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13 info is {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 'ctime': '1400264678', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400264678', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '1726da34-4348-43ad-bdfa-94241ff48c13', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-56047::DEBUG::2014-05-16 18:24:45,430::task::579::TaskManager.Task::(_updateState) Task=`82ef4326-c4cd-4e22-8db4-de29b85a7725`::moving from state init -> state preparing >Thread-56046::INFO::2014-05-16 18:24:45,430::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 'ctime': '1400264678', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400264678', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '1726da34-4348-43ad-bdfa-94241ff48c13', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-56047::INFO::2014-05-16 18:24:45,431::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56046::DEBUG::2014-05-16 18:24:45,431::task::1168::TaskManager.Task::(prepare) Task=`3d64795d-4b71-48d7-857f-614e7d49fa40`::finished: {'info': {'status': 'OK', 'domain': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'voltype': 'LEAF', 'description': '', 'parent': '77c78124-ee6c-46b1-9112-a738f448beca', 'format': 'COW', 'image': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 'ctime': '1400264678', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1400264678', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '34359738368', 'uuid': '1726da34-4348-43ad-bdfa-94241ff48c13', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-56047::INFO::2014-05-16 18:24:45,432::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537173', 'lastCheck': '7.8', 'valid': True}} >Thread-56046::DEBUG::2014-05-16 18:24:45,432::task::579::TaskManager.Task::(_updateState) Task=`3d64795d-4b71-48d7-857f-614e7d49fa40`::moving from state preparing -> state finished >Thread-56047::DEBUG::2014-05-16 18:24:45,433::task::1168::TaskManager.Task::(prepare) Task=`82ef4326-c4cd-4e22-8db4-de29b85a7725`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537173', 'lastCheck': '7.8', 'valid': True}} >Thread-56046::DEBUG::2014-05-16 18:24:45,433::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-56047::DEBUG::2014-05-16 18:24:45,434::task::579::TaskManager.Task::(_updateState) Task=`82ef4326-c4cd-4e22-8db4-de29b85a7725`::moving from state preparing -> state finished >Thread-56046::DEBUG::2014-05-16 18:24:45,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56047::DEBUG::2014-05-16 18:24:45,435::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56047::DEBUG::2014-05-16 18:24:45,436::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56046::DEBUG::2014-05-16 18:24:45,436::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-56047::DEBUG::2014-05-16 18:24:45,437::task::974::TaskManager.Task::(_decref) Task=`82ef4326-c4cd-4e22-8db4-de29b85a7725`::ref 0 aborting False >Thread-56046::DEBUG::2014-05-16 18:24:45,437::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-56046::DEBUG::2014-05-16 18:24:45,438::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-56046::DEBUG::2014-05-16 18:24:45,439::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-56046::DEBUG::2014-05-16 18:24:45,440::task::974::TaskManager.Task::(_decref) Task=`3d64795d-4b71-48d7-857f-614e7d49fa40`::ref 0 aborting False >Thread-56049::DEBUG::2014-05-16 18:24:45,626::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56049::DEBUG::2014-05-16 18:24:45,626::task::579::TaskManager.Task::(_updateState) Task=`fb226b85-63ef-41de-b650-e68c7b0c39db`::moving from state init -> state preparing >Thread-56049::INFO::2014-05-16 18:24:45,626::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='4c648dc4-dc77-4720-b492-6672cfa088af', spUUID=None, options=None) >Thread-56049::DEBUG::2014-05-16 18:24:45,626::taskManager::161::TaskManager::(clearTask) Entry. taskID: 4c648dc4-dc77-4720-b492-6672cfa088af >Thread-56049::DEBUG::2014-05-16 18:24:45,627::taskManager::166::TaskManager::(clearTask) Return. >Thread-56049::INFO::2014-05-16 18:24:45,627::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-56049::DEBUG::2014-05-16 18:24:45,628::task::1168::TaskManager.Task::(prepare) Task=`fb226b85-63ef-41de-b650-e68c7b0c39db`::finished: None >Thread-56049::DEBUG::2014-05-16 18:24:45,628::task::579::TaskManager.Task::(_updateState) Task=`fb226b85-63ef-41de-b650-e68c7b0c39db`::moving from state preparing -> state finished >Thread-56049::DEBUG::2014-05-16 18:24:45,628::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56049::DEBUG::2014-05-16 18:24:45,628::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56049::DEBUG::2014-05-16 18:24:45,628::task::974::TaskManager.Task::(_decref) Task=`fb226b85-63ef-41de-b650-e68c7b0c39db`::ref 0 aborting False >Thread-56050::DEBUG::2014-05-16 18:24:46,435::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56050::DEBUG::2014-05-16 18:24:46,435::task::579::TaskManager.Task::(_updateState) Task=`53e6b5b9-3a22-4961-a8d0-d3a1ec8efc54`::moving from state init -> state preparing >Thread-56050::INFO::2014-05-16 18:24:46,436::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56050::INFO::2014-05-16 18:24:46,436::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56050::DEBUG::2014-05-16 18:24:46,436::task::1168::TaskManager.Task::(prepare) Task=`53e6b5b9-3a22-4961-a8d0-d3a1ec8efc54`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56050::DEBUG::2014-05-16 18:24:46,436::task::579::TaskManager.Task::(_updateState) Task=`53e6b5b9-3a22-4961-a8d0-d3a1ec8efc54`::moving from state preparing -> state finished >Thread-56050::DEBUG::2014-05-16 18:24:46,436::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56050::DEBUG::2014-05-16 18:24:46,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56050::DEBUG::2014-05-16 18:24:46,437::task::974::TaskManager.Task::(_decref) Task=`53e6b5b9-3a22-4961-a8d0-d3a1ec8efc54`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:24:46,458::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-56051::DEBUG::2014-05-16 18:24:46,468::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56051::DEBUG::2014-05-16 18:24:46,468::task::579::TaskManager.Task::(_updateState) Task=`014e1e69-e104-449a-ae67-c925ff64424d`::moving from state init -> state preparing >Thread-56051::INFO::2014-05-16 18:24:46,469::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56051::DEBUG::2014-05-16 18:24:46,469::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`69c358d6-7233-4fa4-89b2-6570b2fdd41b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56051::DEBUG::2014-05-16 18:24:46,469::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56051::DEBUG::2014-05-16 18:24:46,470::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56051::DEBUG::2014-05-16 18:24:46,470::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`69c358d6-7233-4fa4-89b2-6570b2fdd41b`::Granted request >Thread-56051::DEBUG::2014-05-16 18:24:46,470::task::811::TaskManager.Task::(resourceAcquired) Task=`014e1e69-e104-449a-ae67-c925ff64424d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56051::DEBUG::2014-05-16 18:24:46,470::task::974::TaskManager.Task::(_decref) Task=`014e1e69-e104-449a-ae67-c925ff64424d`::ref 1 aborting False >Thread-56051::INFO::2014-05-16 18:24:46,471::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56051::DEBUG::2014-05-16 18:24:46,471::task::1168::TaskManager.Task::(prepare) Task=`014e1e69-e104-449a-ae67-c925ff64424d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56051::DEBUG::2014-05-16 18:24:46,471::task::579::TaskManager.Task::(_updateState) Task=`014e1e69-e104-449a-ae67-c925ff64424d`::moving from state preparing -> state finished >Thread-56051::DEBUG::2014-05-16 18:24:46,471::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56051::DEBUG::2014-05-16 18:24:46,472::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56051::DEBUG::2014-05-16 18:24:46,472::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56051::DEBUG::2014-05-16 18:24:46,472::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56051::DEBUG::2014-05-16 18:24:46,472::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56051::DEBUG::2014-05-16 18:24:46,472::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56051::DEBUG::2014-05-16 18:24:46,472::task::974::TaskManager.Task::(_decref) Task=`014e1e69-e104-449a-ae67-c925ff64424d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:24:46,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365447 s, 28.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:24:47,630::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:24:47,641::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000762754 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:48,542::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:48,614::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342216 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:50,626::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:50,694::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319464 s, 32.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:24:52,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:52,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304964 s, 33.6 MB/s\n'; <rc> = 0 >Thread-56054::DEBUG::2014-05-16 18:24:53,938::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] flowID [6fc5b47c] >Thread-56054::DEBUG::2014-05-16 18:24:53,939::task::579::TaskManager.Task::(_updateState) Task=`6f352628-c326-4347-9eec-4b3cbacdd349`::moving from state init -> state preparing >Thread-56054::INFO::2014-05-16 18:24:53,939::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56054::DEBUG::2014-05-16 18:24:53,942::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dee00b83-be95-4695-a22c-d7b5f3faff58`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56054::DEBUG::2014-05-16 18:24:53,943::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56054::DEBUG::2014-05-16 18:24:53,943::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56054::DEBUG::2014-05-16 18:24:53,943::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`dee00b83-be95-4695-a22c-d7b5f3faff58`::Granted request >Thread-56054::DEBUG::2014-05-16 18:24:53,943::task::811::TaskManager.Task::(resourceAcquired) Task=`6f352628-c326-4347-9eec-4b3cbacdd349`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56054::DEBUG::2014-05-16 18:24:53,943::task::974::TaskManager.Task::(_decref) Task=`6f352628-c326-4347-9eec-4b3cbacdd349`::ref 1 aborting False >Thread-56054::INFO::2014-05-16 18:24:53,944::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56054::DEBUG::2014-05-16 18:24:53,944::task::1168::TaskManager.Task::(prepare) Task=`6f352628-c326-4347-9eec-4b3cbacdd349`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56054::DEBUG::2014-05-16 18:24:53,944::task::579::TaskManager.Task::(_updateState) Task=`6f352628-c326-4347-9eec-4b3cbacdd349`::moving from state preparing -> state finished >Thread-56054::DEBUG::2014-05-16 18:24:53,945::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56054::DEBUG::2014-05-16 18:24:53,945::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56054::DEBUG::2014-05-16 18:24:53,945::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56054::DEBUG::2014-05-16 18:24:53,945::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56054::DEBUG::2014-05-16 18:24:53,945::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56054::DEBUG::2014-05-16 18:24:53,945::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56054::DEBUG::2014-05-16 18:24:53,946::task::974::TaskManager.Task::(_decref) Task=`6f352628-c326-4347-9eec-4b3cbacdd349`::ref 0 aborting False >Thread-56055::DEBUG::2014-05-16 18:24:54,030::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmCreate with ({'custom': {'device_2d478276-6da3-41cc-8268-7f2cd6d93725': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=2d478276-6da3-41cc-8268-7f2cd6d93725, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27ddevice_8646d184-b0e3-405a-88be-2e09f219acd4device_aef822e0-6c58-4ebe-b788-71c82ed73b1cdevice_d91a9f60-1f1d-443c-a6d4-4288519beec1': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=d91a9f60-1f1d-443c-a6d4-4288519beec1, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27ddevice_8646d184-b0e3-405a-88be-2e09f219acd4': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=8646d184-b0e3-405a-88be-2e09f219acd4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27d': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=30227853-80a8-439f-8d21-7695be76f27d, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27ddevice_8646d184-b0e3-405a-88be-2e09f219acd4device_aef822e0-6c58-4ebe-b788-71c82ed73b1c': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=aef822e0-6c58-4ebe-b788-71c82ed73b1c, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'cpuType': 'Nehalem', 'vmId': '7371d6a6-29bf-4f5b-97f7-5e7694cff414', 'devices': [{'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}}, 'readonly': 'true', 'deviceId': '2b85b240-95e1-4a6f-859b-3029f4f3ca94', 'path': '', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '0939fd54-5b3a-4238-baf1-4c328c4aaeb4'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': '261f5553-cf10-4ac6-8a16-3c70d99b7a97', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'volumeID': '1726da34-4348-43ad-bdfa-94241ff48c13', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 'specParams': {}, 'readonly': 'false', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'optional': 'false', 'deviceId': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '176f9d8b-142d-4930-96d5-4147008a2f08'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '97a63046-d062-43bb-b930-939e4ec8a11a'}, {'specParams': {}, 'deviceId': 'c8700151-7a56-448f-b4af-eebce1fb4e67', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '2', 'vmType': 'kvm', 'smartcardEnable': 'true', 'timeOffset': '3600', 'memSize': 2048, 'spiceSslCipherSuite': 'DEFAULT', 'smpCoresPerSocket': '1', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'memGuaranteedSize': 1024, 'vmName': 'bob', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} flowID [6fc5b47c] >Thread-56055::INFO::2014-05-16 18:24:54,036::API::648::vds::(_getNetworkIp) network None: using 0 >Thread-56055::INFO::2014-05-16 18:24:54,036::clientIF::394::vds::(createVm) vmContainerLock acquired by vm 7371d6a6-29bf-4f5b-97f7-5e7694cff414 >Thread-56055::DEBUG::2014-05-16 18:24:54,040::clientIF::407::vds::(createVm) Total desktops after creation of 7371d6a6-29bf-4f5b-97f7-5e7694cff414 is 1 >Thread-56056::DEBUG::2014-05-16 18:24:54,040::vm::2156::vm.Vm::(_startUnderlyingVm) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Start >Thread-56055::DEBUG::2014-05-16 18:24:54,041::BindingXMLRPC::982::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '7371d6a6-29bf-4f5b-97f7-5e7694cff414', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_2d478276-6da3-41cc-8268-7f2cd6d93725': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=2d478276-6da3-41cc-8268-7f2cd6d93725, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27ddevice_8646d184-b0e3-405a-88be-2e09f219acd4device_aef822e0-6c58-4ebe-b788-71c82ed73b1cdevice_d91a9f60-1f1d-443c-a6d4-4288519beec1': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=d91a9f60-1f1d-443c-a6d4-4288519beec1, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27ddevice_8646d184-b0e3-405a-88be-2e09f219acd4': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=8646d184-b0e3-405a-88be-2e09f219acd4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27d': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=30227853-80a8-439f-8d21-7695be76f27d, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27ddevice_8646d184-b0e3-405a-88be-2e09f219acd4device_aef822e0-6c58-4ebe-b788-71c82ed73b1c': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=aef822e0-6c58-4ebe-b788-71c82ed73b1c, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'index': '0', 'iface': 'fdc', 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}}, 'readonly': 'true', 'deviceId': '2b85b240-95e1-4a6f-859b-3029f4f3ca94', 'path': '', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '0939fd54-5b3a-4238-baf1-4c328c4aaeb4'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'true', 'deviceId': '261f5553-cf10-4ac6-8a16-3c70d99b7a97', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'cow', 'bootOrder': '1', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'volumeID': '1726da34-4348-43ad-bdfa-94241ff48c13', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 'specParams': {}, 'readonly': 'false', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'optional': 'false', 'deviceId': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'smartcard', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'type': 'smartcard', 'deviceId': '176f9d8b-142d-4930-96d5-4147008a2f08'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '97a63046-d062-43bb-b930-939e4ec8a11a'}, {'specParams': {}, 'deviceId': 'c8700151-7a56-448f-b4af-eebce1fb4e67', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'bob', 'display': 'qxl', 'nice': '0'}} >Thread-56056::DEBUG::2014-05-16 18:24:54,041::vm::2160::vm.Vm::(_startUnderlyingVm) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::_ongoingCreations acquired >Thread-56056::INFO::2014-05-16 18:24:54,042::vm::3011::vm.Vm::(_run) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::VM wrapper has started >Thread-56056::DEBUG::2014-05-16 18:24:54,044::task::579::TaskManager.Task::(_updateState) Task=`99e46223-c1e6-4f2e-b930-a8fae942e874`::moving from state init -> state preparing >Thread-56056::INFO::2014-05-16 18:24:54,045::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', volUUID='1726da34-4348-43ad-bdfa-94241ff48c13', options=None) >Thread-56056::INFO::2014-05-16 18:24:54,048::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-56056::DEBUG::2014-05-16 18:24:54,049::task::1168::TaskManager.Task::(prepare) Task=`99e46223-c1e6-4f2e-b930-a8fae942e874`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-56056::DEBUG::2014-05-16 18:24:54,051::task::579::TaskManager.Task::(_updateState) Task=`99e46223-c1e6-4f2e-b930-a8fae942e874`::moving from state preparing -> state finished >Thread-56056::DEBUG::2014-05-16 18:24:54,052::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56056::DEBUG::2014-05-16 18:24:54,053::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56056::DEBUG::2014-05-16 18:24:54,053::task::974::TaskManager.Task::(_decref) Task=`99e46223-c1e6-4f2e-b930-a8fae942e874`::ref 0 aborting False >Thread-56056::INFO::2014-05-16 18:24:54,122::clientIF::353::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/7371d6a6-29bf-4f5b-97f7-5e7694cff414.5956d5b3620f98211d0b1903abc90c25.img >Thread-56056::INFO::2014-05-16 18:24:54,122::clientIF::353::vds::(prepareVolumePath) prepared volume path: >Thread-56056::DEBUG::2014-05-16 18:24:54,122::task::579::TaskManager.Task::(_updateState) Task=`0fa7732e-f36d-461a-88fc-968bd755b281`::moving from state init -> state preparing >Thread-56056::INFO::2014-05-16 18:24:54,123::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', leafUUID='1726da34-4348-43ad-bdfa-94241ff48c13') >Thread-56056::DEBUG::2014-05-16 18:24:54,123::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`2986dc99-4372-4fa6-80fb-e7c2a216ba30`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage' >Thread-56056::DEBUG::2014-05-16 18:24:54,123::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-56056::DEBUG::2014-05-16 18:24:54,123::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-56056::DEBUG::2014-05-16 18:24:54,124::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`2986dc99-4372-4fa6-80fb-e7c2a216ba30`::Granted request >Thread-56056::DEBUG::2014-05-16 18:24:54,124::task::811::TaskManager.Task::(resourceAcquired) Task=`0fa7732e-f36d-461a-88fc-968bd755b281`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-56056::DEBUG::2014-05-16 18:24:54,124::task::974::TaskManager.Task::(_decref) Task=`0fa7732e-f36d-461a-88fc-968bd755b281`::ref 1 aborting False >Thread-56056::DEBUG::2014-05-16 18:24:54,124::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-56056::DEBUG::2014-05-16 18:24:54,125::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-56056::DEBUG::2014-05-16 18:24:54,291::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56056::DEBUG::2014-05-16 18:24:54,306::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-56056::DEBUG::2014-05-16 18:24:54,306::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-56056::DEBUG::2014-05-16 18:24:54,307::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y f79908bf-a757-4a71-9ab5-3a12ede5f65c/77c78124-ee6c-46b1-9112-a738f448beca f79908bf-a757-4a71-9ab5-3a12ede5f65c/1726da34-4348-43ad-bdfa-94241ff48c13' (cwd None) >Thread-56056::DEBUG::2014-05-16 18:24:54,516::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56056::DEBUG::2014-05-16 18:24:54,517::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-56056::DEBUG::2014-05-16 18:24:54,517::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-56056::DEBUG::2014-05-16 18:24:54,518::blockSD::1039::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572 >Thread-56056::DEBUG::2014-05-16 18:24:54,519::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-56056::DEBUG::2014-05-16 18:24:54,519::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-56056::DEBUG::2014-05-16 18:24:54,664::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56056::DEBUG::2014-05-16 18:24:54,679::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-56056::DEBUG::2014-05-16 18:24:54,679::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-56056::INFO::2014-05-16 18:24:54,680::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13', 'volumeID': '1726da34-4348-43ad-bdfa-94241ff48c13', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}, 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13', 'imgVolumesInfo': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13', 'volumeID': '1726da34-4348-43ad-bdfa-94241ff48c13', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}]} >Thread-56056::DEBUG::2014-05-16 18:24:54,680::task::1168::TaskManager.Task::(prepare) Task=`0fa7732e-f36d-461a-88fc-968bd755b281`::finished: {'info': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13', 'volumeID': '1726da34-4348-43ad-bdfa-94241ff48c13', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}, 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13', 'imgVolumesInfo': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13', 'volumeID': '1726da34-4348-43ad-bdfa-94241ff48c13', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}]} >Thread-56056::DEBUG::2014-05-16 18:24:54,680::task::579::TaskManager.Task::(_updateState) Task=`0fa7732e-f36d-461a-88fc-968bd755b281`::moving from state preparing -> state finished >Thread-56056::DEBUG::2014-05-16 18:24:54,680::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-56056::DEBUG::2014-05-16 18:24:54,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56056::DEBUG::2014-05-16 18:24:54,681::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-56056::DEBUG::2014-05-16 18:24:54,681::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-56056::DEBUG::2014-05-16 18:24:54,681::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-56056::DEBUG::2014-05-16 18:24:54,681::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-56056::DEBUG::2014-05-16 18:24:54,682::task::974::TaskManager.Task::(_decref) Task=`0fa7732e-f36d-461a-88fc-968bd755b281`::ref 0 aborting False >Thread-56056::INFO::2014-05-16 18:24:54,682::clientIF::353::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13 >Thread-56056::DEBUG::2014-05-16 18:24:54,696::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None) >Thread-56056::DEBUG::2014-05-16 18:24:54,766::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56056::INFO::2014-05-16 18:24:54,767::hooks::100::root::(_runHooksDir) >Thread-56056::DEBUG::2014-05-16 18:24:54,767::vm::3073::vm.Vm::(_run) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>bob</name> > <uuid>7371d6a6-29bf-4f5b-97f7-5e7694cff414</uuid> > <memory>2097152</memory> > <currentMemory>2097152</currentMemory> > <vcpu>2</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/7371d6a6-29bf-4f5b-97f7-5e7694cff414.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/7371d6a6-29bf-4f5b-97f7-5e7694cff414.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <smartcard mode="passthrough" type="spicevmc"/> > <controller model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <video> > <model heads="1" type="qxl" vram="32768"/> > </video> > <disk device="floppy" snapshot="no" type="file"> > <source file="/var/run/vdsm/payload/7371d6a6-29bf-4f5b-97f7-5e7694cff414.5956d5b3620f98211d0b1903abc90c25.img" startupPolicy="optional"/> > <target bus="fdc" dev="fda"/> > <readonly/> > <serial/> > <readonly/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13"/> > <target bus="virtio" dev="vda"/> > <serial>a0a67101-ebc7-4fa0-9e63-bf4c38fd0572</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > <memballoon model="virtio"/> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6.5-20140407.0.el6ev</entry> > <entry name="serial">44454C4C-3500-1054-8036-C6C04F5A5131</entry> > <entry name="uuid">7371d6a6-29bf-4f5b-97f7-5e7694cff414</entry> > </system> > </sysinfo> > <clock adjustment="3600" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Nehalem</model> > <topology cores="1" sockets="2" threads="1"/> > </cpu> ></domain> > >Dummy-51::DEBUG::2014-05-16 18:24:54,788::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:54,872::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454061 s, 22.6 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-05-16 18:24:55,237::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::event Started detail 0 opaque None >Thread-56056::DEBUG::2014-05-16 18:24:55,352::sampling::285::vm.Vm::(start) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Start statistics collection >Thread-56059::DEBUG::2014-05-16 18:24:55,353::sampling::314::vm.Vm::(run) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Stats thread started >Thread-56056::DEBUG::2014-05-16 18:24:55,364::vmChannels::194::vds::(register) Add fileno 7 to listener's channels. >Thread-56056::WARNING::2014-05-16 18:24:55,365::vm::3578::vm.Vm::(_readPauseCode) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::_readPauseCode unsupported by libvirt vm >Thread-56059::DEBUG::2014-05-16 18:24:55,367::task::579::TaskManager.Task::(_updateState) Task=`74e38775-57e2-41c5-9156-cb4da80874e1`::moving from state init -> state preparing >Thread-56059::INFO::2014-05-16 18:24:55,367::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', volUUID='1726da34-4348-43ad-bdfa-94241ff48c13', options=None) >Thread-56059::INFO::2014-05-16 18:24:55,368::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-56059::DEBUG::2014-05-16 18:24:55,368::task::1168::TaskManager.Task::(prepare) Task=`74e38775-57e2-41c5-9156-cb4da80874e1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-56059::DEBUG::2014-05-16 18:24:55,369::task::579::TaskManager.Task::(_updateState) Task=`74e38775-57e2-41c5-9156-cb4da80874e1`::moving from state preparing -> state finished >Thread-56059::DEBUG::2014-05-16 18:24:55,369::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56059::DEBUG::2014-05-16 18:24:55,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56059::DEBUG::2014-05-16 18:24:55,369::task::974::TaskManager.Task::(_decref) Task=`74e38775-57e2-41c5-9156-cb4da80874e1`::ref 0 aborting False >Thread-56056::DEBUG::2014-05-16 18:24:55,376::vm::2177::vm.Vm::(_startUnderlyingVm) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::_ongoingCreations released >VM Channels Listener::DEBUG::2014-05-16 18:24:55,570::vmChannels::102::vds::(_do_add_channels) fileno 7 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-05-16 18:24:55,571::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 7. >VM Channels Listener::DEBUG::2014-05-16 18:24:55,571::guestIF::147::vm.Vm::(_connect) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Attempting connection to /var/lib/libvirt/qemu/channels/7371d6a6-29bf-4f5b-97f7-5e7694cff414.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-05-16 18:24:55,571::guestIF::150::vm.Vm::(_connect) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Connected to /var/lib/libvirt/qemu/channels/7371d6a6-29bf-4f5b-97f7-5e7694cff414.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-05-16 18:24:55,572::vmChannels::144::vds::(_handle_unconnected) Connecting to fileno 7 succeeded. >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,376::vm::600::vm.Vm::(_getCpuStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,376::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,376::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,376::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,376::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,377::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,377::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,378::vm::600::vm.Vm::(_getCpuStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,378::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,378::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,378::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,378::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,379::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:24:56,379::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >Dummy-51::DEBUG::2014-05-16 18:24:56,884::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-56060::DEBUG::2014-05-16 18:24:56,936::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56060::DEBUG::2014-05-16 18:24:56,939::task::579::TaskManager.Task::(_updateState) Task=`64ec26c3-d002-48c7-a2fc-8140323187d1`::moving from state init -> state preparing >Thread-56060::INFO::2014-05-16 18:24:56,941::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56060::INFO::2014-05-16 18:24:56,943::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56060::DEBUG::2014-05-16 18:24:56,945::task::1168::TaskManager.Task::(prepare) Task=`64ec26c3-d002-48c7-a2fc-8140323187d1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56060::DEBUG::2014-05-16 18:24:56,947::task::579::TaskManager.Task::(_updateState) Task=`64ec26c3-d002-48c7-a2fc-8140323187d1`::moving from state preparing -> state finished >Thread-56060::DEBUG::2014-05-16 18:24:56,949::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56060::DEBUG::2014-05-16 18:24:56,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56060::DEBUG::2014-05-16 18:24:56,953::task::974::TaskManager.Task::(_decref) Task=`64ec26c3-d002-48c7-a2fc-8140323187d1`::ref 0 aborting False >Thread-56061::DEBUG::2014-05-16 18:24:56,976::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56061::DEBUG::2014-05-16 18:24:56,977::task::579::TaskManager.Task::(_updateState) Task=`5219f4e8-60a6-48a5-943e-2f483351eba1`::moving from state init -> state preparing >Thread-56061::INFO::2014-05-16 18:24:56,978::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56061::DEBUG::2014-05-16 18:24:56,980::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d8132ee9-6dec-4c3e-affb-0dce089b6903`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56061::DEBUG::2014-05-16 18:24:56,981::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56061::DEBUG::2014-05-16 18:24:56,983::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56061::DEBUG::2014-05-16 18:24:56,984::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d8132ee9-6dec-4c3e-affb-0dce089b6903`::Granted request >Thread-56061::DEBUG::2014-05-16 18:24:56,986::task::811::TaskManager.Task::(resourceAcquired) Task=`5219f4e8-60a6-48a5-943e-2f483351eba1`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56061::DEBUG::2014-05-16 18:24:56,987::task::974::TaskManager.Task::(_decref) Task=`5219f4e8-60a6-48a5-943e-2f483351eba1`::ref 1 aborting False >Thread-56061::INFO::2014-05-16 18:24:56,990::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56061::DEBUG::2014-05-16 18:24:56,992::task::1168::TaskManager.Task::(prepare) Task=`5219f4e8-60a6-48a5-943e-2f483351eba1`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56061::DEBUG::2014-05-16 18:24:56,993::task::579::TaskManager.Task::(_updateState) Task=`5219f4e8-60a6-48a5-943e-2f483351eba1`::moving from state preparing -> state finished >Thread-56061::DEBUG::2014-05-16 18:24:56,993::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56061::DEBUG::2014-05-16 18:24:56,994::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56061::DEBUG::2014-05-16 18:24:56,996::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56061::DEBUG::2014-05-16 18:24:56,997::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56061::DEBUG::2014-05-16 18:24:56,998::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56061::DEBUG::2014-05-16 18:24:56,999::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56061::DEBUG::2014-05-16 18:24:57,000::task::974::TaskManager.Task::(_decref) Task=`5219f4e8-60a6-48a5-943e-2f483351eba1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:24:57,011::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322638 s, 31.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:24:57,683::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:24:57,693::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000411382 s, 10.0 MB/s\n'; <rc> = 0 >Thread-56063::DEBUG::2014-05-16 18:24:57,933::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('7371d6a6-29bf-4f5b-97f7-5e7694cff414',) {} >Thread-56063::DEBUG::2014-05-16 18:24:57,933::vm::600::vm.Vm::(_getCpuStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-56063::DEBUG::2014-05-16 18:24:57,933::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >Thread-56063::DEBUG::2014-05-16 18:24:57,933::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >Thread-56063::DEBUG::2014-05-16 18:24:57,934::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >Thread-56063::DEBUG::2014-05-16 18:24:57,934::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >Thread-56063::DEBUG::2014-05-16 18:24:57,934::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >Thread-56063::DEBUG::2014-05-16 18:24:57,934::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >Thread-56063::DEBUG::2014-05-16 18:24:57,936::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '6403', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '-7761126493907495662', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '7371d6a6-29bf-4f5b-97f7-5e7694cff414', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.51', 'elapsedTime': '3', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Dummy-51::DEBUG::2014-05-16 18:24:59,023::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:24:59,096::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349303 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:01,108::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:01,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348715 s, 29.4 MB/s\n'; <rc> = 0 >Thread-56065::DEBUG::2014-05-16 18:25:01,250::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 49599894.000000 / 8.016938 / 262500000.000000 = 2.356910 >Thread-56065::DEBUG::2014-05-16 18:25:01,250::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.11378133497458329, 'statsAge': 0.45196390151977539, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 2.3569095560380764, 'rxDropped': 0} >Thread-56065::DEBUG::2014-05-16 18:25:01,251::task::579::TaskManager.Task::(_updateState) Task=`e627cc9a-acbf-4ee5-8a51-5c3974fab714`::moving from state init -> state preparing >Thread-56065::INFO::2014-05-16 18:25:01,251::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56065::INFO::2014-05-16 18:25:01,251::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411382', 'lastCheck': '3.5', 'valid': True}} >Thread-56065::DEBUG::2014-05-16 18:25:01,252::task::1168::TaskManager.Task::(prepare) Task=`e627cc9a-acbf-4ee5-8a51-5c3974fab714`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411382', 'lastCheck': '3.5', 'valid': True}} >Thread-56065::DEBUG::2014-05-16 18:25:01,252::task::579::TaskManager.Task::(_updateState) Task=`e627cc9a-acbf-4ee5-8a51-5c3974fab714`::moving from state preparing -> state finished >Thread-56065::DEBUG::2014-05-16 18:25:01,252::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56065::DEBUG::2014-05-16 18:25:01,252::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56065::DEBUG::2014-05-16 18:25:01,252::task::974::TaskManager.Task::(_decref) Task=`e627cc9a-acbf-4ee5-8a51-5c3974fab714`::ref 0 aborting False >Thread-56066::DEBUG::2014-05-16 18:25:01,270::vm::600::vm.Vm::(_getCpuStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-56066::DEBUG::2014-05-16 18:25:01,271::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >Thread-56066::DEBUG::2014-05-16 18:25:01,271::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >Thread-56066::DEBUG::2014-05-16 18:25:01,271::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >Thread-56066::DEBUG::2014-05-16 18:25:01,271::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >Thread-56066::DEBUG::2014-05-16 18:25:01,271::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >Thread-56066::DEBUG::2014-05-16 18:25:01,272::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,385::vm::600::vm.Vm::(_getCpuStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,385::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,385::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,386::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,386::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,386::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,386::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,387::vm::600::vm.Vm::(_getCpuStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,388::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,388::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,388::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,388::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,388::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:01,388::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >Dummy-51::DEBUG::2014-05-16 18:25:03,195::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:03,262::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289388 s, 35.4 MB/s\n'; <rc> = 0 >Thread-56068::DEBUG::2014-05-16 18:25:04,415::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('7371d6a6-29bf-4f5b-97f7-5e7694cff414',) {} >Thread-56068::DEBUG::2014-05-16 18:25:04,415::vm::600::vm.Vm::(_getCpuStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-56068::DEBUG::2014-05-16 18:25:04,415::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >Thread-56068::DEBUG::2014-05-16 18:25:04,416::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >Thread-56068::DEBUG::2014-05-16 18:25:04,416::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >Thread-56068::DEBUG::2014-05-16 18:25:04,416::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >Thread-56068::DEBUG::2014-05-16 18:25:04,416::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >Thread-56068::DEBUG::2014-05-16 18:25:04,416::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >Thread-56068::DEBUG::2014-05-16 18:25:04,417::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '6403', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '-7761126493907495662', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '7371d6a6-29bf-4f5b-97f7-5e7694cff414', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.98', 'elapsedTime': '10', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Dummy-51::DEBUG::2014-05-16 18:25:05,273::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:05,355::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369962 s, 27.7 MB/s\n'; <rc> = 0 >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,395::vm::600::vm.Vm::(_getCpuStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,395::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,396::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,396::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,396::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,396::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,397::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,398::vm::600::vm.Vm::(_getCpuStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,398::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,398::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,398::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,399::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,399::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:06,399::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >Thread-56069::DEBUG::2014-05-16 18:25:07,199::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56069::DEBUG::2014-05-16 18:25:07,200::task::579::TaskManager.Task::(_updateState) Task=`b0d716f8-0327-4ba1-a279-fa575b6eadd4`::moving from state init -> state preparing >Thread-56069::INFO::2014-05-16 18:25:07,200::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56069::INFO::2014-05-16 18:25:07,200::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56069::DEBUG::2014-05-16 18:25:07,200::task::1168::TaskManager.Task::(prepare) Task=`b0d716f8-0327-4ba1-a279-fa575b6eadd4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56069::DEBUG::2014-05-16 18:25:07,201::task::579::TaskManager.Task::(_updateState) Task=`b0d716f8-0327-4ba1-a279-fa575b6eadd4`::moving from state preparing -> state finished >Thread-56069::DEBUG::2014-05-16 18:25:07,201::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56069::DEBUG::2014-05-16 18:25:07,201::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56069::DEBUG::2014-05-16 18:25:07,201::task::974::TaskManager.Task::(_decref) Task=`b0d716f8-0327-4ba1-a279-fa575b6eadd4`::ref 0 aborting False >Thread-56070::DEBUG::2014-05-16 18:25:07,211::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56070::DEBUG::2014-05-16 18:25:07,212::task::579::TaskManager.Task::(_updateState) Task=`aaf198ec-e6a5-4736-9814-80750dc7efca`::moving from state init -> state preparing >Thread-56070::INFO::2014-05-16 18:25:07,212::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56070::DEBUG::2014-05-16 18:25:07,213::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`513a8b93-48fb-45fe-9178-0c45a0eb1f97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56070::DEBUG::2014-05-16 18:25:07,213::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56070::DEBUG::2014-05-16 18:25:07,213::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56070::DEBUG::2014-05-16 18:25:07,214::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`513a8b93-48fb-45fe-9178-0c45a0eb1f97`::Granted request >Thread-56070::DEBUG::2014-05-16 18:25:07,214::task::811::TaskManager.Task::(resourceAcquired) Task=`aaf198ec-e6a5-4736-9814-80750dc7efca`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56070::DEBUG::2014-05-16 18:25:07,214::task::974::TaskManager.Task::(_decref) Task=`aaf198ec-e6a5-4736-9814-80750dc7efca`::ref 1 aborting False >Thread-56070::INFO::2014-05-16 18:25:07,215::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56070::DEBUG::2014-05-16 18:25:07,215::task::1168::TaskManager.Task::(prepare) Task=`aaf198ec-e6a5-4736-9814-80750dc7efca`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56070::DEBUG::2014-05-16 18:25:07,215::task::579::TaskManager.Task::(_updateState) Task=`aaf198ec-e6a5-4736-9814-80750dc7efca`::moving from state preparing -> state finished >Thread-56070::DEBUG::2014-05-16 18:25:07,215::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56070::DEBUG::2014-05-16 18:25:07,215::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56070::DEBUG::2014-05-16 18:25:07,216::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56070::DEBUG::2014-05-16 18:25:07,216::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56070::DEBUG::2014-05-16 18:25:07,216::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56070::DEBUG::2014-05-16 18:25:07,216::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56070::DEBUG::2014-05-16 18:25:07,216::task::974::TaskManager.Task::(_decref) Task=`aaf198ec-e6a5-4736-9814-80750dc7efca`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:25:07,368::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:07,442::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331604 s, 30.9 MB/s\n'; <rc> = 0 >Thread-56072::DEBUG::2014-05-16 18:25:07,450::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('7371d6a6-29bf-4f5b-97f7-5e7694cff414',) {} >Thread-56072::DEBUG::2014-05-16 18:25:07,451::vm::600::vm.Vm::(_getCpuStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-56072::DEBUG::2014-05-16 18:25:07,452::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >Thread-56072::DEBUG::2014-05-16 18:25:07,453::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >Thread-56072::DEBUG::2014-05-16 18:25:07,454::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >Thread-56072::DEBUG::2014-05-16 18:25:07,455::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >Thread-56072::DEBUG::2014-05-16 18:25:07,456::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >Thread-56072::DEBUG::2014-05-16 18:25:07,456::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >Thread-56072::DEBUG::2014-05-16 18:25:07,458::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '6403', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '-7761126493907495662', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '7371d6a6-29bf-4f5b-97f7-5e7694cff414', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.01', 'elapsedTime': '13', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-30::DEBUG::2014-05-16 18:25:07,733::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:25:07,744::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000461721 s, 8.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:09,470::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:09,540::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329717 s, 31.1 MB/s\n'; <rc> = 0 >Thread-56074::DEBUG::2014-05-16 18:25:10,602::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmGetStats with ('7371d6a6-29bf-4f5b-97f7-5e7694cff414',) {} >Thread-56074::DEBUG::2014-05-16 18:25:10,603::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >Thread-56074::DEBUG::2014-05-16 18:25:10,603::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >Thread-56074::DEBUG::2014-05-16 18:25:10,603::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >Thread-56074::DEBUG::2014-05-16 18:25:10,603::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >Thread-56074::DEBUG::2014-05-16 18:25:10,603::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >Thread-56074::DEBUG::2014-05-16 18:25:10,604::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >Thread-56074::DEBUG::2014-05-16 18:25:10,605::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '6403', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '3600', 'hash': '-7761126493907495662', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '7371d6a6-29bf-4f5b-97f7-5e7694cff414', 'displayType': 'qxl', 'cpuUser': '53.55', 'disks': {u'fda': {'truesize': '0', 'apparentsize': '0'}, u'vda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.15', 'elapsedTime': '16', 'vmType': 'kvm', 'cpuSys': '30.11', 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-bob::DEBUG::2014-05-16 18:25:11,405::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:11,405::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:11,406::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:11,406::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:11,406::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:11,406::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:11,407::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:11,408::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:11,408::vm::656::vm.Vm::(_getDiskStats) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda stats not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:11,408::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk fda latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:11,408::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk hdc latency not available >GuestMonitor-bob::DEBUG::2014-05-16 18:25:11,409::vm::695::vm.Vm::(_getDiskLatency) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Disk vda latency not available >Dummy-51::DEBUG::2014-05-16 18:25:11,552::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:11,636::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396902 s, 25.8 MB/s\n'; <rc> = 0 >Thread-56075::DEBUG::2014-05-16 18:25:13,184::BindingXMLRPC::975::vds::(wrapper) client [192.168.2.50]::call vmDestroy with ('7371d6a6-29bf-4f5b-97f7-5e7694cff414',) {} flowID [39c57823] >Thread-56075::INFO::2014-05-16 18:25:13,185::API::324::vds::(destroy) vmContainerLock acquired by vm 7371d6a6-29bf-4f5b-97f7-5e7694cff414 >Thread-56075::DEBUG::2014-05-16 18:25:13,185::vm::4533::vm.Vm::(destroy) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::destroy Called >Thread-56075::INFO::2014-05-16 18:25:13,195::vm::4479::vm.Vm::(releaseVm) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Release VM resources >Thread-56075::DEBUG::2014-05-16 18:25:13,208::sampling::292::vm.Vm::(stop) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Stop statistics collection >Thread-56075::DEBUG::2014-05-16 18:25:13,208::vmChannels::205::vds::(unregister) Delete fileno 7 from listener. >Thread-56059::DEBUG::2014-05-16 18:25:13,208::sampling::323::vm.Vm::(run) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Stats thread finished >VM Channels Listener::DEBUG::2014-05-16 18:25:13,592::vmChannels::112::vds::(_do_del_channels) fileno 7 was removed from listener. >libvirtEventLoop::DEBUG::2014-05-16 18:25:13,647::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::event Stopped detail 1 opaque None >libvirtEventLoop::INFO::2014-05-16 18:25:13,647::vm::2238::vm.Vm::(_onQemuDeath) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::underlying process disconnected >Dummy-51::DEBUG::2014-05-16 18:25:13,648::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-56075::WARNING::2014-05-16 18:25:13,646::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7ff55c06dcd0>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7ff55c06dcd0>> _deviceXML:<disk device="floppy" snapshot="no" type="file"><source file="/var/run/vdsm/payload/7371d6a6-29bf-4f5b-97f7-5e7694cff414.5956d5b3620f98211d0b1903abc90c25.img" startupPolicy="optional"/><target bus="fdc" dev="fda"/><readonly/><serial></serial><readonly/></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7ff55c06dcd0>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7ff55c06dcd0>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7ff55c06dcd0>> address:{u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'} alias:fdc0-0-0 apparentsize:0 blockDev:False cache:none conf:{'status': 'Up', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '7371d6a6-29bf-4f5b-97f7-5e7694cff414', 'pid': '6403', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_2d478276-6da3-41cc-8268-7f2cd6d93725': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=2d478276-6da3-41cc-8268-7f2cd6d93725, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27ddevice_8646d184-b0e3-405a-88be-2e09f219acd4device_aef822e0-6c58-4ebe-b788-71c82ed73b1cdevice_d91a9f60-1f1d-443c-a6d4-4288519beec1': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=d91a9f60-1f1d-443c-a6d4-4288519beec1, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27ddevice_8646d184-b0e3-405a-88be-2e09f219acd4': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=8646d184-b0e3-405a-88be-2e09f219acd4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27d': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=30227853-80a8-439f-8d21-7695be76f27d, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27ddevice_8646d184-b0e3-405a-88be-2e09f219acd4device_aef822e0-6c58-4ebe-b788-71c82ed73b1c': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=aef822e0-6c58-4ebe-b788-71c82ed73b1c, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'pauseCode': 'NOERR', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'alias': u'smartcard0', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'deviceId': '176f9d8b-142d-4930-96d5-4147008a2f08', 'address': {u'slot': u'0', u'controller': u'0', u'type': u'ccid'}, 'device': 'smartcard', 'type': 'smartcard'}, {'alias': u'scsi0', 'specParams': {}, 'deviceId': 'c8700151-7a56-448f-b4af-eebce1fb4e67', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': '0939fd54-5b3a-4238-baf1-4c328c4aaeb4', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'index': '0', 'iface': 'fdc', 'name': u'fda', 'alias': u'fdc0-0-0', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}}, 'readonly': 'True', 'deviceId': '2b85b240-95e1-4a6f-859b-3029f4f3ca94', 'path': '/var/run/vdsm/payload/7371d6a6-29bf-4f5b-97f7-5e7694cff414.5956d5b3620f98211d0b1903abc90c25.img', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'True', 'deviceId': '261f5553-cf10-4ac6-8a16-3c70d99b7a97', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13', 'volumeID': '1726da34-4348-43ad-bdfa-94241ff48c13', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk0', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'reqsize': '0', 'format': 'cow', 'deviceId': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'bootOrder': u'1', 'volumeID': '1726da34-4348-43ad-bdfa-94241ff48c13', 'specParams': {}, 'volumeChain': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13', 'volumeID': '1726da34-4348-43ad-bdfa-94241ff48c13', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}]}, {'target': 2097152, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': '97a63046-d062-43bb-b930-939e4ec8a11a', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'bob', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7ff55c06dcd0>> device:floppy deviceId:2b85b240-95e1-4a6f-859b-3029f4f3ca94 drv:raw extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7ff55c06dcd0>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7ff55c06dcd0>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7ff55c06dcd0>> hasVolumeLeases:False iface:fdc index:0 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7ff55c06dcd0>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7ff55c06dcd0>> log:<logUtils.SimpleLogAdapter instance at 0x7ff5343eaf80> name:fda networkDev:False path:/var/run/vdsm/payload/7371d6a6-29bf-4f5b-97f7-5e7694cff414.5956d5b3620f98211d0b1903abc90c25.img readonly:True reqsize:0 serial: shared:false specParams:{'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}} transientDisk:False truesize:0 type:floppy volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath > File "/usr/share/vdsm/vm.py", line 1431, in __getitem__ >KeyError: 'domainID' >Thread-56075::WARNING::2014-05-16 18:25:13,659::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7ff55c06d790>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7ff55c06d790>> _deviceXML:<disk device="cdrom" snapshot="no" type="file"><address bus="1" controller="0" target="0" type="drive" unit="0"/><source file="" startupPolicy="optional"/><target bus="ide" dev="hdc"/><readonly/><serial></serial></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7ff55c06d790>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7ff55c06d790>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7ff55c06d790>> address:{u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'} alias:ide0-1-0 apparentsize:0 blockDev:False cache:none conf:{'status': 'Up', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '7371d6a6-29bf-4f5b-97f7-5e7694cff414', 'pid': '6403', 'memGuaranteedSize': 1024, 'timeOffset': '3600', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Nehalem', 'custom': {'device_2d478276-6da3-41cc-8268-7f2cd6d93725': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=2d478276-6da3-41cc-8268-7f2cd6d93725, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27ddevice_8646d184-b0e3-405a-88be-2e09f219acd4device_aef822e0-6c58-4ebe-b788-71c82ed73b1cdevice_d91a9f60-1f1d-443c-a6d4-4288519beec1': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=d91a9f60-1f1d-443c-a6d4-4288519beec1, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27ddevice_8646d184-b0e3-405a-88be-2e09f219acd4': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=8646d184-b0e3-405a-88be-2e09f219acd4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27d': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=30227853-80a8-439f-8d21-7695be76f27d, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_2d478276-6da3-41cc-8268-7f2cd6d93725device_30227853-80a8-439f-8d21-7695be76f27ddevice_8646d184-b0e3-405a-88be-2e09f219acd4device_aef822e0-6c58-4ebe-b788-71c82ed73b1c': 'VmDevice {vmId=7371d6a6-29bf-4f5b-97f7-5e7694cff414, deviceId=aef822e0-6c58-4ebe-b788-71c82ed73b1c, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'pauseCode': 'NOERR', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'true', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'alias': u'smartcard0', 'specParams': {'type': 'spicevmc', 'mode': 'passthrough'}, 'deviceId': '176f9d8b-142d-4930-96d5-4147008a2f08', 'address': {u'slot': u'0', u'controller': u'0', u'type': u'ccid'}, 'device': 'smartcard', 'type': 'smartcard'}, {'alias': u'scsi0', 'specParams': {}, 'deviceId': 'c8700151-7a56-448f-b4af-eebce1fb4e67', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': '0939fd54-5b3a-4238-baf1-4c328c4aaeb4', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'index': '0', 'iface': 'fdc', 'name': u'fda', 'alias': u'fdc0-0-0', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'vmPayload': {'file': {'sysprep.inf': 'PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4NCjx1bmF0dGVuZCB4bWxucz0i\ndXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp1bmF0dGVuZCI+DQogICAgPHNldHRpbmdzIHBhc3M9\nInNwZWNpYWxpemUiPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dz\nLVNoZWxsLVNldHVwIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49\nIjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4\nUyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAy\nL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3Rh\nbmNlIj4NCiAgICAgICAgICAgIDxDb21wdXRlck5hbWU+Ym9iPC9Db21wdXRlck5hbWU+DQogICAg\nICAgICAgICA8UmVnaXN0ZXJlZE9yZ2FuaXphdGlvbj5hd2F5ZmFyLm9yZzwvUmVnaXN0ZXJlZE9y\nZ2FuaXphdGlvbj4NCiAgICAgICAgICAgIDxSZWdpc3RlcmVkT3duZXI+VXNlcjwvUmVnaXN0ZXJl\nZE93bmVyPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJN\naWNyb3NvZnQtV2luZG93cy1VbmF0dGVuZGVkSm9pbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4\nODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIg\ndmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0\nLmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8y\nMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SWRlbnRpZmljYXRpb24+DQog\nICAgICAgICAgICAgICAgPENyZWRlbnRpYWxzPg0KICAgICAgICAgICAgICAgICAgICA8RG9tYWlu\nPjwvRG9tYWluPg0KICAgICAgICAgICAgICAgICAgICA8UGFzc3dvcmQ+PC9QYXNzd29yZD4NCiAg\nICAgICAgICAgICAgICAgICAgPFVzZXJuYW1lPjwvVXNlcm5hbWU+DQogICAgICAgICAgICAgICAg\nPC9DcmVkZW50aWFscz4NCiAgICAgICAgICAgICAgICA8RGVidWdKb2luPnRydWU8L0RlYnVnSm9p\nbj4NCiAgICAgICAgICAgICAgICA8Sm9pbkRvbWFpbj48L0pvaW5Eb21haW4+DQogICAgICAgICAg\nICA8L0lkZW50aWZpY2F0aW9uPg0KICAgICAgICA8L2NvbXBvbmVudD4NCiAgICA8L3NldHRpbmdz\nPg0KICAgIDxzZXR0aW5ncyBwYXNzPSJvb2JlU3lzdGVtIj4NCiAgICAgICAgPGNvbXBvbmVudCBu\nYW1lPSJNaWNyb3NvZnQtV2luZG93cy1JRS1DbGllbnROZXR3b3JrUHJvdG9jb2xJbXBsZW1lbnRh\ndGlvbiIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1\nNmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5z\nOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIg\neG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQog\nICAgICAgICAgICA8SEtMTVByb3h5RW5hYmxlPmZhbHNlPC9IS0xNUHJveHlFbmFibGU+DQogICAg\nICAgIDwvY29tcG9uZW50Pg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5k\nb3dzLUludGVybmF0aW9uYWwtQ29yZSIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1Ymxp\nY0tleVRva2VuPSIzMWJmMzg1NmFkMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNj\nb3BlPSJub25TeFMiIHhtbG5zOndjbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlD\nb25maWcvMjAwMi9TdGF0ZSIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNj\naGVtYS1pbnN0YW5jZSI+DQogICAgICAgICAgICA8SW5wdXRMb2NhbGU+MDQwOTowMDAwMDQwOTwv\nSW5wdXRMb2NhbGU+DQogICAgICAgICAgICA8U3lzdGVtTG9jYWxlPmVuLXVzPC9TeXN0ZW1Mb2Nh\nbGU+DQogICAgICAgICAgICA8VUlMYW5ndWFnZT5lbi11czwvVUlMYW5ndWFnZT4NCiAgICAgICAg\nICAgIDxVSUxhbmd1YWdlRmFsbGJhY2s+ZW4tdXM8L1VJTGFuZ3VhZ2VGYWxsYmFjaz4NCiAgICAg\nICAgICAgIDxVc2VyTG9jYWxlPmVuLXVzPC9Vc2VyTG9jYWxlPg0KICAgICAgICA8L2NvbXBvbmVu\ndD4NCiAgICAgICAgPGNvbXBvbmVudCBuYW1lPSJNaWNyb3NvZnQtV2luZG93cy1TaGVsbC1TZXR1\ncCIgcHJvY2Vzc29yQXJjaGl0ZWN0dXJlPSJ4ODYiIHB1YmxpY0tleVRva2VuPSIzMWJmMzg1NmFk\nMzY0ZTM1IiBsYW5ndWFnZT0ibmV1dHJhbCIgdmVyc2lvblNjb3BlPSJub25TeFMiIHhtbG5zOndj\nbT0iaHR0cDovL3NjaGVtYXMubWljcm9zb2Z0LmNvbS9XTUlDb25maWcvMjAwMi9TdGF0ZSIgeG1s\nbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSI+DQogICAg\nICAgICAgICA8RGlzcGxheT4NCiAgICAgICAgICAgICAgICA8Q29sb3JEZXB0aD4zMjwvQ29sb3JE\nZXB0aD4NCiAgICAgICAgICAgICAgICA8SG9yaXpvbnRhbFJlc29sdXRpb24+MTAyNDwvSG9yaXpv\nbnRhbFJlc29sdXRpb24+DQogICAgICAgICAgICAgICAgPFJlZnJlc2hSYXRlPjc1PC9SZWZyZXNo\nUmF0ZT4NCiAgICAgICAgICAgICAgICA8VmVydGljYWxSZXNvbHV0aW9uPjc2ODwvVmVydGljYWxS\nZXNvbHV0aW9uPg0KICAgICAgICAgICAgPC9EaXNwbGF5Pg0KICAgICAgICAgICAgPE9PQkU+DQog\nICAgICAgICAgICAgICAgPEhpZGVFVUxBUGFnZT50cnVlPC9IaWRlRVVMQVBhZ2U+DQogICAgICAg\nICAgICAgICAgPFNraXBVc2VyT09CRT50cnVlPC9Ta2lwVXNlck9PQkU+DQogICAgICAgICAgICA8\nL09PQkU+DQogICAgICAgICAgICA8VXNlckFjY291bnRzPg0KICAgICAgICAgICAgICAgIDxBZG1p\nbmlzdHJhdG9yUGFzc3dvcmQ+DQogICAgICAgICAgICAgICAgICAgIDxWYWx1ZT48L1ZhbHVlPg0K\nICAgICAgICAgICAgICAgICAgICA8UGxhaW5UZXh0PnRydWU8L1BsYWluVGV4dD4NCiAgICAgICAg\nICAgICAgICA8L0FkbWluaXN0cmF0b3JQYXNzd29yZD4NCiAgICAgICAgICAgIDwvVXNlckFjY291\nbnRzPg0KICAgICAgICAgICAgPFJlZ2lzdGVyZWRPcmdhbml6YXRpb24+YXdheWZhci5vcmc8L1Jl\nZ2lzdGVyZWRPcmdhbml6YXRpb24+DQogICAgICAgICAgICA8UmVnaXN0ZXJlZE93bmVyPlVzZXI8\nL1JlZ2lzdGVyZWRPd25lcj4NCiAgICAgICAgICAgIDxUaW1lWm9uZT44NTwvVGltZVpvbmU+DQog\nICAgICAgIDwvY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPHNldHRpbmdzIHBhc3M9\nIndpbmRvd3NQRSI+DQogICAgICAgIDxjb21wb25lbnQgbmFtZT0iTWljcm9zb2Z0LVdpbmRvd3Mt\nSW50ZXJuYXRpb25hbC1Db3JlLVdpblBFIiBwcm9jZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVi\nbGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUiIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9u\nU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dN\nSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9Imh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1M\nU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAgIDxTZXR1cFVJTGFuZ3VhZ2U+DQogICAgICAg\nICAgICAgICAgPFVJTGFuZ3VhZ2U+ZW4tdXM8L1VJTGFuZ3VhZ2U+DQogICAgICAgICAgICA8L1Nl\ndHVwVUlMYW5ndWFnZT4NCiAgICAgICAgICAgIDxJbnB1dExvY2FsZT4wNDA5OjAwMDAwNDA5PC9J\nbnB1dExvY2FsZT4NCiAgICAgICAgICAgIDxVSUxhbmd1YWdlPmVuLXVzPC9VSUxhbmd1YWdlPg0K\nICAgICAgICAgICAgPFN5c3RlbUxvY2FsZT5lbi11czwvU3lzdGVtTG9jYWxlPg0KICAgICAgICAg\nICAgPFVJTGFuZ3VhZ2VGYWxsYmFjaz5lbi11czwvVUlMYW5ndWFnZUZhbGxiYWNrPg0KICAgICAg\nICAgICAgPFVzZXJMb2NhbGU+ZW4tdXM8L1VzZXJMb2NhbGU+DQogICAgICAgIDwvY29tcG9uZW50\nPg0KICAgICAgICA8Y29tcG9uZW50IG5hbWU9Ik1pY3Jvc29mdC1XaW5kb3dzLVNldHVwIiBwcm9j\nZXNzb3JBcmNoaXRlY3R1cmU9Ing4NiIgcHVibGljS2V5VG9rZW49IjMxYmYzODU2YWQzNjRlMzUi\nIGxhbmd1YWdlPSJuZXV0cmFsIiB2ZXJzaW9uU2NvcGU9Im5vblN4UyIgeG1sbnM6d2NtPSJodHRw\nOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL1dNSUNvbmZpZy8yMDAyL1N0YXRlIiB4bWxuczp4c2k9\nImh0dHA6Ly93d3cudzMub3JnLzIwMDEvWE1MU2NoZW1hLWluc3RhbmNlIj4NCiAgICAgICAgICAg\nIDxVc2VyRGF0YT4NCiAgICAgICAgICAgICAgICA8UHJvZHVjdEtleT4NCiAgICAgICAgICAgICAg\nICAgICAgPEtleT48L0tleT4NCiAgICAgICAgICAgICAgICAgICAgPFdpbGxTaG93VUk+TmV2ZXI8\nL1dpbGxTaG93VUk+DQogICAgICAgICAgICAgICAgPC9Qcm9kdWN0S2V5Pg0KICAgICAgICAgICAg\nICAgIDxBY2NlcHRFdWxhPnRydWU8L0FjY2VwdEV1bGE+DQogICAgICAgICAgICAgICAgPE9yZ2Fu\naXphdGlvbj5hd2F5ZmFyLm9yZzwvT3JnYW5pemF0aW9uPg0KICAgICAgICAgICAgICAgIDxGdWxs\nTmFtZT5Vc2VyPC9GdWxsTmFtZT4NCiAgICAgICAgICAgIDwvVXNlckRhdGE+DQogICAgICAgIDwv\nY29tcG9uZW50Pg0KICAgIDwvc2V0dGluZ3M+DQogICAgPGNwaTpvZmZsaW5lSW1hZ2UgY3BpOnNv\ndXJjZT0iY2F0YWxvZzovL2NhdGFsb2dzL3dpbmRvd3MyMDA4LXg4Ni9zb3VyY2VzL2luc3RhbGxf\nd2luZG93cyBsb25naG9ybiBzZXJ2ZXJlbnRlcnByaXNlLmNsZyIgeG1sbnM6Y3BpPSJ1cm46c2No\nZW1hcy1taWNyb3NvZnQtY29tOmNwaSIgLz4NCjwvdW5hdHRlbmQ+DQo=\n'}}}, 'readonly': 'True', 'deviceId': '2b85b240-95e1-4a6f-859b-3029f4f3ca94', 'path': '/var/run/vdsm/payload/7371d6a6-29bf-4f5b-97f7-5e7694cff414.5956d5b3620f98211d0b1903abc90c25.img', 'device': 'floppy', 'shared': 'false', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'}, 'readonly': 'True', 'deviceId': '261f5553-cf10-4ac6-8a16-3c70d99b7a97', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13', 'volumeID': '1726da34-4348-43ad-bdfa-94241ff48c13', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk0', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'reqsize': '0', 'format': 'cow', 'deviceId': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', 'poolID': '5849b030-626e-47cb-ad90-3ce782d831b3', 'device': 'disk', 'path': '/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'bootOrder': u'1', 'volumeID': '1726da34-4348-43ad-bdfa-94241ff48c13', 'specParams': {}, 'volumeChain': [{'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/77c78124-ee6c-46b1-9112-a738f448beca', 'volumeID': '77c78124-ee6c-46b1-9112-a738f448beca', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}, {'domainID': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/f79908bf-a757-4a71-9ab5-3a12ede5f65c/images/a0a67101-ebc7-4fa0-9e63-bf4c38fd0572/1726da34-4348-43ad-bdfa-94241ff48c13', 'volumeID': '1726da34-4348-43ad-bdfa-94241ff48c13', 'leasePath': '/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/leases', 'imageID': 'a0a67101-ebc7-4fa0-9e63-bf4c38fd0572'}]}, {'target': 2097152, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': '97a63046-d062-43bb-b930-939e4ec8a11a', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'smp': '2', 'vmType': 'kvm', 'memSize': 2048, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'bob', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7ff55c06d790>> device:cdrom deviceId:261f5553-cf10-4ac6-8a16-3c70d99b7a97 drv:raw extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7ff55c06d790>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7ff55c06d790>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7ff55c06d790>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7ff55c06d790>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7ff55c06d790>> log:<logUtils.SimpleLogAdapter instance at 0x7ff5343eaf80> name:hdc networkDev:False path: readonly:True reqsize:0 serial: shared:false specParams:{'path': 'en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_with_sp1_debug_checked_build_x64_dvd_619600.iso'} transientDisk:False truesize:0 type:cdrom volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath > File "/usr/share/vdsm/vm.py", line 1431, in __getitem__ >KeyError: 'domainID' >Thread-56075::DEBUG::2014-05-16 18:25:13,661::task::579::TaskManager.Task::(_updateState) Task=`43163b00-302b-430f-bed8-7e15bf2e6c36`::moving from state init -> state preparing >Thread-56075::INFO::2014-05-16 18:25:13,661::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='f79908bf-a757-4a71-9ab5-3a12ede5f65c', spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', imgUUID='a0a67101-ebc7-4fa0-9e63-bf4c38fd0572', volUUID=None) >Thread-56075::DEBUG::2014-05-16 18:25:13,661::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`932930cc-c966-4cc0-ae0f-51fc6cc73392`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'teardownImage' >Thread-56075::DEBUG::2014-05-16 18:25:13,661::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' for lock type 'shared' >Thread-56075::DEBUG::2014-05-16 18:25:13,662::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free. Now locking as 'shared' (1 active user) >Thread-56075::DEBUG::2014-05-16 18:25:13,662::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c`ReqID=`932930cc-c966-4cc0-ae0f-51fc6cc73392`::Granted request >Thread-56075::DEBUG::2014-05-16 18:25:13,662::task::811::TaskManager.Task::(resourceAcquired) Task=`43163b00-302b-430f-bed8-7e15bf2e6c36`::_resourcesAcquired: Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c (shared) >Thread-56075::DEBUG::2014-05-16 18:25:13,662::task::974::TaskManager.Task::(_decref) Task=`43163b00-302b-430f-bed8-7e15bf2e6c36`::ref 1 aborting False >Thread-56075::DEBUG::2014-05-16 18:25:13,662::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-56075::DEBUG::2014-05-16 18:25:13,663::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:13,729::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041573 s, 24.6 MB/s\n'; <rc> = 0 >Thread-56075::DEBUG::2014-05-16 18:25:13,866::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56075::DEBUG::2014-05-16 18:25:13,879::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-56075::DEBUG::2014-05-16 18:25:13,880::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-56075::DEBUG::2014-05-16 18:25:13,880::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n f79908bf-a757-4a71-9ab5-3a12ede5f65c/1726da34-4348-43ad-bdfa-94241ff48c13' (cwd None) >Thread-56075::DEBUG::2014-05-16 18:25:14,105::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56075::DEBUG::2014-05-16 18:25:14,106::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-56075::DEBUG::2014-05-16 18:25:14,106::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-56075::INFO::2014-05-16 18:25:14,106::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-56075::DEBUG::2014-05-16 18:25:14,106::task::1168::TaskManager.Task::(prepare) Task=`43163b00-302b-430f-bed8-7e15bf2e6c36`::finished: None >Thread-56075::DEBUG::2014-05-16 18:25:14,107::task::579::TaskManager.Task::(_updateState) Task=`43163b00-302b-430f-bed8-7e15bf2e6c36`::moving from state preparing -> state finished >Thread-56075::DEBUG::2014-05-16 18:25:14,107::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c': < ResourceRef 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', isValid: 'True' obj: 'None'>} >Thread-56075::DEBUG::2014-05-16 18:25:14,107::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56075::DEBUG::2014-05-16 18:25:14,107::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' >Thread-56075::DEBUG::2014-05-16 18:25:14,107::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' (0 active users) >Thread-56075::DEBUG::2014-05-16 18:25:14,108::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c' is free, finding out if anyone is waiting for it. >Thread-56075::DEBUG::2014-05-16 18:25:14,108::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f79908bf-a757-4a71-9ab5-3a12ede5f65c', Clearing records. >Thread-56075::DEBUG::2014-05-16 18:25:14,108::task::974::TaskManager.Task::(_decref) Task=`43163b00-302b-430f-bed8-7e15bf2e6c36`::ref 0 aborting False >Thread-56075::DEBUG::2014-05-16 18:25:14,110::task::579::TaskManager.Task::(_updateState) Task=`b5740efa-6b45-4ba8-99fe-263ce1bb2466`::moving from state init -> state preparing >Thread-56075::INFO::2014-05-16 18:25:14,110::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='7371d6a6-29bf-4f5b-97f7-5e7694cff414') >Thread-56075::INFO::2014-05-16 18:25:14,112::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-56075::DEBUG::2014-05-16 18:25:14,112::task::1168::TaskManager.Task::(prepare) Task=`b5740efa-6b45-4ba8-99fe-263ce1bb2466`::finished: None >Thread-56075::DEBUG::2014-05-16 18:25:14,112::task::579::TaskManager.Task::(_updateState) Task=`b5740efa-6b45-4ba8-99fe-263ce1bb2466`::moving from state preparing -> state finished >Thread-56075::DEBUG::2014-05-16 18:25:14,112::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56075::DEBUG::2014-05-16 18:25:14,113::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56075::DEBUG::2014-05-16 18:25:14,113::task::974::TaskManager.Task::(_decref) Task=`b5740efa-6b45-4ba8-99fe-263ce1bb2466`::ref 0 aborting False >Thread-56075::DEBUG::2014-05-16 18:25:14,114::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd' (cwd None) >Thread-56075::DEBUG::2014-05-16 18:25:14,387::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56075::INFO::2014-05-16 18:25:14,388::hooks::100::root::(_runHooksDir) >Thread-56075::DEBUG::2014-05-16 18:25:14,388::vm::4527::vm.Vm::(deleteVm) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Total desktops after destroy of 7371d6a6-29bf-4f5b-97f7-5e7694cff414 is 0 >Thread-56075::DEBUG::2014-05-16 18:25:14,389::BindingXMLRPC::982::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >libvirtEventLoop::DEBUG::2014-05-16 18:25:14,393::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '7371d6a6-29bf-4f5b-97f7-5e7694cff414' >libvirtEventLoop::DEBUG::2014-05-16 18:25:14,393::vm::2657::vm.Vm::(setDownStatus) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Changed state to Down: Admin shut down >libvirtEventLoop::DEBUG::2014-05-16 18:25:14,393::sampling::292::vm.Vm::(stop) vmId=`7371d6a6-29bf-4f5b-97f7-5e7694cff414`::Stop statistics collection >libvirtEventLoop::DEBUG::2014-05-16 18:25:14,394::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '7371d6a6-29bf-4f5b-97f7-5e7694cff414' >Dummy-51::DEBUG::2014-05-16 18:25:15,742::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:15,813::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354011 s, 28.9 MB/s\n'; <rc> = 0 >Thread-56078::DEBUG::2014-05-16 18:25:17,298::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56078::DEBUG::2014-05-16 18:25:17,298::task::579::TaskManager.Task::(_updateState) Task=`fcd63221-dd6f-4bf8-9005-48680fa65e87`::moving from state init -> state preparing >Thread-56078::INFO::2014-05-16 18:25:17,298::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56078::INFO::2014-05-16 18:25:17,299::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56078::DEBUG::2014-05-16 18:25:17,299::task::1168::TaskManager.Task::(prepare) Task=`fcd63221-dd6f-4bf8-9005-48680fa65e87`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56078::DEBUG::2014-05-16 18:25:17,299::task::579::TaskManager.Task::(_updateState) Task=`fcd63221-dd6f-4bf8-9005-48680fa65e87`::moving from state preparing -> state finished >Thread-56078::DEBUG::2014-05-16 18:25:17,299::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56078::DEBUG::2014-05-16 18:25:17,299::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56078::DEBUG::2014-05-16 18:25:17,299::task::974::TaskManager.Task::(_decref) Task=`fcd63221-dd6f-4bf8-9005-48680fa65e87`::ref 0 aborting False >Thread-56079::DEBUG::2014-05-16 18:25:17,308::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56079::DEBUG::2014-05-16 18:25:17,308::task::579::TaskManager.Task::(_updateState) Task=`935feee4-e19b-4f8e-9d4c-984ad93855bf`::moving from state init -> state preparing >Thread-56079::INFO::2014-05-16 18:25:17,308::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56079::DEBUG::2014-05-16 18:25:17,308::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`187843e9-06d1-4416-a0ef-1407b7dd6af0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56079::DEBUG::2014-05-16 18:25:17,308::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56079::DEBUG::2014-05-16 18:25:17,309::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56079::DEBUG::2014-05-16 18:25:17,309::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`187843e9-06d1-4416-a0ef-1407b7dd6af0`::Granted request >Thread-56079::DEBUG::2014-05-16 18:25:17,309::task::811::TaskManager.Task::(resourceAcquired) Task=`935feee4-e19b-4f8e-9d4c-984ad93855bf`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56079::DEBUG::2014-05-16 18:25:17,309::task::974::TaskManager.Task::(_decref) Task=`935feee4-e19b-4f8e-9d4c-984ad93855bf`::ref 1 aborting False >Thread-56079::INFO::2014-05-16 18:25:17,310::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56079::DEBUG::2014-05-16 18:25:17,310::task::1168::TaskManager.Task::(prepare) Task=`935feee4-e19b-4f8e-9d4c-984ad93855bf`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56079::DEBUG::2014-05-16 18:25:17,310::task::579::TaskManager.Task::(_updateState) Task=`935feee4-e19b-4f8e-9d4c-984ad93855bf`::moving from state preparing -> state finished >Thread-56079::DEBUG::2014-05-16 18:25:17,310::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56079::DEBUG::2014-05-16 18:25:17,310::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56079::DEBUG::2014-05-16 18:25:17,311::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56079::DEBUG::2014-05-16 18:25:17,311::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56079::DEBUG::2014-05-16 18:25:17,311::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56079::DEBUG::2014-05-16 18:25:17,311::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56079::DEBUG::2014-05-16 18:25:17,311::task::974::TaskManager.Task::(_decref) Task=`935feee4-e19b-4f8e-9d4c-984ad93855bf`::ref 0 aborting False >Thread-56080::DEBUG::2014-05-16 18:25:17,516::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 36964613.000000 / 8.008443 / 262500000.000000 = 1.758364 >Thread-56080::DEBUG::2014-05-16 18:25:17,516::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.10271007703896676, 'statsAge': 0.69877099990844727, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 1.75836390761045, 'rxDropped': 0} >Thread-56080::DEBUG::2014-05-16 18:25:17,516::task::579::TaskManager.Task::(_updateState) Task=`87bbc65f-c931-49a3-9a38-8f65d20fa28c`::moving from state init -> state preparing >Thread-56080::INFO::2014-05-16 18:25:17,516::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56080::INFO::2014-05-16 18:25:17,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461721', 'lastCheck': '9.7', 'valid': True}} >Thread-56080::DEBUG::2014-05-16 18:25:17,517::task::1168::TaskManager.Task::(prepare) Task=`87bbc65f-c931-49a3-9a38-8f65d20fa28c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461721', 'lastCheck': '9.7', 'valid': True}} >Thread-56080::DEBUG::2014-05-16 18:25:17,517::task::579::TaskManager.Task::(_updateState) Task=`87bbc65f-c931-49a3-9a38-8f65d20fa28c`::moving from state preparing -> state finished >Thread-56080::DEBUG::2014-05-16 18:25:17,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56080::DEBUG::2014-05-16 18:25:17,517::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56080::DEBUG::2014-05-16 18:25:17,517::task::974::TaskManager.Task::(_decref) Task=`87bbc65f-c931-49a3-9a38-8f65d20fa28c`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:25:17,781::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:25:17,792::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000799434 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:17,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:17,895::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034795 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:19,907::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:19,974::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317241 s, 32.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:21,986::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:22,059::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034972 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:24,071::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:24,145::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369563 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:26,157::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:26,224::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305132 s, 33.6 MB/s\n'; <rc> = 0 >Thread-56085::DEBUG::2014-05-16 18:25:27,510::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56085::DEBUG::2014-05-16 18:25:27,511::task::579::TaskManager.Task::(_updateState) Task=`11d96628-d00a-4cc2-9f13-ccfb9e413655`::moving from state init -> state preparing >Thread-56085::INFO::2014-05-16 18:25:27,511::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56085::INFO::2014-05-16 18:25:27,511::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56085::DEBUG::2014-05-16 18:25:27,511::task::1168::TaskManager.Task::(prepare) Task=`11d96628-d00a-4cc2-9f13-ccfb9e413655`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56085::DEBUG::2014-05-16 18:25:27,512::task::579::TaskManager.Task::(_updateState) Task=`11d96628-d00a-4cc2-9f13-ccfb9e413655`::moving from state preparing -> state finished >Thread-56085::DEBUG::2014-05-16 18:25:27,512::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56085::DEBUG::2014-05-16 18:25:27,512::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56085::DEBUG::2014-05-16 18:25:27,512::task::974::TaskManager.Task::(_decref) Task=`11d96628-d00a-4cc2-9f13-ccfb9e413655`::ref 0 aborting False >Thread-56086::DEBUG::2014-05-16 18:25:27,575::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56086::DEBUG::2014-05-16 18:25:27,575::task::579::TaskManager.Task::(_updateState) Task=`aa3191af-5795-4ef4-b88f-90c6e11068f7`::moving from state init -> state preparing >Thread-56086::INFO::2014-05-16 18:25:27,575::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56086::DEBUG::2014-05-16 18:25:27,576::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e73cc66e-e7df-4895-98e6-4608f8c3e164`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56086::DEBUG::2014-05-16 18:25:27,576::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56086::DEBUG::2014-05-16 18:25:27,576::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56086::DEBUG::2014-05-16 18:25:27,576::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e73cc66e-e7df-4895-98e6-4608f8c3e164`::Granted request >Thread-56086::DEBUG::2014-05-16 18:25:27,577::task::811::TaskManager.Task::(resourceAcquired) Task=`aa3191af-5795-4ef4-b88f-90c6e11068f7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56086::DEBUG::2014-05-16 18:25:27,577::task::974::TaskManager.Task::(_decref) Task=`aa3191af-5795-4ef4-b88f-90c6e11068f7`::ref 1 aborting False >Thread-56086::INFO::2014-05-16 18:25:27,577::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56086::DEBUG::2014-05-16 18:25:27,577::task::1168::TaskManager.Task::(prepare) Task=`aa3191af-5795-4ef4-b88f-90c6e11068f7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56086::DEBUG::2014-05-16 18:25:27,578::task::579::TaskManager.Task::(_updateState) Task=`aa3191af-5795-4ef4-b88f-90c6e11068f7`::moving from state preparing -> state finished >Thread-56086::DEBUG::2014-05-16 18:25:27,578::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56086::DEBUG::2014-05-16 18:25:27,578::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56086::DEBUG::2014-05-16 18:25:27,578::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56086::DEBUG::2014-05-16 18:25:27,578::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56086::DEBUG::2014-05-16 18:25:27,579::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56086::DEBUG::2014-05-16 18:25:27,579::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56086::DEBUG::2014-05-16 18:25:27,579::task::974::TaskManager.Task::(_decref) Task=`aa3191af-5795-4ef4-b88f-90c6e11068f7`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:25:27,829::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:25:27,839::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000914986 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:28,236::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:28,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354623 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:30,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:30,390::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353023 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:32,402::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:32,470::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320981 s, 31.9 MB/s\n'; <rc> = 0 >Thread-56088::DEBUG::2014-05-16 18:25:32,683::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5418310.000000 / 8.008470 / 262500000.000000 = 0.257742 >Thread-56088::DEBUG::2014-05-16 18:25:32,683::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0078766129594417689, 'statsAge': 1.8508460521697998, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25774187581090524, 'rxDropped': 0} >Thread-56088::DEBUG::2014-05-16 18:25:32,683::task::579::TaskManager.Task::(_updateState) Task=`9b118a9c-2178-486e-9b38-9a32df508c98`::moving from state init -> state preparing >Thread-56088::INFO::2014-05-16 18:25:32,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56088::INFO::2014-05-16 18:25:32,684::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000914986', 'lastCheck': '4.8', 'valid': True}} >Thread-56088::DEBUG::2014-05-16 18:25:32,684::task::1168::TaskManager.Task::(prepare) Task=`9b118a9c-2178-486e-9b38-9a32df508c98`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000914986', 'lastCheck': '4.8', 'valid': True}} >Thread-56088::DEBUG::2014-05-16 18:25:32,684::task::579::TaskManager.Task::(_updateState) Task=`9b118a9c-2178-486e-9b38-9a32df508c98`::moving from state preparing -> state finished >Thread-56088::DEBUG::2014-05-16 18:25:32,684::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56088::DEBUG::2014-05-16 18:25:32,684::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56088::DEBUG::2014-05-16 18:25:32,685::task::974::TaskManager.Task::(_decref) Task=`9b118a9c-2178-486e-9b38-9a32df508c98`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:25:34,482::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:34,554::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359992 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:36,566::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:36,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307178 s, 33.3 MB/s\n'; <rc> = 0 >Thread-56091::DEBUG::2014-05-16 18:25:37,620::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56091::DEBUG::2014-05-16 18:25:37,621::task::579::TaskManager.Task::(_updateState) Task=`ef62b7d6-a0c2-4507-b8f9-0654ff9af813`::moving from state init -> state preparing >Thread-56091::INFO::2014-05-16 18:25:37,621::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56091::INFO::2014-05-16 18:25:37,621::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56091::DEBUG::2014-05-16 18:25:37,622::task::1168::TaskManager.Task::(prepare) Task=`ef62b7d6-a0c2-4507-b8f9-0654ff9af813`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56091::DEBUG::2014-05-16 18:25:37,622::task::579::TaskManager.Task::(_updateState) Task=`ef62b7d6-a0c2-4507-b8f9-0654ff9af813`::moving from state preparing -> state finished >Thread-56091::DEBUG::2014-05-16 18:25:37,622::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56091::DEBUG::2014-05-16 18:25:37,622::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56091::DEBUG::2014-05-16 18:25:37,622::task::974::TaskManager.Task::(_decref) Task=`ef62b7d6-a0c2-4507-b8f9-0654ff9af813`::ref 0 aborting False >Thread-56092::DEBUG::2014-05-16 18:25:37,638::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56092::DEBUG::2014-05-16 18:25:37,638::task::579::TaskManager.Task::(_updateState) Task=`61eeff60-535a-43f4-b34a-fcc63a84f74d`::moving from state init -> state preparing >Thread-56092::INFO::2014-05-16 18:25:37,638::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56092::DEBUG::2014-05-16 18:25:37,639::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`60d3385f-a8a0-43a6-88bf-15378f11f9ba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56092::DEBUG::2014-05-16 18:25:37,639::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56092::DEBUG::2014-05-16 18:25:37,639::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56092::DEBUG::2014-05-16 18:25:37,639::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`60d3385f-a8a0-43a6-88bf-15378f11f9ba`::Granted request >Thread-56092::DEBUG::2014-05-16 18:25:37,640::task::811::TaskManager.Task::(resourceAcquired) Task=`61eeff60-535a-43f4-b34a-fcc63a84f74d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56092::DEBUG::2014-05-16 18:25:37,640::task::974::TaskManager.Task::(_decref) Task=`61eeff60-535a-43f4-b34a-fcc63a84f74d`::ref 1 aborting False >Thread-56092::INFO::2014-05-16 18:25:37,640::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56092::DEBUG::2014-05-16 18:25:37,641::task::1168::TaskManager.Task::(prepare) Task=`61eeff60-535a-43f4-b34a-fcc63a84f74d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56092::DEBUG::2014-05-16 18:25:37,641::task::579::TaskManager.Task::(_updateState) Task=`61eeff60-535a-43f4-b34a-fcc63a84f74d`::moving from state preparing -> state finished >Thread-56092::DEBUG::2014-05-16 18:25:37,641::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56092::DEBUG::2014-05-16 18:25:37,641::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56092::DEBUG::2014-05-16 18:25:37,641::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56092::DEBUG::2014-05-16 18:25:37,642::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56092::DEBUG::2014-05-16 18:25:37,642::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56092::DEBUG::2014-05-16 18:25:37,642::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56092::DEBUG::2014-05-16 18:25:37,642::task::974::TaskManager.Task::(_decref) Task=`61eeff60-535a-43f4-b34a-fcc63a84f74d`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:25:37,874::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:25:37,885::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000982631 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:38,645::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:38,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343458 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:40,727::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:40,794::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316332 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:42,806::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:42,881::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0389329 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:44,894::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:44,968::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363196 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:46,980::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:47,047::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306111 s, 33.5 MB/s\n'; <rc> = 0 >Thread-56096::DEBUG::2014-05-16 18:25:47,727::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56096::DEBUG::2014-05-16 18:25:47,727::task::579::TaskManager.Task::(_updateState) Task=`bbafc80d-5031-4937-887a-706d26f77468`::moving from state init -> state preparing >Thread-56096::INFO::2014-05-16 18:25:47,728::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56096::INFO::2014-05-16 18:25:47,728::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56096::DEBUG::2014-05-16 18:25:47,728::task::1168::TaskManager.Task::(prepare) Task=`bbafc80d-5031-4937-887a-706d26f77468`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56096::DEBUG::2014-05-16 18:25:47,728::task::579::TaskManager.Task::(_updateState) Task=`bbafc80d-5031-4937-887a-706d26f77468`::moving from state preparing -> state finished >Thread-56096::DEBUG::2014-05-16 18:25:47,728::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56096::DEBUG::2014-05-16 18:25:47,729::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56096::DEBUG::2014-05-16 18:25:47,729::task::974::TaskManager.Task::(_decref) Task=`bbafc80d-5031-4937-887a-706d26f77468`::ref 0 aborting False >Thread-56097::DEBUG::2014-05-16 18:25:47,737::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56097::DEBUG::2014-05-16 18:25:47,738::task::579::TaskManager.Task::(_updateState) Task=`37eb49e3-67a1-4c1a-be16-a1204954e45a`::moving from state init -> state preparing >Thread-56097::INFO::2014-05-16 18:25:47,738::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56097::DEBUG::2014-05-16 18:25:47,738::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d3d965a6-6d9a-4bfe-b221-97522896909a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56097::DEBUG::2014-05-16 18:25:47,738::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56097::DEBUG::2014-05-16 18:25:47,739::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56097::DEBUG::2014-05-16 18:25:47,739::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d3d965a6-6d9a-4bfe-b221-97522896909a`::Granted request >Thread-56097::DEBUG::2014-05-16 18:25:47,739::task::811::TaskManager.Task::(resourceAcquired) Task=`37eb49e3-67a1-4c1a-be16-a1204954e45a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56097::DEBUG::2014-05-16 18:25:47,739::task::974::TaskManager.Task::(_decref) Task=`37eb49e3-67a1-4c1a-be16-a1204954e45a`::ref 1 aborting False >Thread-56097::INFO::2014-05-16 18:25:47,740::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56097::DEBUG::2014-05-16 18:25:47,740::task::1168::TaskManager.Task::(prepare) Task=`37eb49e3-67a1-4c1a-be16-a1204954e45a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56097::DEBUG::2014-05-16 18:25:47,740::task::579::TaskManager.Task::(_updateState) Task=`37eb49e3-67a1-4c1a-be16-a1204954e45a`::moving from state preparing -> state finished >Thread-56097::DEBUG::2014-05-16 18:25:47,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56097::DEBUG::2014-05-16 18:25:47,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56097::DEBUG::2014-05-16 18:25:47,741::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56097::DEBUG::2014-05-16 18:25:47,741::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56097::DEBUG::2014-05-16 18:25:47,741::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56097::DEBUG::2014-05-16 18:25:47,741::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56097::DEBUG::2014-05-16 18:25:47,742::task::974::TaskManager.Task::(_decref) Task=`37eb49e3-67a1-4c1a-be16-a1204954e45a`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:25:47,921::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:25:47,931::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000768518 s, 5.3 MB/s\n'; <rc> = 0 >Thread-56098::DEBUG::2014-05-16 18:25:47,940::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3234389.000000 / 8.011446 / 262500000.000000 = 0.153798 >Thread-56098::DEBUG::2014-05-16 18:25:47,941::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0038774998864991718, 'statsAge': 1.0873939990997314, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15379847665547644, 'rxDropped': 0} >Thread-56098::DEBUG::2014-05-16 18:25:47,943::task::579::TaskManager.Task::(_updateState) Task=`781039e0-bfb6-479f-bf26-3c50e8dffcf2`::moving from state init -> state preparing >Thread-56098::INFO::2014-05-16 18:25:47,944::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56098::INFO::2014-05-16 18:25:47,946::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000982631', 'lastCheck': '10.0', 'valid': True}} >Thread-56098::DEBUG::2014-05-16 18:25:47,947::task::1168::TaskManager.Task::(prepare) Task=`781039e0-bfb6-479f-bf26-3c50e8dffcf2`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000982631', 'lastCheck': '10.0', 'valid': True}} >Thread-56098::DEBUG::2014-05-16 18:25:47,948::task::579::TaskManager.Task::(_updateState) Task=`781039e0-bfb6-479f-bf26-3c50e8dffcf2`::moving from state preparing -> state finished >Thread-56098::DEBUG::2014-05-16 18:25:47,949::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56098::DEBUG::2014-05-16 18:25:47,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56098::DEBUG::2014-05-16 18:25:47,951::task::974::TaskManager.Task::(_decref) Task=`781039e0-bfb6-479f-bf26-3c50e8dffcf2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:25:49,059::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:49,130::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352617 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:51,142::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:51,208::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306791 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:53,220::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:53,286::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310967 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:55,298::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:55,370::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357478 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:57,381::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:57,448::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309187 s, 33.1 MB/s\n'; <rc> = 0 >Thread-56103::DEBUG::2014-05-16 18:25:57,791::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56103::DEBUG::2014-05-16 18:25:57,792::task::579::TaskManager.Task::(_updateState) Task=`81a54b45-3df1-44e3-9915-68c5733112e9`::moving from state init -> state preparing >Thread-56103::INFO::2014-05-16 18:25:57,792::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56103::INFO::2014-05-16 18:25:57,792::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56103::DEBUG::2014-05-16 18:25:57,792::task::1168::TaskManager.Task::(prepare) Task=`81a54b45-3df1-44e3-9915-68c5733112e9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56103::DEBUG::2014-05-16 18:25:57,793::task::579::TaskManager.Task::(_updateState) Task=`81a54b45-3df1-44e3-9915-68c5733112e9`::moving from state preparing -> state finished >Thread-56103::DEBUG::2014-05-16 18:25:57,793::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56103::DEBUG::2014-05-16 18:25:57,793::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56103::DEBUG::2014-05-16 18:25:57,793::task::974::TaskManager.Task::(_decref) Task=`81a54b45-3df1-44e3-9915-68c5733112e9`::ref 0 aborting False >Thread-56104::DEBUG::2014-05-16 18:25:57,802::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56104::DEBUG::2014-05-16 18:25:57,802::task::579::TaskManager.Task::(_updateState) Task=`277d312f-f1a9-4baf-8eff-8d5eadb8b2ec`::moving from state init -> state preparing >Thread-56104::INFO::2014-05-16 18:25:57,802::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56104::DEBUG::2014-05-16 18:25:57,803::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fb9fda21-5562-4c38-a5dc-515e0b059c1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56104::DEBUG::2014-05-16 18:25:57,803::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56104::DEBUG::2014-05-16 18:25:57,803::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56104::DEBUG::2014-05-16 18:25:57,803::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fb9fda21-5562-4c38-a5dc-515e0b059c1b`::Granted request >Thread-56104::DEBUG::2014-05-16 18:25:57,804::task::811::TaskManager.Task::(resourceAcquired) Task=`277d312f-f1a9-4baf-8eff-8d5eadb8b2ec`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56104::DEBUG::2014-05-16 18:25:57,804::task::974::TaskManager.Task::(_decref) Task=`277d312f-f1a9-4baf-8eff-8d5eadb8b2ec`::ref 1 aborting False >Thread-56104::INFO::2014-05-16 18:25:57,804::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56104::DEBUG::2014-05-16 18:25:57,805::task::1168::TaskManager.Task::(prepare) Task=`277d312f-f1a9-4baf-8eff-8d5eadb8b2ec`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56104::DEBUG::2014-05-16 18:25:57,805::task::579::TaskManager.Task::(_updateState) Task=`277d312f-f1a9-4baf-8eff-8d5eadb8b2ec`::moving from state preparing -> state finished >Thread-56104::DEBUG::2014-05-16 18:25:57,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56104::DEBUG::2014-05-16 18:25:57,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56104::DEBUG::2014-05-16 18:25:57,805::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56104::DEBUG::2014-05-16 18:25:57,806::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56104::DEBUG::2014-05-16 18:25:57,806::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56104::DEBUG::2014-05-16 18:25:57,806::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56104::DEBUG::2014-05-16 18:25:57,806::task::974::TaskManager.Task::(_decref) Task=`277d312f-f1a9-4baf-8eff-8d5eadb8b2ec`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:25:57,999::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:25:58,009::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000818078 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:25:59,460::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:25:59,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351315 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:01,543::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:01,693::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.112671 s, 9.1 MB/s\n'; <rc> = 0 >Thread-56106::DEBUG::2014-05-16 18:26:03,145::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4320486.000000 / 8.008341 / 262500000.000000 = 0.205523 >Thread-56106::DEBUG::2014-05-16 18:26:03,145::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052817313386596598, 'statsAge': 0.27654218673706055, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20552314922220907, 'rxDropped': 0} >Thread-56106::DEBUG::2014-05-16 18:26:03,145::task::579::TaskManager.Task::(_updateState) Task=`a20f69ff-468a-4443-a373-5af9c2ca0d3f`::moving from state init -> state preparing >Thread-56106::INFO::2014-05-16 18:26:03,146::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56106::INFO::2014-05-16 18:26:03,146::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000818078', 'lastCheck': '5.1', 'valid': True}} >Thread-56106::DEBUG::2014-05-16 18:26:03,146::task::1168::TaskManager.Task::(prepare) Task=`a20f69ff-468a-4443-a373-5af9c2ca0d3f`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000818078', 'lastCheck': '5.1', 'valid': True}} >Thread-56106::DEBUG::2014-05-16 18:26:03,146::task::579::TaskManager.Task::(_updateState) Task=`a20f69ff-468a-4443-a373-5af9c2ca0d3f`::moving from state preparing -> state finished >Thread-56106::DEBUG::2014-05-16 18:26:03,146::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56106::DEBUG::2014-05-16 18:26:03,146::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56106::DEBUG::2014-05-16 18:26:03,146::task::974::TaskManager.Task::(_decref) Task=`a20f69ff-468a-4443-a373-5af9c2ca0d3f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:26:03,701::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:03,767::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307688 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:05,779::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:05,847::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314967 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:07,858::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-56109::DEBUG::2014-05-16 18:26:07,868::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56109::DEBUG::2014-05-16 18:26:07,873::task::579::TaskManager.Task::(_updateState) Task=`798176b9-d0cf-40e7-b256-58ee469b19ea`::moving from state init -> state preparing >Thread-56109::INFO::2014-05-16 18:26:07,873::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56109::INFO::2014-05-16 18:26:07,873::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56109::DEBUG::2014-05-16 18:26:07,873::task::1168::TaskManager.Task::(prepare) Task=`798176b9-d0cf-40e7-b256-58ee469b19ea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56109::DEBUG::2014-05-16 18:26:07,873::task::579::TaskManager.Task::(_updateState) Task=`798176b9-d0cf-40e7-b256-58ee469b19ea`::moving from state preparing -> state finished >Thread-56109::DEBUG::2014-05-16 18:26:07,874::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56109::DEBUG::2014-05-16 18:26:07,874::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56109::DEBUG::2014-05-16 18:26:07,874::task::974::TaskManager.Task::(_decref) Task=`798176b9-d0cf-40e7-b256-58ee469b19ea`::ref 0 aborting False >Thread-56110::DEBUG::2014-05-16 18:26:07,882::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56110::DEBUG::2014-05-16 18:26:07,883::task::579::TaskManager.Task::(_updateState) Task=`dc3c07a7-0f37-45d9-ac4b-d42b387c82af`::moving from state init -> state preparing >Thread-56110::INFO::2014-05-16 18:26:07,883::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56110::DEBUG::2014-05-16 18:26:07,883::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6f16d905-ee72-4eff-8795-aef1ef125fdb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56110::DEBUG::2014-05-16 18:26:07,884::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56110::DEBUG::2014-05-16 18:26:07,884::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56110::DEBUG::2014-05-16 18:26:07,884::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6f16d905-ee72-4eff-8795-aef1ef125fdb`::Granted request >Thread-56110::DEBUG::2014-05-16 18:26:07,885::task::811::TaskManager.Task::(resourceAcquired) Task=`dc3c07a7-0f37-45d9-ac4b-d42b387c82af`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56110::DEBUG::2014-05-16 18:26:07,885::task::974::TaskManager.Task::(_decref) Task=`dc3c07a7-0f37-45d9-ac4b-d42b387c82af`::ref 1 aborting False >Thread-56110::INFO::2014-05-16 18:26:07,886::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56110::DEBUG::2014-05-16 18:26:07,886::task::1168::TaskManager.Task::(prepare) Task=`dc3c07a7-0f37-45d9-ac4b-d42b387c82af`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56110::DEBUG::2014-05-16 18:26:07,886::task::579::TaskManager.Task::(_updateState) Task=`dc3c07a7-0f37-45d9-ac4b-d42b387c82af`::moving from state preparing -> state finished >Thread-56110::DEBUG::2014-05-16 18:26:07,886::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56110::DEBUG::2014-05-16 18:26:07,886::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56110::DEBUG::2014-05-16 18:26:07,887::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56110::DEBUG::2014-05-16 18:26:07,887::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56110::DEBUG::2014-05-16 18:26:07,887::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56110::DEBUG::2014-05-16 18:26:07,887::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56110::DEBUG::2014-05-16 18:26:07,888::task::974::TaskManager.Task::(_decref) Task=`dc3c07a7-0f37-45d9-ac4b-d42b387c82af`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:26:07,933::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03863 s, 26.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:26:08,046::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:26:08,057::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000766696 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:09,945::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:10,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353427 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:12,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:12,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308865 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:14,107::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:14,174::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314008 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:16,186::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:16,257::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353463 s, 29.0 MB/s\n'; <rc> = 0 >Thread-56114::DEBUG::2014-05-16 18:26:17,915::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56114::DEBUG::2014-05-16 18:26:17,916::task::579::TaskManager.Task::(_updateState) Task=`d276615d-0daf-4122-b5b0-e2591939cc26`::moving from state init -> state preparing >Thread-56114::INFO::2014-05-16 18:26:17,916::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56114::INFO::2014-05-16 18:26:17,916::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56114::DEBUG::2014-05-16 18:26:17,916::task::1168::TaskManager.Task::(prepare) Task=`d276615d-0daf-4122-b5b0-e2591939cc26`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56114::DEBUG::2014-05-16 18:26:17,916::task::579::TaskManager.Task::(_updateState) Task=`d276615d-0daf-4122-b5b0-e2591939cc26`::moving from state preparing -> state finished >Thread-56114::DEBUG::2014-05-16 18:26:17,916::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56114::DEBUG::2014-05-16 18:26:17,917::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56114::DEBUG::2014-05-16 18:26:17,917::task::974::TaskManager.Task::(_decref) Task=`d276615d-0daf-4122-b5b0-e2591939cc26`::ref 0 aborting False >Thread-56115::DEBUG::2014-05-16 18:26:17,925::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56115::DEBUG::2014-05-16 18:26:17,925::task::579::TaskManager.Task::(_updateState) Task=`3e20c969-4859-45ad-bcc7-587da8f0e0b9`::moving from state init -> state preparing >Thread-56115::INFO::2014-05-16 18:26:17,925::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56115::DEBUG::2014-05-16 18:26:17,925::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6b818d5c-f314-4c59-85e3-08443322de6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56115::DEBUG::2014-05-16 18:26:17,925::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56115::DEBUG::2014-05-16 18:26:17,926::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56115::DEBUG::2014-05-16 18:26:17,926::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6b818d5c-f314-4c59-85e3-08443322de6c`::Granted request >Thread-56115::DEBUG::2014-05-16 18:26:17,926::task::811::TaskManager.Task::(resourceAcquired) Task=`3e20c969-4859-45ad-bcc7-587da8f0e0b9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56115::DEBUG::2014-05-16 18:26:17,926::task::974::TaskManager.Task::(_decref) Task=`3e20c969-4859-45ad-bcc7-587da8f0e0b9`::ref 1 aborting False >Thread-56115::INFO::2014-05-16 18:26:17,927::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56115::DEBUG::2014-05-16 18:26:17,927::task::1168::TaskManager.Task::(prepare) Task=`3e20c969-4859-45ad-bcc7-587da8f0e0b9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56115::DEBUG::2014-05-16 18:26:17,927::task::579::TaskManager.Task::(_updateState) Task=`3e20c969-4859-45ad-bcc7-587da8f0e0b9`::moving from state preparing -> state finished >Thread-56115::DEBUG::2014-05-16 18:26:17,927::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56115::DEBUG::2014-05-16 18:26:17,927::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56115::DEBUG::2014-05-16 18:26:17,928::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56115::DEBUG::2014-05-16 18:26:17,928::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56115::DEBUG::2014-05-16 18:26:17,928::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56115::DEBUG::2014-05-16 18:26:17,928::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56115::DEBUG::2014-05-16 18:26:17,928::task::974::TaskManager.Task::(_decref) Task=`3e20c969-4859-45ad-bcc7-587da8f0e0b9`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:26:18,091::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:26:18,101::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640085 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:18,269::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:18,340::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353564 s, 29.0 MB/s\n'; <rc> = 0 >Thread-56116::DEBUG::2014-05-16 18:26:18,384::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5413224.000000 / 8.008516 / 262500000.000000 = 0.257498 >Thread-56116::DEBUG::2014-05-16 18:26:18,384::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066473048355383075, 'statsAge': 1.5007538795471191, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25749846195883852, 'rxDropped': 0} >Thread-56116::DEBUG::2014-05-16 18:26:18,384::task::579::TaskManager.Task::(_updateState) Task=`79ba8daa-2cd0-4b7e-acf4-a61fb85b4a0c`::moving from state init -> state preparing >Thread-56116::INFO::2014-05-16 18:26:18,385::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56116::INFO::2014-05-16 18:26:18,385::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640085', 'lastCheck': '0.3', 'valid': True}} >Thread-56116::DEBUG::2014-05-16 18:26:18,385::task::1168::TaskManager.Task::(prepare) Task=`79ba8daa-2cd0-4b7e-acf4-a61fb85b4a0c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640085', 'lastCheck': '0.3', 'valid': True}} >Thread-56116::DEBUG::2014-05-16 18:26:18,385::task::579::TaskManager.Task::(_updateState) Task=`79ba8daa-2cd0-4b7e-acf4-a61fb85b4a0c`::moving from state preparing -> state finished >Thread-56116::DEBUG::2014-05-16 18:26:18,385::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56116::DEBUG::2014-05-16 18:26:18,386::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56116::DEBUG::2014-05-16 18:26:18,386::task::974::TaskManager.Task::(_decref) Task=`79ba8daa-2cd0-4b7e-acf4-a61fb85b4a0c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:26:20,352::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:20,419::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311607 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:22,431::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:22,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035787 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:24,514::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:24,586::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359675 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:26,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:26,664::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309492 s, 33.1 MB/s\n'; <rc> = 0 >Thread-56121::DEBUG::2014-05-16 18:26:27,997::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56121::DEBUG::2014-05-16 18:26:27,997::task::579::TaskManager.Task::(_updateState) Task=`82eb36e3-9847-4d47-8ebc-5c6c379b1a4d`::moving from state init -> state preparing >Thread-56121::INFO::2014-05-16 18:26:27,997::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56121::INFO::2014-05-16 18:26:27,998::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56121::DEBUG::2014-05-16 18:26:27,998::task::1168::TaskManager.Task::(prepare) Task=`82eb36e3-9847-4d47-8ebc-5c6c379b1a4d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56121::DEBUG::2014-05-16 18:26:27,998::task::579::TaskManager.Task::(_updateState) Task=`82eb36e3-9847-4d47-8ebc-5c6c379b1a4d`::moving from state preparing -> state finished >Thread-56121::DEBUG::2014-05-16 18:26:27,998::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56121::DEBUG::2014-05-16 18:26:27,998::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56121::DEBUG::2014-05-16 18:26:27,998::task::974::TaskManager.Task::(_decref) Task=`82eb36e3-9847-4d47-8ebc-5c6c379b1a4d`::ref 0 aborting False >Thread-56122::DEBUG::2014-05-16 18:26:28,017::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56122::DEBUG::2014-05-16 18:26:28,017::task::579::TaskManager.Task::(_updateState) Task=`a9e48d07-641f-4a31-89b6-9fa52f4dde0c`::moving from state init -> state preparing >Thread-56122::INFO::2014-05-16 18:26:28,017::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56122::DEBUG::2014-05-16 18:26:28,018::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9b12999b-5a1b-41c9-9a94-90604cb967e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56122::DEBUG::2014-05-16 18:26:28,018::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56122::DEBUG::2014-05-16 18:26:28,018::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56122::DEBUG::2014-05-16 18:26:28,018::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9b12999b-5a1b-41c9-9a94-90604cb967e1`::Granted request >Thread-56122::DEBUG::2014-05-16 18:26:28,018::task::811::TaskManager.Task::(resourceAcquired) Task=`a9e48d07-641f-4a31-89b6-9fa52f4dde0c`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56122::DEBUG::2014-05-16 18:26:28,019::task::974::TaskManager.Task::(_decref) Task=`a9e48d07-641f-4a31-89b6-9fa52f4dde0c`::ref 1 aborting False >Thread-56122::INFO::2014-05-16 18:26:28,019::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56122::DEBUG::2014-05-16 18:26:28,019::task::1168::TaskManager.Task::(prepare) Task=`a9e48d07-641f-4a31-89b6-9fa52f4dde0c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56122::DEBUG::2014-05-16 18:26:28,020::task::579::TaskManager.Task::(_updateState) Task=`a9e48d07-641f-4a31-89b6-9fa52f4dde0c`::moving from state preparing -> state finished >Thread-56122::DEBUG::2014-05-16 18:26:28,020::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56122::DEBUG::2014-05-16 18:26:28,020::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56122::DEBUG::2014-05-16 18:26:28,020::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56122::DEBUG::2014-05-16 18:26:28,020::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56122::DEBUG::2014-05-16 18:26:28,020::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56122::DEBUG::2014-05-16 18:26:28,021::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56122::DEBUG::2014-05-16 18:26:28,021::task::974::TaskManager.Task::(_decref) Task=`a9e48d07-641f-4a31-89b6-9fa52f4dde0c`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:26:28,139::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:26:28,150::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108175 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:28,675::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:28,740::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353316 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:30,748::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:30,819::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346747 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:32,830::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:32,896::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302805 s, 33.8 MB/s\n'; <rc> = 0 >Thread-56124::DEBUG::2014-05-16 18:26:33,563::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4343727.000000 / 8.008573 / 262500000.000000 = 0.206623 >Thread-56124::DEBUG::2014-05-16 18:26:33,563::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0056289202504021165, 'statsAge': 0.66308379173278809, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20662271935807489, 'rxDropped': 0} >Thread-56124::DEBUG::2014-05-16 18:26:33,564::task::579::TaskManager.Task::(_updateState) Task=`0d1096a1-5e68-4626-b285-5e0e4aec727d`::moving from state init -> state preparing >Thread-56124::INFO::2014-05-16 18:26:33,564::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56124::INFO::2014-05-16 18:26:33,564::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108175', 'lastCheck': '5.4', 'valid': True}} >Thread-56124::DEBUG::2014-05-16 18:26:33,564::task::1168::TaskManager.Task::(prepare) Task=`0d1096a1-5e68-4626-b285-5e0e4aec727d`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108175', 'lastCheck': '5.4', 'valid': True}} >Thread-56124::DEBUG::2014-05-16 18:26:33,565::task::579::TaskManager.Task::(_updateState) Task=`0d1096a1-5e68-4626-b285-5e0e4aec727d`::moving from state preparing -> state finished >Thread-56124::DEBUG::2014-05-16 18:26:33,565::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56124::DEBUG::2014-05-16 18:26:33,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56124::DEBUG::2014-05-16 18:26:33,565::task::974::TaskManager.Task::(_decref) Task=`0d1096a1-5e68-4626-b285-5e0e4aec727d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:26:34,912::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:34,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312429 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:36,991::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:37,063::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352647 s, 29.0 MB/s\n'; <rc> = 0 >Thread-56127::DEBUG::2014-05-16 18:26:38,113::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56127::DEBUG::2014-05-16 18:26:38,114::task::579::TaskManager.Task::(_updateState) Task=`aad17cdd-2e35-474a-88b0-1680a6e29781`::moving from state init -> state preparing >Thread-56127::INFO::2014-05-16 18:26:38,114::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56127::INFO::2014-05-16 18:26:38,114::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56127::DEBUG::2014-05-16 18:26:38,114::task::1168::TaskManager.Task::(prepare) Task=`aad17cdd-2e35-474a-88b0-1680a6e29781`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56127::DEBUG::2014-05-16 18:26:38,114::task::579::TaskManager.Task::(_updateState) Task=`aad17cdd-2e35-474a-88b0-1680a6e29781`::moving from state preparing -> state finished >Thread-56127::DEBUG::2014-05-16 18:26:38,115::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56127::DEBUG::2014-05-16 18:26:38,115::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56127::DEBUG::2014-05-16 18:26:38,115::task::974::TaskManager.Task::(_decref) Task=`aad17cdd-2e35-474a-88b0-1680a6e29781`::ref 0 aborting False >Thread-56128::DEBUG::2014-05-16 18:26:38,122::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56128::DEBUG::2014-05-16 18:26:38,123::task::579::TaskManager.Task::(_updateState) Task=`b48461f3-466c-4922-b540-183b10d044cf`::moving from state init -> state preparing >Thread-56128::INFO::2014-05-16 18:26:38,123::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56128::DEBUG::2014-05-16 18:26:38,123::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`63a682b3-6069-4589-a326-95668de359f8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56128::DEBUG::2014-05-16 18:26:38,123::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56128::DEBUG::2014-05-16 18:26:38,123::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56128::DEBUG::2014-05-16 18:26:38,124::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`63a682b3-6069-4589-a326-95668de359f8`::Granted request >Thread-56128::DEBUG::2014-05-16 18:26:38,124::task::811::TaskManager.Task::(resourceAcquired) Task=`b48461f3-466c-4922-b540-183b10d044cf`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56128::DEBUG::2014-05-16 18:26:38,124::task::974::TaskManager.Task::(_decref) Task=`b48461f3-466c-4922-b540-183b10d044cf`::ref 1 aborting False >Thread-56128::INFO::2014-05-16 18:26:38,125::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56128::DEBUG::2014-05-16 18:26:38,125::task::1168::TaskManager.Task::(prepare) Task=`b48461f3-466c-4922-b540-183b10d044cf`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56128::DEBUG::2014-05-16 18:26:38,125::task::579::TaskManager.Task::(_updateState) Task=`b48461f3-466c-4922-b540-183b10d044cf`::moving from state preparing -> state finished >Thread-56128::DEBUG::2014-05-16 18:26:38,125::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56128::DEBUG::2014-05-16 18:26:38,125::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56128::DEBUG::2014-05-16 18:26:38,125::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56128::DEBUG::2014-05-16 18:26:38,126::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56128::DEBUG::2014-05-16 18:26:38,126::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56128::DEBUG::2014-05-16 18:26:38,126::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56128::DEBUG::2014-05-16 18:26:38,126::task::974::TaskManager.Task::(_decref) Task=`b48461f3-466c-4922-b540-183b10d044cf`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:26:38,183::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:26:38,193::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582723 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:39,075::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:39,147::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03544 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:41,159::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:41,225::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301303 s, 34.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:43,237::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:43,309::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354708 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:45,321::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:45,394::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359466 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:47,406::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:47,474::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311918 s, 32.8 MB/s\n'; <rc> = 0 >Thread-56132::DEBUG::2014-05-16 18:26:48,184::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56132::DEBUG::2014-05-16 18:26:48,185::task::579::TaskManager.Task::(_updateState) Task=`5da2bb42-7725-4fe9-b1f1-5e705b268eba`::moving from state init -> state preparing >Thread-56132::INFO::2014-05-16 18:26:48,186::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56132::INFO::2014-05-16 18:26:48,186::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56132::DEBUG::2014-05-16 18:26:48,186::task::1168::TaskManager.Task::(prepare) Task=`5da2bb42-7725-4fe9-b1f1-5e705b268eba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56132::DEBUG::2014-05-16 18:26:48,186::task::579::TaskManager.Task::(_updateState) Task=`5da2bb42-7725-4fe9-b1f1-5e705b268eba`::moving from state preparing -> state finished >Thread-56132::DEBUG::2014-05-16 18:26:48,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56132::DEBUG::2014-05-16 18:26:48,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56132::DEBUG::2014-05-16 18:26:48,187::task::974::TaskManager.Task::(_decref) Task=`5da2bb42-7725-4fe9-b1f1-5e705b268eba`::ref 0 aborting False >Thread-56133::DEBUG::2014-05-16 18:26:48,196::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56133::DEBUG::2014-05-16 18:26:48,196::task::579::TaskManager.Task::(_updateState) Task=`43677fc4-cf2e-4522-8acc-d7edac1f1e2c`::moving from state init -> state preparing >Thread-56133::INFO::2014-05-16 18:26:48,196::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56133::DEBUG::2014-05-16 18:26:48,196::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6e4deede-19b3-4f96-9878-e0be82e85140`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56133::DEBUG::2014-05-16 18:26:48,197::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56133::DEBUG::2014-05-16 18:26:48,197::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56133::DEBUG::2014-05-16 18:26:48,197::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6e4deede-19b3-4f96-9878-e0be82e85140`::Granted request >Thread-56133::DEBUG::2014-05-16 18:26:48,197::task::811::TaskManager.Task::(resourceAcquired) Task=`43677fc4-cf2e-4522-8acc-d7edac1f1e2c`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56133::DEBUG::2014-05-16 18:26:48,197::task::974::TaskManager.Task::(_decref) Task=`43677fc4-cf2e-4522-8acc-d7edac1f1e2c`::ref 1 aborting False >Thread-56133::INFO::2014-05-16 18:26:48,198::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56133::DEBUG::2014-05-16 18:26:48,198::task::1168::TaskManager.Task::(prepare) Task=`43677fc4-cf2e-4522-8acc-d7edac1f1e2c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56133::DEBUG::2014-05-16 18:26:48,198::task::579::TaskManager.Task::(_updateState) Task=`43677fc4-cf2e-4522-8acc-d7edac1f1e2c`::moving from state preparing -> state finished >Thread-56133::DEBUG::2014-05-16 18:26:48,199::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56133::DEBUG::2014-05-16 18:26:48,199::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56133::DEBUG::2014-05-16 18:26:48,199::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56133::DEBUG::2014-05-16 18:26:48,199::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56133::DEBUG::2014-05-16 18:26:48,199::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56133::DEBUG::2014-05-16 18:26:48,199::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56133::DEBUG::2014-05-16 18:26:48,200::task::974::TaskManager.Task::(_decref) Task=`43677fc4-cf2e-4522-8acc-d7edac1f1e2c`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:26:48,212::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 18:26:48,212::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:26:48,230::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:26:48,238::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000806798 s, 2.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:26:48,239::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000806798 s, 2.5 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 18:26:48,239::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 18:26:48,239::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 18:26:48,239::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:26:48,239::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:26:48,240::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:26:48,240::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:26:48,240::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:26:48,241::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:26:48,241::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:26:48,408::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:26:48,409::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:26:48,410::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 18:26:48,411::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 18:26:48,411::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 18:26:48,412::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 18:26:48,412::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:26:48,557::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:26:48,577::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:26:48,587::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000544236 s, 7.5 MB/s\n'; <rc> = 0 >Thread-56134::DEBUG::2014-05-16 18:26:48,895::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4311507.000000 / 8.008359 / 262500000.000000 = 0.205096 >Thread-56134::DEBUG::2014-05-16 18:26:48,895::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0050929640800643052, 'statsAge': 1.9775090217590332, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20509555295847168, 'rxDropped': 0} >Thread-56134::DEBUG::2014-05-16 18:26:48,895::task::579::TaskManager.Task::(_updateState) Task=`71ce10c1-5c1f-4506-ae37-7dbe8a9a0ae9`::moving from state init -> state preparing >Thread-56134::INFO::2014-05-16 18:26:48,896::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56134::INFO::2014-05-16 18:26:48,896::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544236', 'lastCheck': '0.3', 'valid': True}} >Thread-56134::DEBUG::2014-05-16 18:26:48,896::task::1168::TaskManager.Task::(prepare) Task=`71ce10c1-5c1f-4506-ae37-7dbe8a9a0ae9`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544236', 'lastCheck': '0.3', 'valid': True}} >Thread-56134::DEBUG::2014-05-16 18:26:48,896::task::579::TaskManager.Task::(_updateState) Task=`71ce10c1-5c1f-4506-ae37-7dbe8a9a0ae9`::moving from state preparing -> state finished >Thread-56134::DEBUG::2014-05-16 18:26:48,896::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56134::DEBUG::2014-05-16 18:26:48,896::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56134::DEBUG::2014-05-16 18:26:48,897::task::974::TaskManager.Task::(_decref) Task=`71ce10c1-5c1f-4506-ae37-7dbe8a9a0ae9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:26:49,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:49,558::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356665 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:51,570::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:51,635::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299199 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:53,647::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:53,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305168 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:55,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:55,794::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322536 s, 31.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:57,806::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:57,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035193 s, 29.1 MB/s\n'; <rc> = 0 >Thread-56139::DEBUG::2014-05-16 18:26:58,274::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56139::DEBUG::2014-05-16 18:26:58,275::task::579::TaskManager.Task::(_updateState) Task=`99ebedfc-35a1-4b64-9a60-14c67398cba8`::moving from state init -> state preparing >Thread-56139::INFO::2014-05-16 18:26:58,275::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56139::INFO::2014-05-16 18:26:58,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56139::DEBUG::2014-05-16 18:26:58,275::task::1168::TaskManager.Task::(prepare) Task=`99ebedfc-35a1-4b64-9a60-14c67398cba8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56139::DEBUG::2014-05-16 18:26:58,276::task::579::TaskManager.Task::(_updateState) Task=`99ebedfc-35a1-4b64-9a60-14c67398cba8`::moving from state preparing -> state finished >Thread-56139::DEBUG::2014-05-16 18:26:58,276::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56139::DEBUG::2014-05-16 18:26:58,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56139::DEBUG::2014-05-16 18:26:58,276::task::974::TaskManager.Task::(_decref) Task=`99ebedfc-35a1-4b64-9a60-14c67398cba8`::ref 0 aborting False >Thread-56140::DEBUG::2014-05-16 18:26:58,320::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56140::DEBUG::2014-05-16 18:26:58,321::task::579::TaskManager.Task::(_updateState) Task=`c06d0718-1521-477d-9b4f-f74f996dac31`::moving from state init -> state preparing >Thread-56140::INFO::2014-05-16 18:26:58,321::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56140::DEBUG::2014-05-16 18:26:58,321::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`add203f7-f45a-4109-a045-28f20fd1217a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56140::DEBUG::2014-05-16 18:26:58,321::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56140::DEBUG::2014-05-16 18:26:58,322::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56140::DEBUG::2014-05-16 18:26:58,322::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`add203f7-f45a-4109-a045-28f20fd1217a`::Granted request >Thread-56140::DEBUG::2014-05-16 18:26:58,322::task::811::TaskManager.Task::(resourceAcquired) Task=`c06d0718-1521-477d-9b4f-f74f996dac31`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56140::DEBUG::2014-05-16 18:26:58,322::task::974::TaskManager.Task::(_decref) Task=`c06d0718-1521-477d-9b4f-f74f996dac31`::ref 1 aborting False >Thread-56140::INFO::2014-05-16 18:26:58,323::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56140::DEBUG::2014-05-16 18:26:58,323::task::1168::TaskManager.Task::(prepare) Task=`c06d0718-1521-477d-9b4f-f74f996dac31`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56140::DEBUG::2014-05-16 18:26:58,323::task::579::TaskManager.Task::(_updateState) Task=`c06d0718-1521-477d-9b4f-f74f996dac31`::moving from state preparing -> state finished >Thread-56140::DEBUG::2014-05-16 18:26:58,323::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56140::DEBUG::2014-05-16 18:26:58,324::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56140::DEBUG::2014-05-16 18:26:58,324::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56140::DEBUG::2014-05-16 18:26:58,324::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56140::DEBUG::2014-05-16 18:26:58,324::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56140::DEBUG::2014-05-16 18:26:58,324::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56140::DEBUG::2014-05-16 18:26:58,324::task::974::TaskManager.Task::(_decref) Task=`c06d0718-1521-477d-9b4f-f74f996dac31`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:26:58,624::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:26:58,634::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000823018 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:26:59,888::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:26:59,960::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355081 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:01,971::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:02,040::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314429 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:04,052::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:04,123::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350414 s, 29.2 MB/s\n'; <rc> = 0 >Thread-56142::DEBUG::2014-05-16 18:27:04,469::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4321351.000000 / 8.008446 / 262500000.000000 = 0.205562 >Thread-56142::DEBUG::2014-05-16 18:27:04,469::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053775607501537204, 'statsAge': 1.5350649356842041, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20556159795164469, 'rxDropped': 0} >Thread-56142::DEBUG::2014-05-16 18:27:04,470::task::579::TaskManager.Task::(_updateState) Task=`c10faea7-98b9-4e35-97c2-39c819660f7a`::moving from state init -> state preparing >Thread-56142::INFO::2014-05-16 18:27:04,470::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56142::INFO::2014-05-16 18:27:04,470::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823018', 'lastCheck': '5.8', 'valid': True}} >Thread-56142::DEBUG::2014-05-16 18:27:04,470::task::1168::TaskManager.Task::(prepare) Task=`c10faea7-98b9-4e35-97c2-39c819660f7a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823018', 'lastCheck': '5.8', 'valid': True}} >Thread-56142::DEBUG::2014-05-16 18:27:04,471::task::579::TaskManager.Task::(_updateState) Task=`c10faea7-98b9-4e35-97c2-39c819660f7a`::moving from state preparing -> state finished >Thread-56142::DEBUG::2014-05-16 18:27:04,471::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56142::DEBUG::2014-05-16 18:27:04,471::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56142::DEBUG::2014-05-16 18:27:04,471::task::974::TaskManager.Task::(_decref) Task=`c10faea7-98b9-4e35-97c2-39c819660f7a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:27:06,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:06,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308584 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:08,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:08,280::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305926 s, 33.5 MB/s\n'; <rc> = 0 >Thread-56145::DEBUG::2014-05-16 18:27:08,402::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56145::DEBUG::2014-05-16 18:27:08,403::task::579::TaskManager.Task::(_updateState) Task=`2bdebb31-04f7-4f29-99dc-23d574c15bbc`::moving from state init -> state preparing >Thread-56145::INFO::2014-05-16 18:27:08,403::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56145::INFO::2014-05-16 18:27:08,403::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56145::DEBUG::2014-05-16 18:27:08,403::task::1168::TaskManager.Task::(prepare) Task=`2bdebb31-04f7-4f29-99dc-23d574c15bbc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56145::DEBUG::2014-05-16 18:27:08,404::task::579::TaskManager.Task::(_updateState) Task=`2bdebb31-04f7-4f29-99dc-23d574c15bbc`::moving from state preparing -> state finished >Thread-56145::DEBUG::2014-05-16 18:27:08,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56145::DEBUG::2014-05-16 18:27:08,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56145::DEBUG::2014-05-16 18:27:08,404::task::974::TaskManager.Task::(_decref) Task=`2bdebb31-04f7-4f29-99dc-23d574c15bbc`::ref 0 aborting False >Thread-56146::DEBUG::2014-05-16 18:27:08,412::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56146::DEBUG::2014-05-16 18:27:08,412::task::579::TaskManager.Task::(_updateState) Task=`e1035e82-5608-4ef3-96c9-0acda6757899`::moving from state init -> state preparing >Thread-56146::INFO::2014-05-16 18:27:08,413::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56146::DEBUG::2014-05-16 18:27:08,413::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`57690fef-520f-4e14-9c86-b02f75d9d6f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56146::DEBUG::2014-05-16 18:27:08,413::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56146::DEBUG::2014-05-16 18:27:08,413::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56146::DEBUG::2014-05-16 18:27:08,414::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`57690fef-520f-4e14-9c86-b02f75d9d6f0`::Granted request >Thread-56146::DEBUG::2014-05-16 18:27:08,414::task::811::TaskManager.Task::(resourceAcquired) Task=`e1035e82-5608-4ef3-96c9-0acda6757899`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56146::DEBUG::2014-05-16 18:27:08,414::task::974::TaskManager.Task::(_decref) Task=`e1035e82-5608-4ef3-96c9-0acda6757899`::ref 1 aborting False >Thread-56146::INFO::2014-05-16 18:27:08,415::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56146::DEBUG::2014-05-16 18:27:08,415::task::1168::TaskManager.Task::(prepare) Task=`e1035e82-5608-4ef3-96c9-0acda6757899`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56146::DEBUG::2014-05-16 18:27:08,415::task::579::TaskManager.Task::(_updateState) Task=`e1035e82-5608-4ef3-96c9-0acda6757899`::moving from state preparing -> state finished >Thread-56146::DEBUG::2014-05-16 18:27:08,415::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56146::DEBUG::2014-05-16 18:27:08,415::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56146::DEBUG::2014-05-16 18:27:08,416::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56146::DEBUG::2014-05-16 18:27:08,416::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56146::DEBUG::2014-05-16 18:27:08,416::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56146::DEBUG::2014-05-16 18:27:08,416::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56146::DEBUG::2014-05-16 18:27:08,416::task::974::TaskManager.Task::(_decref) Task=`e1035e82-5608-4ef3-96c9-0acda6757899`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:27:08,672::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:27:08,682::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000803366 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:10,291::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:10,363::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352754 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:12,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:12,440::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298019 s, 34.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:14,451::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:14,519::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311943 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:16,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:16,602::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034956 s, 29.3 MB/s\n'; <rc> = 0 >Thread-56150::DEBUG::2014-05-16 18:27:18,526::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56150::DEBUG::2014-05-16 18:27:18,527::task::579::TaskManager.Task::(_updateState) Task=`fc5b26ce-821a-4fa8-a153-0b171726b6c9`::moving from state init -> state preparing >Thread-56150::INFO::2014-05-16 18:27:18,527::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56150::INFO::2014-05-16 18:27:18,527::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56150::DEBUG::2014-05-16 18:27:18,527::task::1168::TaskManager.Task::(prepare) Task=`fc5b26ce-821a-4fa8-a153-0b171726b6c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56150::DEBUG::2014-05-16 18:27:18,528::task::579::TaskManager.Task::(_updateState) Task=`fc5b26ce-821a-4fa8-a153-0b171726b6c9`::moving from state preparing -> state finished >Thread-56150::DEBUG::2014-05-16 18:27:18,528::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56150::DEBUG::2014-05-16 18:27:18,528::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56150::DEBUG::2014-05-16 18:27:18,528::task::974::TaskManager.Task::(_decref) Task=`fc5b26ce-821a-4fa8-a153-0b171726b6c9`::ref 0 aborting False >Thread-56151::DEBUG::2014-05-16 18:27:18,536::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56151::DEBUG::2014-05-16 18:27:18,536::task::579::TaskManager.Task::(_updateState) Task=`299fcc03-1ecf-4cd4-a2ad-93eb656fb3e5`::moving from state init -> state preparing >Thread-56151::INFO::2014-05-16 18:27:18,537::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56151::DEBUG::2014-05-16 18:27:18,537::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0d06c818-e2fc-4571-942d-dd8783a8dc75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56151::DEBUG::2014-05-16 18:27:18,537::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56151::DEBUG::2014-05-16 18:27:18,537::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56151::DEBUG::2014-05-16 18:27:18,537::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0d06c818-e2fc-4571-942d-dd8783a8dc75`::Granted request >Thread-56151::DEBUG::2014-05-16 18:27:18,538::task::811::TaskManager.Task::(resourceAcquired) Task=`299fcc03-1ecf-4cd4-a2ad-93eb656fb3e5`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56151::DEBUG::2014-05-16 18:27:18,538::task::974::TaskManager.Task::(_decref) Task=`299fcc03-1ecf-4cd4-a2ad-93eb656fb3e5`::ref 1 aborting False >Thread-56151::INFO::2014-05-16 18:27:18,538::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56151::DEBUG::2014-05-16 18:27:18,539::task::1168::TaskManager.Task::(prepare) Task=`299fcc03-1ecf-4cd4-a2ad-93eb656fb3e5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56151::DEBUG::2014-05-16 18:27:18,539::task::579::TaskManager.Task::(_updateState) Task=`299fcc03-1ecf-4cd4-a2ad-93eb656fb3e5`::moving from state preparing -> state finished >Thread-56151::DEBUG::2014-05-16 18:27:18,539::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56151::DEBUG::2014-05-16 18:27:18,539::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56151::DEBUG::2014-05-16 18:27:18,539::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56151::DEBUG::2014-05-16 18:27:18,539::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56151::DEBUG::2014-05-16 18:27:18,539::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56151::DEBUG::2014-05-16 18:27:18,540::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56151::DEBUG::2014-05-16 18:27:18,540::task::974::TaskManager.Task::(_decref) Task=`299fcc03-1ecf-4cd4-a2ad-93eb656fb3e5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:27:18,613::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:18,680::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310714 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:27:18,720::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:27:18,730::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000814771 s, 5.0 MB/s\n'; <rc> = 0 >Thread-56152::DEBUG::2014-05-16 18:27:20,659::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5419764.000000 / 8.008441 / 262500000.000000 = 0.257812 >Thread-56152::DEBUG::2014-05-16 18:27:20,659::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066604961773272017, 'statsAge': 1.7080180644989014, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25781197706020353, 'rxDropped': 0} >Thread-56152::DEBUG::2014-05-16 18:27:20,660::task::579::TaskManager.Task::(_updateState) Task=`9dedc7a7-8102-46b5-a70c-b2ba238f5789`::moving from state init -> state preparing >Thread-56152::INFO::2014-05-16 18:27:20,660::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56152::INFO::2014-05-16 18:27:20,660::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814771', 'lastCheck': '1.9', 'valid': True}} >Thread-56152::DEBUG::2014-05-16 18:27:20,660::task::1168::TaskManager.Task::(prepare) Task=`9dedc7a7-8102-46b5-a70c-b2ba238f5789`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814771', 'lastCheck': '1.9', 'valid': True}} >Thread-56152::DEBUG::2014-05-16 18:27:20,660::task::579::TaskManager.Task::(_updateState) Task=`9dedc7a7-8102-46b5-a70c-b2ba238f5789`::moving from state preparing -> state finished >Thread-56152::DEBUG::2014-05-16 18:27:20,661::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56152::DEBUG::2014-05-16 18:27:20,661::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56152::DEBUG::2014-05-16 18:27:20,661::task::974::TaskManager.Task::(_decref) Task=`9dedc7a7-8102-46b5-a70c-b2ba238f5789`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:27:20,692::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:20,760::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310842 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:22,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:22,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312361 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:24,851::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:24,922::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035633 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:26,934::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:27,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342014 s, 29.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:27:28,769::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:27:28,780::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101696 s, 4.0 MB/s\n'; <rc> = 0 >Thread-56155::DEBUG::2014-05-16 18:27:28,845::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56155::DEBUG::2014-05-16 18:27:28,845::task::579::TaskManager.Task::(_updateState) Task=`0bb60936-8f4d-48b9-a6b9-7b03bb7afb94`::moving from state init -> state preparing >Thread-56155::INFO::2014-05-16 18:27:28,846::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56155::INFO::2014-05-16 18:27:28,846::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56155::DEBUG::2014-05-16 18:27:28,846::task::1168::TaskManager.Task::(prepare) Task=`0bb60936-8f4d-48b9-a6b9-7b03bb7afb94`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56155::DEBUG::2014-05-16 18:27:28,846::task::579::TaskManager.Task::(_updateState) Task=`0bb60936-8f4d-48b9-a6b9-7b03bb7afb94`::moving from state preparing -> state finished >Thread-56155::DEBUG::2014-05-16 18:27:28,846::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56155::DEBUG::2014-05-16 18:27:28,846::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56155::DEBUG::2014-05-16 18:27:28,847::task::974::TaskManager.Task::(_decref) Task=`0bb60936-8f4d-48b9-a6b9-7b03bb7afb94`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:27:29,015::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-56156::DEBUG::2014-05-16 18:27:29,032::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56156::DEBUG::2014-05-16 18:27:29,032::task::579::TaskManager.Task::(_updateState) Task=`dfa0b0ab-71d2-4c9e-b1bb-f439b20c652c`::moving from state init -> state preparing >Thread-56156::INFO::2014-05-16 18:27:29,032::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56156::DEBUG::2014-05-16 18:27:29,033::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9bfdb1c5-5698-486b-b591-3e4243d7f8d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56156::DEBUG::2014-05-16 18:27:29,033::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56156::DEBUG::2014-05-16 18:27:29,033::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56156::DEBUG::2014-05-16 18:27:29,033::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9bfdb1c5-5698-486b-b591-3e4243d7f8d9`::Granted request >Thread-56156::DEBUG::2014-05-16 18:27:29,034::task::811::TaskManager.Task::(resourceAcquired) Task=`dfa0b0ab-71d2-4c9e-b1bb-f439b20c652c`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56156::DEBUG::2014-05-16 18:27:29,034::task::974::TaskManager.Task::(_decref) Task=`dfa0b0ab-71d2-4c9e-b1bb-f439b20c652c`::ref 1 aborting False >Thread-56156::INFO::2014-05-16 18:27:29,035::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56156::DEBUG::2014-05-16 18:27:29,035::task::1168::TaskManager.Task::(prepare) Task=`dfa0b0ab-71d2-4c9e-b1bb-f439b20c652c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56156::DEBUG::2014-05-16 18:27:29,035::task::579::TaskManager.Task::(_updateState) Task=`dfa0b0ab-71d2-4c9e-b1bb-f439b20c652c`::moving from state preparing -> state finished >Thread-56156::DEBUG::2014-05-16 18:27:29,036::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56156::DEBUG::2014-05-16 18:27:29,036::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56156::DEBUG::2014-05-16 18:27:29,036::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56156::DEBUG::2014-05-16 18:27:29,036::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56156::DEBUG::2014-05-16 18:27:29,037::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56156::DEBUG::2014-05-16 18:27:29,037::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56156::DEBUG::2014-05-16 18:27:29,037::task::974::TaskManager.Task::(_decref) Task=`dfa0b0ab-71d2-4c9e-b1bb-f439b20c652c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:27:29,087::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357553 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:31,099::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:31,170::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352276 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:33,182::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:33,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304992 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:35,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:35,328::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314532 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:37,339::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:37,410::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350921 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:27:38,810::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:27:38,821::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106866 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:39,422::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:39,494::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363418 s, 28.2 MB/s\n'; <rc> = 0 >Thread-56160::DEBUG::2014-05-16 18:27:39,765::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56160::DEBUG::2014-05-16 18:27:39,767::task::579::TaskManager.Task::(_updateState) Task=`e7389515-d19c-4e8a-857e-8d5864cc036a`::moving from state init -> state preparing >Thread-56160::INFO::2014-05-16 18:27:39,767::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56160::INFO::2014-05-16 18:27:39,768::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56160::DEBUG::2014-05-16 18:27:39,768::task::1168::TaskManager.Task::(prepare) Task=`e7389515-d19c-4e8a-857e-8d5864cc036a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56160::DEBUG::2014-05-16 18:27:39,768::task::579::TaskManager.Task::(_updateState) Task=`e7389515-d19c-4e8a-857e-8d5864cc036a`::moving from state preparing -> state finished >Thread-56160::DEBUG::2014-05-16 18:27:39,768::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56160::DEBUG::2014-05-16 18:27:39,768::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56160::DEBUG::2014-05-16 18:27:39,768::task::974::TaskManager.Task::(_decref) Task=`e7389515-d19c-4e8a-857e-8d5864cc036a`::ref 0 aborting False >Thread-56161::DEBUG::2014-05-16 18:27:40,269::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56161::DEBUG::2014-05-16 18:27:40,269::task::579::TaskManager.Task::(_updateState) Task=`c1fa5abe-343c-4838-afb0-c47cf395b700`::moving from state init -> state preparing >Thread-56161::INFO::2014-05-16 18:27:40,270::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56161::DEBUG::2014-05-16 18:27:40,270::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`06c898b1-7c36-4bce-8a35-1597f53c78d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56161::DEBUG::2014-05-16 18:27:40,270::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56161::DEBUG::2014-05-16 18:27:40,270::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56161::DEBUG::2014-05-16 18:27:40,271::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`06c898b1-7c36-4bce-8a35-1597f53c78d3`::Granted request >Thread-56161::DEBUG::2014-05-16 18:27:40,271::task::811::TaskManager.Task::(resourceAcquired) Task=`c1fa5abe-343c-4838-afb0-c47cf395b700`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56161::DEBUG::2014-05-16 18:27:40,271::task::974::TaskManager.Task::(_decref) Task=`c1fa5abe-343c-4838-afb0-c47cf395b700`::ref 1 aborting False >Thread-56161::INFO::2014-05-16 18:27:40,272::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56161::DEBUG::2014-05-16 18:27:40,272::task::1168::TaskManager.Task::(prepare) Task=`c1fa5abe-343c-4838-afb0-c47cf395b700`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56161::DEBUG::2014-05-16 18:27:40,272::task::579::TaskManager.Task::(_updateState) Task=`c1fa5abe-343c-4838-afb0-c47cf395b700`::moving from state preparing -> state finished >Thread-56161::DEBUG::2014-05-16 18:27:40,272::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56161::DEBUG::2014-05-16 18:27:40,272::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56161::DEBUG::2014-05-16 18:27:40,273::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56161::DEBUG::2014-05-16 18:27:40,273::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56161::DEBUG::2014-05-16 18:27:40,273::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56161::DEBUG::2014-05-16 18:27:40,273::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56161::DEBUG::2014-05-16 18:27:40,273::task::974::TaskManager.Task::(_decref) Task=`c1fa5abe-343c-4838-afb0-c47cf395b700`::ref 0 aborting False >Thread-56162::DEBUG::2014-05-16 18:27:41,044::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319155.000000 / 8.008346 / 262500000.000000 = 0.205460 >Thread-56162::DEBUG::2014-05-16 18:27:41,044::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052908612080012143, 'statsAge': 0.067918062210083008, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20545969971269226, 'rxDropped': 0} >Thread-56162::DEBUG::2014-05-16 18:27:41,044::task::579::TaskManager.Task::(_updateState) Task=`aec86f6b-3e73-4d2f-8be2-a1ccf2b92221`::moving from state init -> state preparing >Thread-56162::INFO::2014-05-16 18:27:41,044::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56162::INFO::2014-05-16 18:27:41,044::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106866', 'lastCheck': '2.2', 'valid': True}} >Thread-56162::DEBUG::2014-05-16 18:27:41,044::task::1168::TaskManager.Task::(prepare) Task=`aec86f6b-3e73-4d2f-8be2-a1ccf2b92221`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106866', 'lastCheck': '2.2', 'valid': True}} >Thread-56162::DEBUG::2014-05-16 18:27:41,045::task::579::TaskManager.Task::(_updateState) Task=`aec86f6b-3e73-4d2f-8be2-a1ccf2b92221`::moving from state preparing -> state finished >Thread-56162::DEBUG::2014-05-16 18:27:41,045::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56162::DEBUG::2014-05-16 18:27:41,045::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56162::DEBUG::2014-05-16 18:27:41,045::task::974::TaskManager.Task::(_decref) Task=`aec86f6b-3e73-4d2f-8be2-a1ccf2b92221`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:27:41,505::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:41,573::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310226 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:43,585::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:43,657::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351141 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:45,669::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:45,740::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353992 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:47,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:47,819::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314898 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:27:48,858::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:27:48,868::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000807861 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:49,831::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:49,897::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310936 s, 32.9 MB/s\n'; <rc> = 0 >Thread-56166::DEBUG::2014-05-16 18:27:50,837::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56166::DEBUG::2014-05-16 18:27:50,838::task::579::TaskManager.Task::(_updateState) Task=`e7381497-4889-466c-bd65-d36f0f52d76e`::moving from state init -> state preparing >Thread-56166::INFO::2014-05-16 18:27:50,838::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56166::INFO::2014-05-16 18:27:50,838::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56166::DEBUG::2014-05-16 18:27:50,839::task::1168::TaskManager.Task::(prepare) Task=`e7381497-4889-466c-bd65-d36f0f52d76e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56166::DEBUG::2014-05-16 18:27:50,839::task::579::TaskManager.Task::(_updateState) Task=`e7381497-4889-466c-bd65-d36f0f52d76e`::moving from state preparing -> state finished >Thread-56166::DEBUG::2014-05-16 18:27:50,839::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56166::DEBUG::2014-05-16 18:27:50,839::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56166::DEBUG::2014-05-16 18:27:50,839::task::974::TaskManager.Task::(_decref) Task=`e7381497-4889-466c-bd65-d36f0f52d76e`::ref 0 aborting False >Thread-56167::DEBUG::2014-05-16 18:27:50,866::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56167::DEBUG::2014-05-16 18:27:50,866::task::579::TaskManager.Task::(_updateState) Task=`5039bc5a-6515-4065-8837-d1a4ff2d06df`::moving from state init -> state preparing >Thread-56167::INFO::2014-05-16 18:27:50,866::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56167::DEBUG::2014-05-16 18:27:50,866::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e22e68a1-16bb-49b8-9601-444269c88651`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56167::DEBUG::2014-05-16 18:27:50,867::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56167::DEBUG::2014-05-16 18:27:50,867::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56167::DEBUG::2014-05-16 18:27:50,867::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`e22e68a1-16bb-49b8-9601-444269c88651`::Granted request >Thread-56167::DEBUG::2014-05-16 18:27:50,867::task::811::TaskManager.Task::(resourceAcquired) Task=`5039bc5a-6515-4065-8837-d1a4ff2d06df`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56167::DEBUG::2014-05-16 18:27:50,868::task::974::TaskManager.Task::(_decref) Task=`5039bc5a-6515-4065-8837-d1a4ff2d06df`::ref 1 aborting False >Thread-56167::INFO::2014-05-16 18:27:50,868::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56167::DEBUG::2014-05-16 18:27:50,868::task::1168::TaskManager.Task::(prepare) Task=`5039bc5a-6515-4065-8837-d1a4ff2d06df`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56167::DEBUG::2014-05-16 18:27:50,869::task::579::TaskManager.Task::(_updateState) Task=`5039bc5a-6515-4065-8837-d1a4ff2d06df`::moving from state preparing -> state finished >Thread-56167::DEBUG::2014-05-16 18:27:50,869::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56167::DEBUG::2014-05-16 18:27:50,869::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56167::DEBUG::2014-05-16 18:27:50,869::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56167::DEBUG::2014-05-16 18:27:50,869::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56167::DEBUG::2014-05-16 18:27:50,869::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56167::DEBUG::2014-05-16 18:27:50,870::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56167::DEBUG::2014-05-16 18:27:50,870::task::974::TaskManager.Task::(_decref) Task=`5039bc5a-6515-4065-8837-d1a4ff2d06df`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:27:51,909::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:52,034::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0875125 s, 11.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:54,045::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:54,113::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311595 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:27:56,124::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:56,193::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315569 s, 32.4 MB/s\n'; <rc> = 0 >Thread-56170::DEBUG::2014-05-16 18:27:57,807::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5411684.000000 / 8.008465 / 262500000.000000 = 0.257427 >Thread-56170::DEBUG::2014-05-16 18:27:57,807::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0065537319567266035, 'statsAge': 0.81470203399658203, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25742684665108112, 'rxDropped': 0} >Thread-56170::DEBUG::2014-05-16 18:27:57,808::task::579::TaskManager.Task::(_updateState) Task=`a2002ccb-7a63-4394-bf88-ae15b0d16ebc`::moving from state init -> state preparing >Thread-56170::INFO::2014-05-16 18:27:57,808::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56170::INFO::2014-05-16 18:27:57,809::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807861', 'lastCheck': '8.9', 'valid': True}} >Thread-56170::DEBUG::2014-05-16 18:27:57,809::task::1168::TaskManager.Task::(prepare) Task=`a2002ccb-7a63-4394-bf88-ae15b0d16ebc`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807861', 'lastCheck': '8.9', 'valid': True}} >Thread-56170::DEBUG::2014-05-16 18:27:57,809::task::579::TaskManager.Task::(_updateState) Task=`a2002ccb-7a63-4394-bf88-ae15b0d16ebc`::moving from state preparing -> state finished >Thread-56170::DEBUG::2014-05-16 18:27:57,809::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56170::DEBUG::2014-05-16 18:27:57,809::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56170::DEBUG::2014-05-16 18:27:57,809::task::974::TaskManager.Task::(_decref) Task=`a2002ccb-7a63-4394-bf88-ae15b0d16ebc`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:27:58,205::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:27:58,276::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349176 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:27:58,902::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:27:58,913::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000803496 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:00,288::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:00,359::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355394 s, 28.8 MB/s\n'; <rc> = 0 >Thread-56172::DEBUG::2014-05-16 18:28:00,954::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56172::DEBUG::2014-05-16 18:28:00,954::task::579::TaskManager.Task::(_updateState) Task=`722f810d-4a3d-4398-bd6e-5e606cb0c42d`::moving from state init -> state preparing >Thread-56172::INFO::2014-05-16 18:28:00,955::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56172::INFO::2014-05-16 18:28:00,955::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56172::DEBUG::2014-05-16 18:28:00,955::task::1168::TaskManager.Task::(prepare) Task=`722f810d-4a3d-4398-bd6e-5e606cb0c42d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56172::DEBUG::2014-05-16 18:28:00,955::task::579::TaskManager.Task::(_updateState) Task=`722f810d-4a3d-4398-bd6e-5e606cb0c42d`::moving from state preparing -> state finished >Thread-56172::DEBUG::2014-05-16 18:28:00,955::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56172::DEBUG::2014-05-16 18:28:00,955::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56172::DEBUG::2014-05-16 18:28:00,956::task::974::TaskManager.Task::(_decref) Task=`722f810d-4a3d-4398-bd6e-5e606cb0c42d`::ref 0 aborting False >Thread-56173::DEBUG::2014-05-16 18:28:00,966::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56173::DEBUG::2014-05-16 18:28:00,967::task::579::TaskManager.Task::(_updateState) Task=`0d9f57b6-8366-434e-9863-a297a026947e`::moving from state init -> state preparing >Thread-56173::INFO::2014-05-16 18:28:00,967::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56173::DEBUG::2014-05-16 18:28:00,967::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ae21f8fc-c54b-417d-b4e8-516a5b53fa94`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56173::DEBUG::2014-05-16 18:28:00,967::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56173::DEBUG::2014-05-16 18:28:00,968::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56173::DEBUG::2014-05-16 18:28:00,968::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ae21f8fc-c54b-417d-b4e8-516a5b53fa94`::Granted request >Thread-56173::DEBUG::2014-05-16 18:28:00,968::task::811::TaskManager.Task::(resourceAcquired) Task=`0d9f57b6-8366-434e-9863-a297a026947e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56173::DEBUG::2014-05-16 18:28:00,968::task::974::TaskManager.Task::(_decref) Task=`0d9f57b6-8366-434e-9863-a297a026947e`::ref 1 aborting False >Thread-56173::INFO::2014-05-16 18:28:00,969::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56173::DEBUG::2014-05-16 18:28:00,969::task::1168::TaskManager.Task::(prepare) Task=`0d9f57b6-8366-434e-9863-a297a026947e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56173::DEBUG::2014-05-16 18:28:00,969::task::579::TaskManager.Task::(_updateState) Task=`0d9f57b6-8366-434e-9863-a297a026947e`::moving from state preparing -> state finished >Thread-56173::DEBUG::2014-05-16 18:28:00,969::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56173::DEBUG::2014-05-16 18:28:00,970::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56173::DEBUG::2014-05-16 18:28:00,970::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56173::DEBUG::2014-05-16 18:28:00,970::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56173::DEBUG::2014-05-16 18:28:00,970::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56173::DEBUG::2014-05-16 18:28:00,970::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56173::DEBUG::2014-05-16 18:28:00,971::task::974::TaskManager.Task::(_decref) Task=`0d9f57b6-8366-434e-9863-a297a026947e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:28:02,371::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:02,438::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306336 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:04,450::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:04,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355147 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:06,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:06,601::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309584 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:08,612::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:08,679::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307598 s, 33.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:28:08,950::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:28:08,961::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000777327 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:10,690::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:10,762::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353206 s, 29.0 MB/s\n'; <rc> = 0 >Thread-56178::DEBUG::2014-05-16 18:28:11,033::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56178::DEBUG::2014-05-16 18:28:11,033::task::579::TaskManager.Task::(_updateState) Task=`5bc4469c-43db-4d52-8e12-d65c77e94abc`::moving from state init -> state preparing >Thread-56178::INFO::2014-05-16 18:28:11,034::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56178::INFO::2014-05-16 18:28:11,034::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56178::DEBUG::2014-05-16 18:28:11,034::task::1168::TaskManager.Task::(prepare) Task=`5bc4469c-43db-4d52-8e12-d65c77e94abc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56178::DEBUG::2014-05-16 18:28:11,034::task::579::TaskManager.Task::(_updateState) Task=`5bc4469c-43db-4d52-8e12-d65c77e94abc`::moving from state preparing -> state finished >Thread-56178::DEBUG::2014-05-16 18:28:11,034::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56178::DEBUG::2014-05-16 18:28:11,034::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56178::DEBUG::2014-05-16 18:28:11,034::task::974::TaskManager.Task::(_decref) Task=`5bc4469c-43db-4d52-8e12-d65c77e94abc`::ref 0 aborting False >Thread-56179::DEBUG::2014-05-16 18:28:11,063::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56179::DEBUG::2014-05-16 18:28:11,063::task::579::TaskManager.Task::(_updateState) Task=`8d5778cd-cc03-4a6e-8b1d-7c761c884fcd`::moving from state init -> state preparing >Thread-56179::INFO::2014-05-16 18:28:11,063::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56179::DEBUG::2014-05-16 18:28:11,063::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fbc1567c-ee7d-4fd5-bcd3-3c288545427a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56179::DEBUG::2014-05-16 18:28:11,064::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56179::DEBUG::2014-05-16 18:28:11,064::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56179::DEBUG::2014-05-16 18:28:11,064::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fbc1567c-ee7d-4fd5-bcd3-3c288545427a`::Granted request >Thread-56179::DEBUG::2014-05-16 18:28:11,064::task::811::TaskManager.Task::(resourceAcquired) Task=`8d5778cd-cc03-4a6e-8b1d-7c761c884fcd`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56179::DEBUG::2014-05-16 18:28:11,064::task::974::TaskManager.Task::(_decref) Task=`8d5778cd-cc03-4a6e-8b1d-7c761c884fcd`::ref 1 aborting False >Thread-56179::INFO::2014-05-16 18:28:11,065::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56179::DEBUG::2014-05-16 18:28:11,065::task::1168::TaskManager.Task::(prepare) Task=`8d5778cd-cc03-4a6e-8b1d-7c761c884fcd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56179::DEBUG::2014-05-16 18:28:11,065::task::579::TaskManager.Task::(_updateState) Task=`8d5778cd-cc03-4a6e-8b1d-7c761c884fcd`::moving from state preparing -> state finished >Thread-56179::DEBUG::2014-05-16 18:28:11,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56179::DEBUG::2014-05-16 18:28:11,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56179::DEBUG::2014-05-16 18:28:11,066::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56179::DEBUG::2014-05-16 18:28:11,066::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56179::DEBUG::2014-05-16 18:28:11,066::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56179::DEBUG::2014-05-16 18:28:11,066::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56179::DEBUG::2014-05-16 18:28:11,066::task::974::TaskManager.Task::(_decref) Task=`8d5778cd-cc03-4a6e-8b1d-7c761c884fcd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:28:12,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:12,841::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311082 s, 32.9 MB/s\n'; <rc> = 0 >Thread-56180::DEBUG::2014-05-16 18:28:13,364::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3241804.000000 / 8.008514 / 262500000.000000 = 0.154208 >Thread-56180::DEBUG::2014-05-16 18:28:13,364::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0040799436712286429, 'statsAge': 0.35461306571960449, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15420750510858924, 'rxDropped': 0} >Thread-56180::DEBUG::2014-05-16 18:28:13,365::task::579::TaskManager.Task::(_updateState) Task=`1efb4f82-9b94-4e8c-bad1-746ac27010a4`::moving from state init -> state preparing >Thread-56180::INFO::2014-05-16 18:28:13,365::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56180::INFO::2014-05-16 18:28:13,365::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777327', 'lastCheck': '4.4', 'valid': True}} >Thread-56180::DEBUG::2014-05-16 18:28:13,366::task::1168::TaskManager.Task::(prepare) Task=`1efb4f82-9b94-4e8c-bad1-746ac27010a4`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777327', 'lastCheck': '4.4', 'valid': True}} >Thread-56180::DEBUG::2014-05-16 18:28:13,366::task::579::TaskManager.Task::(_updateState) Task=`1efb4f82-9b94-4e8c-bad1-746ac27010a4`::moving from state preparing -> state finished >Thread-56180::DEBUG::2014-05-16 18:28:13,366::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56180::DEBUG::2014-05-16 18:28:13,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56180::DEBUG::2014-05-16 18:28:13,366::task::974::TaskManager.Task::(_decref) Task=`1efb4f82-9b94-4e8c-bad1-746ac27010a4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:28:14,853::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:14,925::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368205 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:16,937::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:17,003::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312742 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:28:18,997::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:28:19,008::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110417 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:19,018::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:19,138::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0837834 s, 12.2 MB/s\n'; <rc> = 0 >Thread-56184::DEBUG::2014-05-16 18:28:21,105::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56184::DEBUG::2014-05-16 18:28:21,105::task::579::TaskManager.Task::(_updateState) Task=`793f5aa3-8c5b-4684-a7d0-bca4caf9232c`::moving from state init -> state preparing >Thread-56184::INFO::2014-05-16 18:28:21,106::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56184::INFO::2014-05-16 18:28:21,106::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56184::DEBUG::2014-05-16 18:28:21,106::task::1168::TaskManager.Task::(prepare) Task=`793f5aa3-8c5b-4684-a7d0-bca4caf9232c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56184::DEBUG::2014-05-16 18:28:21,106::task::579::TaskManager.Task::(_updateState) Task=`793f5aa3-8c5b-4684-a7d0-bca4caf9232c`::moving from state preparing -> state finished >Thread-56184::DEBUG::2014-05-16 18:28:21,106::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56184::DEBUG::2014-05-16 18:28:21,106::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56184::DEBUG::2014-05-16 18:28:21,107::task::974::TaskManager.Task::(_decref) Task=`793f5aa3-8c5b-4684-a7d0-bca4caf9232c`::ref 0 aborting False >Thread-56185::DEBUG::2014-05-16 18:28:21,115::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56185::DEBUG::2014-05-16 18:28:21,116::task::579::TaskManager.Task::(_updateState) Task=`7664e068-aab1-438f-a323-d70ab096a4b3`::moving from state init -> state preparing >Thread-56185::INFO::2014-05-16 18:28:21,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56185::DEBUG::2014-05-16 18:28:21,116::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a773cede-7c50-4771-bbc4-63490ddf0c5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56185::DEBUG::2014-05-16 18:28:21,116::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56185::DEBUG::2014-05-16 18:28:21,116::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56185::DEBUG::2014-05-16 18:28:21,117::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a773cede-7c50-4771-bbc4-63490ddf0c5f`::Granted request >Thread-56185::DEBUG::2014-05-16 18:28:21,117::task::811::TaskManager.Task::(resourceAcquired) Task=`7664e068-aab1-438f-a323-d70ab096a4b3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56185::DEBUG::2014-05-16 18:28:21,117::task::974::TaskManager.Task::(_decref) Task=`7664e068-aab1-438f-a323-d70ab096a4b3`::ref 1 aborting False >Thread-56185::INFO::2014-05-16 18:28:21,118::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56185::DEBUG::2014-05-16 18:28:21,118::task::1168::TaskManager.Task::(prepare) Task=`7664e068-aab1-438f-a323-d70ab096a4b3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56185::DEBUG::2014-05-16 18:28:21,118::task::579::TaskManager.Task::(_updateState) Task=`7664e068-aab1-438f-a323-d70ab096a4b3`::moving from state preparing -> state finished >Thread-56185::DEBUG::2014-05-16 18:28:21,118::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56185::DEBUG::2014-05-16 18:28:21,118::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56185::DEBUG::2014-05-16 18:28:21,119::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56185::DEBUG::2014-05-16 18:28:21,119::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56185::DEBUG::2014-05-16 18:28:21,119::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56185::DEBUG::2014-05-16 18:28:21,119::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56185::DEBUG::2014-05-16 18:28:21,119::task::974::TaskManager.Task::(_decref) Task=`7664e068-aab1-438f-a323-d70ab096a4b3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:28:21,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:21,224::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364775 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:23,235::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:23,302::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306089 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:25,314::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:25,385::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354166 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:27,396::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:27,463::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311207 s, 32.9 MB/s\n'; <rc> = 0 >Thread-56188::DEBUG::2014-05-16 18:28:28,637::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4318612.000000 / 8.021843 / 262500000.000000 = 0.205088 >Thread-56188::DEBUG::2014-05-16 18:28:28,637::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053390414912098472, 'statsAge': 1.5993568897247314, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20508822383111328, 'rxDropped': 0} >Thread-56188::DEBUG::2014-05-16 18:28:28,639::task::579::TaskManager.Task::(_updateState) Task=`ced70cdc-50a9-4810-801e-0db27a47afb6`::moving from state init -> state preparing >Thread-56188::INFO::2014-05-16 18:28:28,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56188::INFO::2014-05-16 18:28:28,639::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110417', 'lastCheck': '9.5', 'valid': True}} >Thread-56188::DEBUG::2014-05-16 18:28:28,640::task::1168::TaskManager.Task::(prepare) Task=`ced70cdc-50a9-4810-801e-0db27a47afb6`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110417', 'lastCheck': '9.5', 'valid': True}} >Thread-56188::DEBUG::2014-05-16 18:28:28,640::task::579::TaskManager.Task::(_updateState) Task=`ced70cdc-50a9-4810-801e-0db27a47afb6`::moving from state preparing -> state finished >Thread-56188::DEBUG::2014-05-16 18:28:28,640::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56188::DEBUG::2014-05-16 18:28:28,640::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56188::DEBUG::2014-05-16 18:28:28,640::task::974::TaskManager.Task::(_decref) Task=`ced70cdc-50a9-4810-801e-0db27a47afb6`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:28:29,106::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:28:29,116::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000790138 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:29,475::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:29,548::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364904 s, 28.1 MB/s\n'; <rc> = 0 >Thread-56190::DEBUG::2014-05-16 18:28:31,160::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56190::DEBUG::2014-05-16 18:28:31,160::task::579::TaskManager.Task::(_updateState) Task=`705fbafb-cd05-4e0b-8886-18ce033f5dd5`::moving from state init -> state preparing >Thread-56190::INFO::2014-05-16 18:28:31,161::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56190::INFO::2014-05-16 18:28:31,161::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56190::DEBUG::2014-05-16 18:28:31,161::task::1168::TaskManager.Task::(prepare) Task=`705fbafb-cd05-4e0b-8886-18ce033f5dd5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56190::DEBUG::2014-05-16 18:28:31,161::task::579::TaskManager.Task::(_updateState) Task=`705fbafb-cd05-4e0b-8886-18ce033f5dd5`::moving from state preparing -> state finished >Thread-56190::DEBUG::2014-05-16 18:28:31,161::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56190::DEBUG::2014-05-16 18:28:31,162::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56190::DEBUG::2014-05-16 18:28:31,162::task::974::TaskManager.Task::(_decref) Task=`705fbafb-cd05-4e0b-8886-18ce033f5dd5`::ref 0 aborting False >Thread-56191::DEBUG::2014-05-16 18:28:31,170::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56191::DEBUG::2014-05-16 18:28:31,170::task::579::TaskManager.Task::(_updateState) Task=`be6bc950-e4d3-4e96-bb3d-bb05dfde521d`::moving from state init -> state preparing >Thread-56191::INFO::2014-05-16 18:28:31,171::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56191::DEBUG::2014-05-16 18:28:31,171::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fd85edd1-6a35-4829-9db9-f270f22f03d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56191::DEBUG::2014-05-16 18:28:31,171::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56191::DEBUG::2014-05-16 18:28:31,171::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56191::DEBUG::2014-05-16 18:28:31,172::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fd85edd1-6a35-4829-9db9-f270f22f03d4`::Granted request >Thread-56191::DEBUG::2014-05-16 18:28:31,172::task::811::TaskManager.Task::(resourceAcquired) Task=`be6bc950-e4d3-4e96-bb3d-bb05dfde521d`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56191::DEBUG::2014-05-16 18:28:31,172::task::974::TaskManager.Task::(_decref) Task=`be6bc950-e4d3-4e96-bb3d-bb05dfde521d`::ref 1 aborting False >Thread-56191::INFO::2014-05-16 18:28:31,173::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56191::DEBUG::2014-05-16 18:28:31,173::task::1168::TaskManager.Task::(prepare) Task=`be6bc950-e4d3-4e96-bb3d-bb05dfde521d`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56191::DEBUG::2014-05-16 18:28:31,173::task::579::TaskManager.Task::(_updateState) Task=`be6bc950-e4d3-4e96-bb3d-bb05dfde521d`::moving from state preparing -> state finished >Thread-56191::DEBUG::2014-05-16 18:28:31,173::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56191::DEBUG::2014-05-16 18:28:31,173::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56191::DEBUG::2014-05-16 18:28:31,174::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56191::DEBUG::2014-05-16 18:28:31,174::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56191::DEBUG::2014-05-16 18:28:31,174::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56191::DEBUG::2014-05-16 18:28:31,174::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56191::DEBUG::2014-05-16 18:28:31,174::task::974::TaskManager.Task::(_decref) Task=`be6bc950-e4d3-4e96-bb3d-bb05dfde521d`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:28:31,560::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:31,632::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354505 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:33,643::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:33,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347278 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:35,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:35,798::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353764 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:37,810::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:37,882::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343487 s, 29.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:28:39,149::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:28:39,160::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731973 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:39,889::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:39,970::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360388 s, 28.4 MB/s\n'; <rc> = 0 >Thread-56196::DEBUG::2014-05-16 18:28:41,202::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56196::DEBUG::2014-05-16 18:28:41,203::task::579::TaskManager.Task::(_updateState) Task=`dd8561d3-b8e1-4058-a11f-d8a88a230439`::moving from state init -> state preparing >Thread-56196::INFO::2014-05-16 18:28:41,203::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56196::INFO::2014-05-16 18:28:41,203::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56196::DEBUG::2014-05-16 18:28:41,204::task::1168::TaskManager.Task::(prepare) Task=`dd8561d3-b8e1-4058-a11f-d8a88a230439`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56196::DEBUG::2014-05-16 18:28:41,204::task::579::TaskManager.Task::(_updateState) Task=`dd8561d3-b8e1-4058-a11f-d8a88a230439`::moving from state preparing -> state finished >Thread-56196::DEBUG::2014-05-16 18:28:41,204::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56196::DEBUG::2014-05-16 18:28:41,204::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56196::DEBUG::2014-05-16 18:28:41,204::task::974::TaskManager.Task::(_decref) Task=`dd8561d3-b8e1-4058-a11f-d8a88a230439`::ref 0 aborting False >Thread-56197::DEBUG::2014-05-16 18:28:41,237::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56197::DEBUG::2014-05-16 18:28:41,237::task::579::TaskManager.Task::(_updateState) Task=`38b92777-7a25-449f-ae8b-3cdbcfb769c2`::moving from state init -> state preparing >Thread-56197::INFO::2014-05-16 18:28:41,237::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56197::DEBUG::2014-05-16 18:28:41,237::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9634b606-070a-49d2-9a76-4b8ed49c4ebc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56197::DEBUG::2014-05-16 18:28:41,238::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56197::DEBUG::2014-05-16 18:28:41,238::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56197::DEBUG::2014-05-16 18:28:41,238::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9634b606-070a-49d2-9a76-4b8ed49c4ebc`::Granted request >Thread-56197::DEBUG::2014-05-16 18:28:41,238::task::811::TaskManager.Task::(resourceAcquired) Task=`38b92777-7a25-449f-ae8b-3cdbcfb769c2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56197::DEBUG::2014-05-16 18:28:41,238::task::974::TaskManager.Task::(_decref) Task=`38b92777-7a25-449f-ae8b-3cdbcfb769c2`::ref 1 aborting False >Thread-56197::INFO::2014-05-16 18:28:41,239::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56197::DEBUG::2014-05-16 18:28:41,239::task::1168::TaskManager.Task::(prepare) Task=`38b92777-7a25-449f-ae8b-3cdbcfb769c2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56197::DEBUG::2014-05-16 18:28:41,239::task::579::TaskManager.Task::(_updateState) Task=`38b92777-7a25-449f-ae8b-3cdbcfb769c2`::moving from state preparing -> state finished >Thread-56197::DEBUG::2014-05-16 18:28:41,239::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56197::DEBUG::2014-05-16 18:28:41,239::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56197::DEBUG::2014-05-16 18:28:41,240::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56197::DEBUG::2014-05-16 18:28:41,240::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56197::DEBUG::2014-05-16 18:28:41,240::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56197::DEBUG::2014-05-16 18:28:41,240::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56197::DEBUG::2014-05-16 18:28:41,240::task::974::TaskManager.Task::(_decref) Task=`38b92777-7a25-449f-ae8b-3cdbcfb769c2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:28:41,983::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:42,051::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313026 s, 32.7 MB/s\n'; <rc> = 0 >Thread-56198::DEBUG::2014-05-16 18:28:43,921::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4319161.000000 / 8.008841 / 262500000.000000 = 0.205447 >Thread-56198::DEBUG::2014-05-16 18:28:43,921::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053494215286237663, 'statsAge': 0.86569905281066895, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20544728743035121, 'rxDropped': 0} >Thread-56198::DEBUG::2014-05-16 18:28:43,922::task::579::TaskManager.Task::(_updateState) Task=`6058912a-6ffc-4fa4-9280-1233e3e983a2`::moving from state init -> state preparing >Thread-56198::INFO::2014-05-16 18:28:43,922::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56198::INFO::2014-05-16 18:28:43,922::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731973', 'lastCheck': '4.7', 'valid': True}} >Thread-56198::DEBUG::2014-05-16 18:28:43,922::task::1168::TaskManager.Task::(prepare) Task=`6058912a-6ffc-4fa4-9280-1233e3e983a2`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731973', 'lastCheck': '4.7', 'valid': True}} >Thread-56198::DEBUG::2014-05-16 18:28:43,922::task::579::TaskManager.Task::(_updateState) Task=`6058912a-6ffc-4fa4-9280-1233e3e983a2`::moving from state preparing -> state finished >Thread-56198::DEBUG::2014-05-16 18:28:43,923::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56198::DEBUG::2014-05-16 18:28:43,923::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56198::DEBUG::2014-05-16 18:28:43,923::task::974::TaskManager.Task::(_decref) Task=`6058912a-6ffc-4fa4-9280-1233e3e983a2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:28:44,063::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:44,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310473 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:46,143::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:46,214::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357821 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:48,226::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:48,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312494 s, 32.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:28:49,197::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:28:49,207::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756637 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:50,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:50,377::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351681 s, 29.1 MB/s\n'; <rc> = 0 >Thread-56202::DEBUG::2014-05-16 18:28:51,278::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56202::DEBUG::2014-05-16 18:28:51,278::task::579::TaskManager.Task::(_updateState) Task=`f3c8ffc1-ef7c-4d97-9680-939d2ed1aab4`::moving from state init -> state preparing >Thread-56202::INFO::2014-05-16 18:28:51,279::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56202::INFO::2014-05-16 18:28:51,279::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56202::DEBUG::2014-05-16 18:28:51,279::task::1168::TaskManager.Task::(prepare) Task=`f3c8ffc1-ef7c-4d97-9680-939d2ed1aab4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56202::DEBUG::2014-05-16 18:28:51,279::task::579::TaskManager.Task::(_updateState) Task=`f3c8ffc1-ef7c-4d97-9680-939d2ed1aab4`::moving from state preparing -> state finished >Thread-56202::DEBUG::2014-05-16 18:28:51,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56202::DEBUG::2014-05-16 18:28:51,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56202::DEBUG::2014-05-16 18:28:51,280::task::974::TaskManager.Task::(_decref) Task=`f3c8ffc1-ef7c-4d97-9680-939d2ed1aab4`::ref 0 aborting False >Thread-56203::DEBUG::2014-05-16 18:28:51,288::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56203::DEBUG::2014-05-16 18:28:51,289::task::579::TaskManager.Task::(_updateState) Task=`687b37f6-5eda-4523-8c2d-600dc08dae8f`::moving from state init -> state preparing >Thread-56203::INFO::2014-05-16 18:28:51,289::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56203::DEBUG::2014-05-16 18:28:51,289::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fc19ed04-8c7e-4937-a4a5-6d2edaa29bfb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56203::DEBUG::2014-05-16 18:28:51,289::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56203::DEBUG::2014-05-16 18:28:51,290::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56203::DEBUG::2014-05-16 18:28:51,290::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`fc19ed04-8c7e-4937-a4a5-6d2edaa29bfb`::Granted request >Thread-56203::DEBUG::2014-05-16 18:28:51,290::task::811::TaskManager.Task::(resourceAcquired) Task=`687b37f6-5eda-4523-8c2d-600dc08dae8f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56203::DEBUG::2014-05-16 18:28:51,290::task::974::TaskManager.Task::(_decref) Task=`687b37f6-5eda-4523-8c2d-600dc08dae8f`::ref 1 aborting False >Thread-56203::INFO::2014-05-16 18:28:51,291::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56203::DEBUG::2014-05-16 18:28:51,291::task::1168::TaskManager.Task::(prepare) Task=`687b37f6-5eda-4523-8c2d-600dc08dae8f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56203::DEBUG::2014-05-16 18:28:51,291::task::579::TaskManager.Task::(_updateState) Task=`687b37f6-5eda-4523-8c2d-600dc08dae8f`::moving from state preparing -> state finished >Thread-56203::DEBUG::2014-05-16 18:28:51,291::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56203::DEBUG::2014-05-16 18:28:51,292::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56203::DEBUG::2014-05-16 18:28:51,292::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56203::DEBUG::2014-05-16 18:28:51,292::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56203::DEBUG::2014-05-16 18:28:51,292::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56203::DEBUG::2014-05-16 18:28:51,292::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56203::DEBUG::2014-05-16 18:28:51,292::task::974::TaskManager.Task::(_decref) Task=`687b37f6-5eda-4523-8c2d-600dc08dae8f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:28:52,388::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:52,460::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352651 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:54,472::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:54,538::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299105 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:56,549::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:56,616::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030902 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:28:58,628::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:28:58,699::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353975 s, 28.9 MB/s\n'; <rc> = 0 >Thread-56206::DEBUG::2014-05-16 18:28:59,231::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5406151.000000 / 8.009120 / 262500000.000000 = 0.257143 >Thread-56206::DEBUG::2014-05-16 18:28:59,232::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0067480215516994291, 'statsAge': 0.15809512138366699, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25714261972045832, 'rxDropped': 0} >Thread-56206::DEBUG::2014-05-16 18:28:59,233::task::579::TaskManager.Task::(_updateState) Task=`f2821fd1-4445-4906-955f-4e642e60233d`::moving from state init -> state preparing >Thread-56206::INFO::2014-05-16 18:28:59,234::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56206::INFO::2014-05-16 18:28:59,234::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756637', 'lastCheck': '10.0', 'valid': True}} >Thread-56206::DEBUG::2014-05-16 18:28:59,234::task::1168::TaskManager.Task::(prepare) Task=`f2821fd1-4445-4906-955f-4e642e60233d`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756637', 'lastCheck': '10.0', 'valid': True}} >Thread-56206::DEBUG::2014-05-16 18:28:59,235::task::579::TaskManager.Task::(_updateState) Task=`f2821fd1-4445-4906-955f-4e642e60233d`::moving from state preparing -> state finished >Thread-56206::DEBUG::2014-05-16 18:28:59,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56206::DEBUG::2014-05-16 18:28:59,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56206::DEBUG::2014-05-16 18:28:59,236::task::974::TaskManager.Task::(_decref) Task=`f2821fd1-4445-4906-955f-4e642e60233d`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:28:59,250::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:28:59,260::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000845234 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:00,711::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:00,782::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354096 s, 28.9 MB/s\n'; <rc> = 0 >Thread-56208::DEBUG::2014-05-16 18:29:01,344::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56208::DEBUG::2014-05-16 18:29:01,345::task::579::TaskManager.Task::(_updateState) Task=`a42ea7b9-e40b-4e1f-9786-0cb0ad50838a`::moving from state init -> state preparing >Thread-56208::INFO::2014-05-16 18:29:01,345::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56208::INFO::2014-05-16 18:29:01,345::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56208::DEBUG::2014-05-16 18:29:01,345::task::1168::TaskManager.Task::(prepare) Task=`a42ea7b9-e40b-4e1f-9786-0cb0ad50838a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56208::DEBUG::2014-05-16 18:29:01,345::task::579::TaskManager.Task::(_updateState) Task=`a42ea7b9-e40b-4e1f-9786-0cb0ad50838a`::moving from state preparing -> state finished >Thread-56208::DEBUG::2014-05-16 18:29:01,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56208::DEBUG::2014-05-16 18:29:01,346::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56208::DEBUG::2014-05-16 18:29:01,346::task::974::TaskManager.Task::(_decref) Task=`a42ea7b9-e40b-4e1f-9786-0cb0ad50838a`::ref 0 aborting False >Thread-56209::DEBUG::2014-05-16 18:29:01,358::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56209::DEBUG::2014-05-16 18:29:01,358::task::579::TaskManager.Task::(_updateState) Task=`1b55ed9a-69c4-4b5c-9808-1e0ed408a24f`::moving from state init -> state preparing >Thread-56209::INFO::2014-05-16 18:29:01,358::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56209::DEBUG::2014-05-16 18:29:01,358::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`01df3e6c-321c-491a-a9b8-7ed5506e7679`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56209::DEBUG::2014-05-16 18:29:01,359::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56209::DEBUG::2014-05-16 18:29:01,359::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56209::DEBUG::2014-05-16 18:29:01,359::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`01df3e6c-321c-491a-a9b8-7ed5506e7679`::Granted request >Thread-56209::DEBUG::2014-05-16 18:29:01,359::task::811::TaskManager.Task::(resourceAcquired) Task=`1b55ed9a-69c4-4b5c-9808-1e0ed408a24f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56209::DEBUG::2014-05-16 18:29:01,359::task::974::TaskManager.Task::(_decref) Task=`1b55ed9a-69c4-4b5c-9808-1e0ed408a24f`::ref 1 aborting False >Thread-56209::INFO::2014-05-16 18:29:01,360::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56209::DEBUG::2014-05-16 18:29:01,360::task::1168::TaskManager.Task::(prepare) Task=`1b55ed9a-69c4-4b5c-9808-1e0ed408a24f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56209::DEBUG::2014-05-16 18:29:01,361::task::579::TaskManager.Task::(_updateState) Task=`1b55ed9a-69c4-4b5c-9808-1e0ed408a24f`::moving from state preparing -> state finished >Thread-56209::DEBUG::2014-05-16 18:29:01,361::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56209::DEBUG::2014-05-16 18:29:01,361::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56209::DEBUG::2014-05-16 18:29:01,361::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56209::DEBUG::2014-05-16 18:29:01,361::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56209::DEBUG::2014-05-16 18:29:01,361::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56209::DEBUG::2014-05-16 18:29:01,362::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56209::DEBUG::2014-05-16 18:29:01,362::task::974::TaskManager.Task::(_decref) Task=`1b55ed9a-69c4-4b5c-9808-1e0ed408a24f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:29:02,794::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:02,861::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308391 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:04,872::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:04,939::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309551 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:06,951::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:07,022::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353845 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:09,033::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:09,105::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308765 s, 33.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:29:09,296::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:29:09,306::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000827454 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:11,117::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:11,184::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314267 s, 32.6 MB/s\n'; <rc> = 0 >Thread-56213::DEBUG::2014-05-16 18:29:11,408::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56213::DEBUG::2014-05-16 18:29:11,409::task::579::TaskManager.Task::(_updateState) Task=`56fe6aa7-bafb-493f-963f-2d2198dbf89d`::moving from state init -> state preparing >Thread-56213::INFO::2014-05-16 18:29:11,409::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56213::INFO::2014-05-16 18:29:11,409::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56213::DEBUG::2014-05-16 18:29:11,409::task::1168::TaskManager.Task::(prepare) Task=`56fe6aa7-bafb-493f-963f-2d2198dbf89d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56213::DEBUG::2014-05-16 18:29:11,410::task::579::TaskManager.Task::(_updateState) Task=`56fe6aa7-bafb-493f-963f-2d2198dbf89d`::moving from state preparing -> state finished >Thread-56213::DEBUG::2014-05-16 18:29:11,410::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56213::DEBUG::2014-05-16 18:29:11,410::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56213::DEBUG::2014-05-16 18:29:11,410::task::974::TaskManager.Task::(_decref) Task=`56fe6aa7-bafb-493f-963f-2d2198dbf89d`::ref 0 aborting False >Thread-56214::DEBUG::2014-05-16 18:29:11,435::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56214::DEBUG::2014-05-16 18:29:11,435::task::579::TaskManager.Task::(_updateState) Task=`eab6da25-f5b0-4391-94ce-54051300f78e`::moving from state init -> state preparing >Thread-56214::INFO::2014-05-16 18:29:11,435::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56214::DEBUG::2014-05-16 18:29:11,436::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`28c25291-9c46-47a3-84af-7a6927344394`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56214::DEBUG::2014-05-16 18:29:11,436::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56214::DEBUG::2014-05-16 18:29:11,436::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56214::DEBUG::2014-05-16 18:29:11,436::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`28c25291-9c46-47a3-84af-7a6927344394`::Granted request >Thread-56214::DEBUG::2014-05-16 18:29:11,436::task::811::TaskManager.Task::(resourceAcquired) Task=`eab6da25-f5b0-4391-94ce-54051300f78e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56214::DEBUG::2014-05-16 18:29:11,437::task::974::TaskManager.Task::(_decref) Task=`eab6da25-f5b0-4391-94ce-54051300f78e`::ref 1 aborting False >Thread-56214::INFO::2014-05-16 18:29:11,437::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56214::DEBUG::2014-05-16 18:29:11,437::task::1168::TaskManager.Task::(prepare) Task=`eab6da25-f5b0-4391-94ce-54051300f78e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56214::DEBUG::2014-05-16 18:29:11,438::task::579::TaskManager.Task::(_updateState) Task=`eab6da25-f5b0-4391-94ce-54051300f78e`::moving from state preparing -> state finished >Thread-56214::DEBUG::2014-05-16 18:29:11,438::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56214::DEBUG::2014-05-16 18:29:11,438::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56214::DEBUG::2014-05-16 18:29:11,438::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56214::DEBUG::2014-05-16 18:29:11,438::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56214::DEBUG::2014-05-16 18:29:11,439::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56214::DEBUG::2014-05-16 18:29:11,439::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56214::DEBUG::2014-05-16 18:29:11,439::task::974::TaskManager.Task::(_decref) Task=`eab6da25-f5b0-4391-94ce-54051300f78e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:29:13,195::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:13,266::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034916 s, 29.3 MB/s\n'; <rc> = 0 >Thread-56216::DEBUG::2014-05-16 18:29:14,605::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4320100.000000 / 8.011733 / 262500000.000000 = 0.205418 >Thread-56216::DEBUG::2014-05-16 18:29:14,605::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053511993793915694, 'statsAge': 1.5131890773773193, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20541777535906805, 'rxDropped': 0} >Thread-56216::DEBUG::2014-05-16 18:29:14,606::task::579::TaskManager.Task::(_updateState) Task=`03df6720-3ee6-4933-b418-04fa3fedf69a`::moving from state init -> state preparing >Thread-56216::INFO::2014-05-16 18:29:14,606::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56216::INFO::2014-05-16 18:29:14,607::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000827454', 'lastCheck': '5.3', 'valid': True}} >Thread-56216::DEBUG::2014-05-16 18:29:14,607::task::1168::TaskManager.Task::(prepare) Task=`03df6720-3ee6-4933-b418-04fa3fedf69a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000827454', 'lastCheck': '5.3', 'valid': True}} >Thread-56216::DEBUG::2014-05-16 18:29:14,607::task::579::TaskManager.Task::(_updateState) Task=`03df6720-3ee6-4933-b418-04fa3fedf69a`::moving from state preparing -> state finished >Thread-56216::DEBUG::2014-05-16 18:29:14,607::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56216::DEBUG::2014-05-16 18:29:14,607::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56216::DEBUG::2014-05-16 18:29:14,607::task::974::TaskManager.Task::(_decref) Task=`03df6720-3ee6-4933-b418-04fa3fedf69a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:29:15,278::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:15,348::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347242 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:17,360::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:17,428::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318652 s, 32.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:29:19,342::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:29:19,353::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010395 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:19,439::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:19,510::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351013 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:21,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-56220::DEBUG::2014-05-16 18:29:21,545::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56220::DEBUG::2014-05-16 18:29:21,547::task::579::TaskManager.Task::(_updateState) Task=`012f0fd5-d949-4557-9ba7-96c6d72ddb90`::moving from state init -> state preparing >Thread-56220::INFO::2014-05-16 18:29:21,548::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56220::INFO::2014-05-16 18:29:21,550::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56220::DEBUG::2014-05-16 18:29:21,550::task::1168::TaskManager.Task::(prepare) Task=`012f0fd5-d949-4557-9ba7-96c6d72ddb90`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56220::DEBUG::2014-05-16 18:29:21,551::task::579::TaskManager.Task::(_updateState) Task=`012f0fd5-d949-4557-9ba7-96c6d72ddb90`::moving from state preparing -> state finished >Thread-56220::DEBUG::2014-05-16 18:29:21,552::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56220::DEBUG::2014-05-16 18:29:21,553::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56220::DEBUG::2014-05-16 18:29:21,554::task::974::TaskManager.Task::(_decref) Task=`012f0fd5-d949-4557-9ba7-96c6d72ddb90`::ref 0 aborting False >Thread-56221::DEBUG::2014-05-16 18:29:21,578::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56221::DEBUG::2014-05-16 18:29:21,580::task::579::TaskManager.Task::(_updateState) Task=`2113a3e7-87f0-4c97-be6f-6a56efe15300`::moving from state init -> state preparing >Thread-56221::INFO::2014-05-16 18:29:21,581::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56221::DEBUG::2014-05-16 18:29:21,583::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c2b0ef9d-6a5a-475d-b5e1-edc2eb6f73d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56221::DEBUG::2014-05-16 18:29:21,584::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56221::DEBUG::2014-05-16 18:29:21,585::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56221::DEBUG::2014-05-16 18:29:21,586::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c2b0ef9d-6a5a-475d-b5e1-edc2eb6f73d9`::Granted request >Thread-56221::DEBUG::2014-05-16 18:29:21,588::task::811::TaskManager.Task::(resourceAcquired) Task=`2113a3e7-87f0-4c97-be6f-6a56efe15300`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56221::DEBUG::2014-05-16 18:29:21,589::task::974::TaskManager.Task::(_decref) Task=`2113a3e7-87f0-4c97-be6f-6a56efe15300`::ref 1 aborting False >Thread-56221::INFO::2014-05-16 18:29:21,592::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56221::DEBUG::2014-05-16 18:29:21,593::task::1168::TaskManager.Task::(prepare) Task=`2113a3e7-87f0-4c97-be6f-6a56efe15300`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56221::DEBUG::2014-05-16 18:29:21,594::task::579::TaskManager.Task::(_updateState) Task=`2113a3e7-87f0-4c97-be6f-6a56efe15300`::moving from state preparing -> state finished >Thread-56221::DEBUG::2014-05-16 18:29:21,595::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56221::DEBUG::2014-05-16 18:29:21,596::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56221::DEBUG::2014-05-16 18:29:21,597::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56221::DEBUG::2014-05-16 18:29:21,598::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56221::DEBUG::2014-05-16 18:29:21,599::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56221::DEBUG::2014-05-16 18:29:21,600::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56221::DEBUG::2014-05-16 18:29:21,601::task::974::TaskManager.Task::(_decref) Task=`2113a3e7-87f0-4c97-be6f-6a56efe15300`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:29:21,635::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0684047 s, 15.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:23,647::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:23,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306184 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:25,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:25,798::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357888 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:27,810::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:27,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306785 s, 33.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:29:29,386::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:29:29,396::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102105 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:29,888::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-56224::DEBUG::2014-05-16 18:29:29,913::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4309095.000000 / 8.008507 / 262500000.000000 = 0.204977 >Thread-56224::DEBUG::2014-05-16 18:29:29,914::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053776149031313667, 'statsAge': 0.80231213569641113, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20497703220706642, 'rxDropped': 0} >Thread-56224::DEBUG::2014-05-16 18:29:29,915::task::579::TaskManager.Task::(_updateState) Task=`f1d858ef-849e-4a25-9464-7d3ed63a05c4`::moving from state init -> state preparing >Thread-56224::INFO::2014-05-16 18:29:29,916::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56224::INFO::2014-05-16 18:29:29,917::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102105', 'lastCheck': '0.5', 'valid': True}} >Thread-56224::DEBUG::2014-05-16 18:29:29,918::task::1168::TaskManager.Task::(prepare) Task=`f1d858ef-849e-4a25-9464-7d3ed63a05c4`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102105', 'lastCheck': '0.5', 'valid': True}} >Thread-56224::DEBUG::2014-05-16 18:29:29,919::task::579::TaskManager.Task::(_updateState) Task=`f1d858ef-849e-4a25-9464-7d3ed63a05c4`::moving from state preparing -> state finished >Thread-56224::DEBUG::2014-05-16 18:29:29,920::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56224::DEBUG::2014-05-16 18:29:29,921::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56224::DEBUG::2014-05-16 18:29:29,922::task::974::TaskManager.Task::(_decref) Task=`f1d858ef-849e-4a25-9464-7d3ed63a05c4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:29:29,985::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0611484 s, 16.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:31,999::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:32,067::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318074 s, 32.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:34,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:34,151::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035779 s, 28.6 MB/s\n'; <rc> = 0 >Thread-56226::DEBUG::2014-05-16 18:29:35,111::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56226::DEBUG::2014-05-16 18:29:35,112::task::579::TaskManager.Task::(_updateState) Task=`72a8aad0-1e00-4704-9b70-0b6e77dff96b`::moving from state init -> state preparing >Thread-56226::INFO::2014-05-16 18:29:35,112::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56226::INFO::2014-05-16 18:29:35,112::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56226::DEBUG::2014-05-16 18:29:35,113::task::1168::TaskManager.Task::(prepare) Task=`72a8aad0-1e00-4704-9b70-0b6e77dff96b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56226::DEBUG::2014-05-16 18:29:35,113::task::579::TaskManager.Task::(_updateState) Task=`72a8aad0-1e00-4704-9b70-0b6e77dff96b`::moving from state preparing -> state finished >Thread-56226::DEBUG::2014-05-16 18:29:35,113::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56226::DEBUG::2014-05-16 18:29:35,113::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56226::DEBUG::2014-05-16 18:29:35,113::task::974::TaskManager.Task::(_decref) Task=`72a8aad0-1e00-4704-9b70-0b6e77dff96b`::ref 0 aborting False >Thread-56227::DEBUG::2014-05-16 18:29:35,137::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56227::DEBUG::2014-05-16 18:29:35,137::task::579::TaskManager.Task::(_updateState) Task=`05685ee9-eb92-45a0-a5f7-25b9dc7aeed2`::moving from state init -> state preparing >Thread-56227::INFO::2014-05-16 18:29:35,137::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56227::DEBUG::2014-05-16 18:29:35,138::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`af9855e9-1834-4cea-8492-93ac31ba8bb5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56227::DEBUG::2014-05-16 18:29:35,138::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56227::DEBUG::2014-05-16 18:29:35,138::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56227::DEBUG::2014-05-16 18:29:35,138::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`af9855e9-1834-4cea-8492-93ac31ba8bb5`::Granted request >Thread-56227::DEBUG::2014-05-16 18:29:35,138::task::811::TaskManager.Task::(resourceAcquired) Task=`05685ee9-eb92-45a0-a5f7-25b9dc7aeed2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56227::DEBUG::2014-05-16 18:29:35,138::task::974::TaskManager.Task::(_decref) Task=`05685ee9-eb92-45a0-a5f7-25b9dc7aeed2`::ref 1 aborting False >Thread-56227::INFO::2014-05-16 18:29:35,139::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56227::DEBUG::2014-05-16 18:29:35,139::task::1168::TaskManager.Task::(prepare) Task=`05685ee9-eb92-45a0-a5f7-25b9dc7aeed2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56227::DEBUG::2014-05-16 18:29:35,139::task::579::TaskManager.Task::(_updateState) Task=`05685ee9-eb92-45a0-a5f7-25b9dc7aeed2`::moving from state preparing -> state finished >Thread-56227::DEBUG::2014-05-16 18:29:35,139::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56227::DEBUG::2014-05-16 18:29:35,140::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56227::DEBUG::2014-05-16 18:29:35,140::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56227::DEBUG::2014-05-16 18:29:35,140::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56227::DEBUG::2014-05-16 18:29:35,140::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56227::DEBUG::2014-05-16 18:29:35,140::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56227::DEBUG::2014-05-16 18:29:35,141::task::974::TaskManager.Task::(_decref) Task=`05685ee9-eb92-45a0-a5f7-25b9dc7aeed2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:29:36,162::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:36,233::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343907 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:38,245::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:38,345::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0630268 s, 16.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:29:39,433::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:29:39,443::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000837117 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:40,357::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:40,429::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358458 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:42,440::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:42,507::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309963 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:44,519::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:44,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344118 s, 29.8 MB/s\n'; <rc> = 0 >Thread-56231::DEBUG::2014-05-16 18:29:45,317::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56231::DEBUG::2014-05-16 18:29:45,317::task::579::TaskManager.Task::(_updateState) Task=`4f1282fa-dca9-4b06-a891-da226e8b6962`::moving from state init -> state preparing >Thread-56231::INFO::2014-05-16 18:29:45,317::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56231::INFO::2014-05-16 18:29:45,318::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56231::DEBUG::2014-05-16 18:29:45,318::task::1168::TaskManager.Task::(prepare) Task=`4f1282fa-dca9-4b06-a891-da226e8b6962`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56231::DEBUG::2014-05-16 18:29:45,318::task::579::TaskManager.Task::(_updateState) Task=`4f1282fa-dca9-4b06-a891-da226e8b6962`::moving from state preparing -> state finished >Thread-56231::DEBUG::2014-05-16 18:29:45,318::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56231::DEBUG::2014-05-16 18:29:45,318::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56231::DEBUG::2014-05-16 18:29:45,319::task::974::TaskManager.Task::(_decref) Task=`4f1282fa-dca9-4b06-a891-da226e8b6962`::ref 0 aborting False >Thread-56232::DEBUG::2014-05-16 18:29:45,327::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56232::DEBUG::2014-05-16 18:29:45,327::task::579::TaskManager.Task::(_updateState) Task=`d2405f03-3742-4cd1-9560-2728515c627f`::moving from state init -> state preparing >Thread-56232::INFO::2014-05-16 18:29:45,327::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56232::DEBUG::2014-05-16 18:29:45,327::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1a1ce661-382b-49c1-9c14-6b7242609b39`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56232::DEBUG::2014-05-16 18:29:45,328::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56232::DEBUG::2014-05-16 18:29:45,328::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56232::DEBUG::2014-05-16 18:29:45,328::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1a1ce661-382b-49c1-9c14-6b7242609b39`::Granted request >Thread-56232::DEBUG::2014-05-16 18:29:45,328::task::811::TaskManager.Task::(resourceAcquired) Task=`d2405f03-3742-4cd1-9560-2728515c627f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56232::DEBUG::2014-05-16 18:29:45,328::task::974::TaskManager.Task::(_decref) Task=`d2405f03-3742-4cd1-9560-2728515c627f`::ref 1 aborting False >Thread-56232::INFO::2014-05-16 18:29:45,329::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56232::DEBUG::2014-05-16 18:29:45,329::task::1168::TaskManager.Task::(prepare) Task=`d2405f03-3742-4cd1-9560-2728515c627f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56232::DEBUG::2014-05-16 18:29:45,329::task::579::TaskManager.Task::(_updateState) Task=`d2405f03-3742-4cd1-9560-2728515c627f`::moving from state preparing -> state finished >Thread-56232::DEBUG::2014-05-16 18:29:45,330::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56232::DEBUG::2014-05-16 18:29:45,330::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56232::DEBUG::2014-05-16 18:29:45,330::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56232::DEBUG::2014-05-16 18:29:45,330::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56232::DEBUG::2014-05-16 18:29:45,330::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56232::DEBUG::2014-05-16 18:29:45,330::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56232::DEBUG::2014-05-16 18:29:45,331::task::974::TaskManager.Task::(_decref) Task=`d2405f03-3742-4cd1-9560-2728515c627f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:29:46,601::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:46,672::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352146 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:48,685::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:48,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316458 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:29:49,480::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:29:49,490::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000818442 s, 5.0 MB/s\n'; <rc> = 0 >Thread-56234::DEBUG::2014-05-16 18:29:50,615::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4312081.000000 / 8.009233 / 262500000.000000 = 0.205100 >Thread-56234::DEBUG::2014-05-16 18:29:50,616::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053441179355799605, 'statsAge': 1.482943058013916, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20510047893991928, 'rxDropped': 0} >Thread-56234::DEBUG::2014-05-16 18:29:50,616::task::579::TaskManager.Task::(_updateState) Task=`ba30ee3f-c884-4b2f-b3ce-7de5628546d2`::moving from state init -> state preparing >Thread-56234::INFO::2014-05-16 18:29:50,616::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56234::INFO::2014-05-16 18:29:50,616::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000818442', 'lastCheck': '1.1', 'valid': True}} >Thread-56234::DEBUG::2014-05-16 18:29:50,617::task::1168::TaskManager.Task::(prepare) Task=`ba30ee3f-c884-4b2f-b3ce-7de5628546d2`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000818442', 'lastCheck': '1.1', 'valid': True}} >Thread-56234::DEBUG::2014-05-16 18:29:50,617::task::579::TaskManager.Task::(_updateState) Task=`ba30ee3f-c884-4b2f-b3ce-7de5628546d2`::moving from state preparing -> state finished >Thread-56234::DEBUG::2014-05-16 18:29:50,617::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56234::DEBUG::2014-05-16 18:29:50,617::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56234::DEBUG::2014-05-16 18:29:50,617::task::974::TaskManager.Task::(_decref) Task=`ba30ee3f-c884-4b2f-b3ce-7de5628546d2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:29:50,763::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:50,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036076 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:52,848::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:52,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035108 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:54,931::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:54,998::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314061 s, 32.6 MB/s\n'; <rc> = 0 >Thread-56237::DEBUG::2014-05-16 18:29:55,431::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56237::DEBUG::2014-05-16 18:29:55,432::task::579::TaskManager.Task::(_updateState) Task=`9b4d0359-9b94-4028-81ab-347cf3d6cc2c`::moving from state init -> state preparing >Thread-56237::INFO::2014-05-16 18:29:55,432::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56237::INFO::2014-05-16 18:29:55,432::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56237::DEBUG::2014-05-16 18:29:55,433::task::1168::TaskManager.Task::(prepare) Task=`9b4d0359-9b94-4028-81ab-347cf3d6cc2c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56237::DEBUG::2014-05-16 18:29:55,433::task::579::TaskManager.Task::(_updateState) Task=`9b4d0359-9b94-4028-81ab-347cf3d6cc2c`::moving from state preparing -> state finished >Thread-56237::DEBUG::2014-05-16 18:29:55,433::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56237::DEBUG::2014-05-16 18:29:55,433::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56237::DEBUG::2014-05-16 18:29:55,433::task::974::TaskManager.Task::(_decref) Task=`9b4d0359-9b94-4028-81ab-347cf3d6cc2c`::ref 0 aborting False >Thread-56238::DEBUG::2014-05-16 18:29:55,449::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56238::DEBUG::2014-05-16 18:29:55,449::task::579::TaskManager.Task::(_updateState) Task=`edd54d1b-02a6-417a-84d6-c72b1beae923`::moving from state init -> state preparing >Thread-56238::INFO::2014-05-16 18:29:55,449::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56238::DEBUG::2014-05-16 18:29:55,450::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7857b362-8bdb-40ee-ab02-b6758e524e56`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56238::DEBUG::2014-05-16 18:29:55,450::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56238::DEBUG::2014-05-16 18:29:55,450::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56238::DEBUG::2014-05-16 18:29:55,450::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7857b362-8bdb-40ee-ab02-b6758e524e56`::Granted request >Thread-56238::DEBUG::2014-05-16 18:29:55,450::task::811::TaskManager.Task::(resourceAcquired) Task=`edd54d1b-02a6-417a-84d6-c72b1beae923`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56238::DEBUG::2014-05-16 18:29:55,451::task::974::TaskManager.Task::(_decref) Task=`edd54d1b-02a6-417a-84d6-c72b1beae923`::ref 1 aborting False >Thread-56238::INFO::2014-05-16 18:29:55,451::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56238::DEBUG::2014-05-16 18:29:55,451::task::1168::TaskManager.Task::(prepare) Task=`edd54d1b-02a6-417a-84d6-c72b1beae923`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56238::DEBUG::2014-05-16 18:29:55,452::task::579::TaskManager.Task::(_updateState) Task=`edd54d1b-02a6-417a-84d6-c72b1beae923`::moving from state preparing -> state finished >Thread-56238::DEBUG::2014-05-16 18:29:55,452::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56238::DEBUG::2014-05-16 18:29:55,452::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56238::DEBUG::2014-05-16 18:29:55,452::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56238::DEBUG::2014-05-16 18:29:55,452::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56238::DEBUG::2014-05-16 18:29:55,453::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56238::DEBUG::2014-05-16 18:29:55,453::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56238::DEBUG::2014-05-16 18:29:55,453::task::974::TaskManager.Task::(_decref) Task=`edd54d1b-02a6-417a-84d6-c72b1beae923`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:29:57,010::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:57,077::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310348 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:29:59,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:29:59,164::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325064 s, 31.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:29:59,527::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:29:59,538::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000806035 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:01,175::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:01,247::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355988 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:03,258::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:03,327::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308626 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:05,339::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:05,411::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355663 s, 28.8 MB/s\n'; <rc> = 0 >Thread-56242::DEBUG::2014-05-16 18:30:05,498::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56242::DEBUG::2014-05-16 18:30:05,499::task::579::TaskManager.Task::(_updateState) Task=`e37eb1e6-5cb5-4475-8602-81d460631b08`::moving from state init -> state preparing >Thread-56242::INFO::2014-05-16 18:30:05,499::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56242::INFO::2014-05-16 18:30:05,500::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56242::DEBUG::2014-05-16 18:30:05,500::task::1168::TaskManager.Task::(prepare) Task=`e37eb1e6-5cb5-4475-8602-81d460631b08`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56242::DEBUG::2014-05-16 18:30:05,500::task::579::TaskManager.Task::(_updateState) Task=`e37eb1e6-5cb5-4475-8602-81d460631b08`::moving from state preparing -> state finished >Thread-56242::DEBUG::2014-05-16 18:30:05,500::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56242::DEBUG::2014-05-16 18:30:05,500::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56242::DEBUG::2014-05-16 18:30:05,500::task::974::TaskManager.Task::(_decref) Task=`e37eb1e6-5cb5-4475-8602-81d460631b08`::ref 0 aborting False >Thread-56243::DEBUG::2014-05-16 18:30:05,521::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56243::DEBUG::2014-05-16 18:30:05,522::task::579::TaskManager.Task::(_updateState) Task=`6f967856-9bf4-4945-982c-23bee6f6787f`::moving from state init -> state preparing >Thread-56243::INFO::2014-05-16 18:30:05,522::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56243::DEBUG::2014-05-16 18:30:05,522::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4676fae1-6bdb-4bad-bf7d-35020835afaf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56243::DEBUG::2014-05-16 18:30:05,522::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56243::DEBUG::2014-05-16 18:30:05,523::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56243::DEBUG::2014-05-16 18:30:05,524::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4676fae1-6bdb-4bad-bf7d-35020835afaf`::Granted request >Thread-56243::DEBUG::2014-05-16 18:30:05,524::task::811::TaskManager.Task::(resourceAcquired) Task=`6f967856-9bf4-4945-982c-23bee6f6787f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56243::DEBUG::2014-05-16 18:30:05,524::task::974::TaskManager.Task::(_decref) Task=`6f967856-9bf4-4945-982c-23bee6f6787f`::ref 1 aborting False >Thread-56243::INFO::2014-05-16 18:30:05,525::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56243::DEBUG::2014-05-16 18:30:05,525::task::1168::TaskManager.Task::(prepare) Task=`6f967856-9bf4-4945-982c-23bee6f6787f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56243::DEBUG::2014-05-16 18:30:05,525::task::579::TaskManager.Task::(_updateState) Task=`6f967856-9bf4-4945-982c-23bee6f6787f`::moving from state preparing -> state finished >Thread-56243::DEBUG::2014-05-16 18:30:05,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56243::DEBUG::2014-05-16 18:30:05,525::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56243::DEBUG::2014-05-16 18:30:05,526::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56243::DEBUG::2014-05-16 18:30:05,526::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56243::DEBUG::2014-05-16 18:30:05,526::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56243::DEBUG::2014-05-16 18:30:05,526::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56243::DEBUG::2014-05-16 18:30:05,526::task::974::TaskManager.Task::(_decref) Task=`6f967856-9bf4-4945-982c-23bee6f6787f`::ref 0 aborting False >Thread-56244::DEBUG::2014-05-16 18:30:06,441::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317138.000000 / 8.012203 / 262500000.000000 = 0.205265 >Thread-56244::DEBUG::2014-05-16 18:30:06,441::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052495163428804273, 'statsAge': 1.2874209880828857, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20526489462240166, 'rxDropped': 0} >Thread-56244::DEBUG::2014-05-16 18:30:06,442::task::579::TaskManager.Task::(_updateState) Task=`35e29344-306e-41b4-89ac-914c0e4b69cd`::moving from state init -> state preparing >Thread-56244::INFO::2014-05-16 18:30:06,442::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56244::INFO::2014-05-16 18:30:06,442::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806035', 'lastCheck': '6.9', 'valid': True}} >Thread-56244::DEBUG::2014-05-16 18:30:06,442::task::1168::TaskManager.Task::(prepare) Task=`35e29344-306e-41b4-89ac-914c0e4b69cd`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806035', 'lastCheck': '6.9', 'valid': True}} >Thread-56244::DEBUG::2014-05-16 18:30:06,443::task::579::TaskManager.Task::(_updateState) Task=`35e29344-306e-41b4-89ac-914c0e4b69cd`::moving from state preparing -> state finished >Thread-56244::DEBUG::2014-05-16 18:30:06,443::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56244::DEBUG::2014-05-16 18:30:06,443::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56244::DEBUG::2014-05-16 18:30:06,443::task::974::TaskManager.Task::(_decref) Task=`35e29344-306e-41b4-89ac-914c0e4b69cd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:30:07,422::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:07,493::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348002 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:09,505::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 18:30:09,699::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:30:09,730::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000774018 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:09,825::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346636 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:11,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:11,906::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306571 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:13,918::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:13,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346048 s, 29.6 MB/s\n'; <rc> = 0 >Thread-56248::DEBUG::2014-05-16 18:30:15,586::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56248::DEBUG::2014-05-16 18:30:15,586::task::579::TaskManager.Task::(_updateState) Task=`eeeb55c1-1f9b-4114-b6ec-109262388cf7`::moving from state init -> state preparing >Thread-56248::INFO::2014-05-16 18:30:15,586::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56248::INFO::2014-05-16 18:30:15,587::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56248::DEBUG::2014-05-16 18:30:15,587::task::1168::TaskManager.Task::(prepare) Task=`eeeb55c1-1f9b-4114-b6ec-109262388cf7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56248::DEBUG::2014-05-16 18:30:15,587::task::579::TaskManager.Task::(_updateState) Task=`eeeb55c1-1f9b-4114-b6ec-109262388cf7`::moving from state preparing -> state finished >Thread-56248::DEBUG::2014-05-16 18:30:15,587::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56248::DEBUG::2014-05-16 18:30:15,587::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56248::DEBUG::2014-05-16 18:30:15,588::task::974::TaskManager.Task::(_decref) Task=`eeeb55c1-1f9b-4114-b6ec-109262388cf7`::ref 0 aborting False >Thread-56250::DEBUG::2014-05-16 18:30:15,608::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56250::DEBUG::2014-05-16 18:30:15,608::task::579::TaskManager.Task::(_updateState) Task=`6658d0b3-dc4d-44c0-9dfb-76158ec52216`::moving from state init -> state preparing >Thread-56250::INFO::2014-05-16 18:30:15,608::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56250::DEBUG::2014-05-16 18:30:15,608::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f1440a08-e5ff-45a6-a22e-efcd5205eee1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56250::DEBUG::2014-05-16 18:30:15,609::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56250::DEBUG::2014-05-16 18:30:15,609::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56250::DEBUG::2014-05-16 18:30:15,609::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f1440a08-e5ff-45a6-a22e-efcd5205eee1`::Granted request >Thread-56250::DEBUG::2014-05-16 18:30:15,609::task::811::TaskManager.Task::(resourceAcquired) Task=`6658d0b3-dc4d-44c0-9dfb-76158ec52216`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56250::DEBUG::2014-05-16 18:30:15,610::task::974::TaskManager.Task::(_decref) Task=`6658d0b3-dc4d-44c0-9dfb-76158ec52216`::ref 1 aborting False >Thread-56250::INFO::2014-05-16 18:30:15,610::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56250::DEBUG::2014-05-16 18:30:15,610::task::1168::TaskManager.Task::(prepare) Task=`6658d0b3-dc4d-44c0-9dfb-76158ec52216`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56250::DEBUG::2014-05-16 18:30:15,611::task::579::TaskManager.Task::(_updateState) Task=`6658d0b3-dc4d-44c0-9dfb-76158ec52216`::moving from state preparing -> state finished >Thread-56250::DEBUG::2014-05-16 18:30:15,611::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56250::DEBUG::2014-05-16 18:30:15,612::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56250::DEBUG::2014-05-16 18:30:15,613::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56250::DEBUG::2014-05-16 18:30:15,613::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56250::DEBUG::2014-05-16 18:30:15,613::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56250::DEBUG::2014-05-16 18:30:15,613::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56250::DEBUG::2014-05-16 18:30:15,613::task::974::TaskManager.Task::(_decref) Task=`6658d0b3-dc4d-44c0-9dfb-76158ec52216`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:30:16,000::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:16,074::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370478 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:18,086::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:18,153::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304975 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:30:19,845::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:30:19,856::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107594 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:20,164::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:20,231::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031454 s, 32.6 MB/s\n'; <rc> = 0 >Thread-56252::DEBUG::2014-05-16 18:30:21,718::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5416004.000000 / 8.008553 / 262500000.000000 = 0.257630 >Thread-56252::DEBUG::2014-05-16 18:30:21,718::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0067004553996988922, 'statsAge': 0.54778599739074707, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25762951332238249, 'rxDropped': 0} >Thread-56252::DEBUG::2014-05-16 18:30:21,719::task::579::TaskManager.Task::(_updateState) Task=`e283d67e-f42e-45d1-88a1-86c7ac5660b8`::moving from state init -> state preparing >Thread-56252::INFO::2014-05-16 18:30:21,719::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56252::INFO::2014-05-16 18:30:21,719::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107594', 'lastCheck': '1.8', 'valid': True}} >Thread-56252::DEBUG::2014-05-16 18:30:21,719::task::1168::TaskManager.Task::(prepare) Task=`e283d67e-f42e-45d1-88a1-86c7ac5660b8`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107594', 'lastCheck': '1.8', 'valid': True}} >Thread-56252::DEBUG::2014-05-16 18:30:21,720::task::579::TaskManager.Task::(_updateState) Task=`e283d67e-f42e-45d1-88a1-86c7ac5660b8`::moving from state preparing -> state finished >Thread-56252::DEBUG::2014-05-16 18:30:21,720::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56252::DEBUG::2014-05-16 18:30:21,720::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56252::DEBUG::2014-05-16 18:30:21,720::task::974::TaskManager.Task::(_decref) Task=`e283d67e-f42e-45d1-88a1-86c7ac5660b8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:30:22,243::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:22,314::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354402 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:24,327::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:24,394::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310261 s, 33.0 MB/s\n'; <rc> = 0 >Thread-56255::DEBUG::2014-05-16 18:30:25,692::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56255::DEBUG::2014-05-16 18:30:25,693::task::579::TaskManager.Task::(_updateState) Task=`fd6b586a-fadb-47db-9aca-fd98b7f54099`::moving from state init -> state preparing >Thread-56255::INFO::2014-05-16 18:30:25,693::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56255::INFO::2014-05-16 18:30:25,693::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56255::DEBUG::2014-05-16 18:30:25,693::task::1168::TaskManager.Task::(prepare) Task=`fd6b586a-fadb-47db-9aca-fd98b7f54099`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56255::DEBUG::2014-05-16 18:30:25,694::task::579::TaskManager.Task::(_updateState) Task=`fd6b586a-fadb-47db-9aca-fd98b7f54099`::moving from state preparing -> state finished >Thread-56255::DEBUG::2014-05-16 18:30:25,694::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56255::DEBUG::2014-05-16 18:30:25,694::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56255::DEBUG::2014-05-16 18:30:25,694::task::974::TaskManager.Task::(_decref) Task=`fd6b586a-fadb-47db-9aca-fd98b7f54099`::ref 0 aborting False >Thread-56256::DEBUG::2014-05-16 18:30:25,713::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56256::DEBUG::2014-05-16 18:30:25,713::task::579::TaskManager.Task::(_updateState) Task=`970d53b8-3a7c-42d2-9979-bab0e40575ec`::moving from state init -> state preparing >Thread-56256::INFO::2014-05-16 18:30:25,713::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56256::DEBUG::2014-05-16 18:30:25,714::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bf6e14c7-e738-49ac-83e6-b3884c47180b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56256::DEBUG::2014-05-16 18:30:25,714::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56256::DEBUG::2014-05-16 18:30:25,714::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56256::DEBUG::2014-05-16 18:30:25,714::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bf6e14c7-e738-49ac-83e6-b3884c47180b`::Granted request >Thread-56256::DEBUG::2014-05-16 18:30:25,714::task::811::TaskManager.Task::(resourceAcquired) Task=`970d53b8-3a7c-42d2-9979-bab0e40575ec`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56256::DEBUG::2014-05-16 18:30:25,715::task::974::TaskManager.Task::(_decref) Task=`970d53b8-3a7c-42d2-9979-bab0e40575ec`::ref 1 aborting False >Thread-56256::INFO::2014-05-16 18:30:25,715::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56256::DEBUG::2014-05-16 18:30:25,715::task::1168::TaskManager.Task::(prepare) Task=`970d53b8-3a7c-42d2-9979-bab0e40575ec`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56256::DEBUG::2014-05-16 18:30:25,716::task::579::TaskManager.Task::(_updateState) Task=`970d53b8-3a7c-42d2-9979-bab0e40575ec`::moving from state preparing -> state finished >Thread-56256::DEBUG::2014-05-16 18:30:25,716::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56256::DEBUG::2014-05-16 18:30:25,716::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56256::DEBUG::2014-05-16 18:30:25,716::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56256::DEBUG::2014-05-16 18:30:25,716::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56256::DEBUG::2014-05-16 18:30:25,716::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56256::DEBUG::2014-05-16 18:30:25,717::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56256::DEBUG::2014-05-16 18:30:25,717::task::974::TaskManager.Task::(_decref) Task=`970d53b8-3a7c-42d2-9979-bab0e40575ec`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:30:26,406::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:26,474::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310175 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:28,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:28,557::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350129 s, 29.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:30:29,889::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:30:29,901::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105467 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:30,569::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:30,640::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354401 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:32,651::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:32,718::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030952 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:34,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:34,802::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357154 s, 28.7 MB/s\n'; <rc> = 0 >Thread-56260::DEBUG::2014-05-16 18:30:35,779::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56260::DEBUG::2014-05-16 18:30:35,779::task::579::TaskManager.Task::(_updateState) Task=`6f975aac-42d3-4c56-b694-619763c8309e`::moving from state init -> state preparing >Thread-56260::INFO::2014-05-16 18:30:35,780::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56260::INFO::2014-05-16 18:30:35,780::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56260::DEBUG::2014-05-16 18:30:35,780::task::1168::TaskManager.Task::(prepare) Task=`6f975aac-42d3-4c56-b694-619763c8309e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56260::DEBUG::2014-05-16 18:30:35,780::task::579::TaskManager.Task::(_updateState) Task=`6f975aac-42d3-4c56-b694-619763c8309e`::moving from state preparing -> state finished >Thread-56260::DEBUG::2014-05-16 18:30:35,780::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56260::DEBUG::2014-05-16 18:30:35,781::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56260::DEBUG::2014-05-16 18:30:35,781::task::974::TaskManager.Task::(_decref) Task=`6f975aac-42d3-4c56-b694-619763c8309e`::ref 0 aborting False >Thread-56261::DEBUG::2014-05-16 18:30:35,793::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56261::DEBUG::2014-05-16 18:30:35,794::task::579::TaskManager.Task::(_updateState) Task=`c61df316-2160-4bb1-ae6e-1c56485f5457`::moving from state init -> state preparing >Thread-56261::INFO::2014-05-16 18:30:35,794::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56261::DEBUG::2014-05-16 18:30:35,794::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c2865c15-1942-445c-b29e-ef24c74d5f6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56261::DEBUG::2014-05-16 18:30:35,794::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56261::DEBUG::2014-05-16 18:30:35,795::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56261::DEBUG::2014-05-16 18:30:35,795::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c2865c15-1942-445c-b29e-ef24c74d5f6f`::Granted request >Thread-56261::DEBUG::2014-05-16 18:30:35,795::task::811::TaskManager.Task::(resourceAcquired) Task=`c61df316-2160-4bb1-ae6e-1c56485f5457`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56261::DEBUG::2014-05-16 18:30:35,795::task::974::TaskManager.Task::(_decref) Task=`c61df316-2160-4bb1-ae6e-1c56485f5457`::ref 1 aborting False >Thread-56261::INFO::2014-05-16 18:30:35,796::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56261::DEBUG::2014-05-16 18:30:35,796::task::1168::TaskManager.Task::(prepare) Task=`c61df316-2160-4bb1-ae6e-1c56485f5457`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56261::DEBUG::2014-05-16 18:30:35,796::task::579::TaskManager.Task::(_updateState) Task=`c61df316-2160-4bb1-ae6e-1c56485f5457`::moving from state preparing -> state finished >Thread-56261::DEBUG::2014-05-16 18:30:35,797::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56261::DEBUG::2014-05-16 18:30:35,797::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56261::DEBUG::2014-05-16 18:30:35,797::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56261::DEBUG::2014-05-16 18:30:35,797::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56261::DEBUG::2014-05-16 18:30:35,797::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56261::DEBUG::2014-05-16 18:30:35,797::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56261::DEBUG::2014-05-16 18:30:35,798::task::974::TaskManager.Task::(_decref) Task=`c61df316-2160-4bb1-ae6e-1c56485f5457`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:30:36,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:36,884::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034563 s, 29.6 MB/s\n'; <rc> = 0 >Thread-56262::DEBUG::2014-05-16 18:30:36,986::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313780.000000 / 8.008581 / 262500000.000000 = 0.205198 >Thread-56262::DEBUG::2014-05-16 18:30:36,986::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0051152751819030029, 'statsAge': 1.8004159927368164, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20519799670984168, 'rxDropped': 0} >Thread-56262::DEBUG::2014-05-16 18:30:36,986::task::579::TaskManager.Task::(_updateState) Task=`3c53c33e-e143-45e1-bc31-690984517523`::moving from state init -> state preparing >Thread-56262::INFO::2014-05-16 18:30:36,987::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56262::INFO::2014-05-16 18:30:36,987::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105467', 'lastCheck': '7.1', 'valid': True}} >Thread-56262::DEBUG::2014-05-16 18:30:36,987::task::1168::TaskManager.Task::(prepare) Task=`3c53c33e-e143-45e1-bc31-690984517523`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105467', 'lastCheck': '7.1', 'valid': True}} >Thread-56262::DEBUG::2014-05-16 18:30:36,987::task::579::TaskManager.Task::(_updateState) Task=`3c53c33e-e143-45e1-bc31-690984517523`::moving from state preparing -> state finished >Thread-56262::DEBUG::2014-05-16 18:30:36,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56262::DEBUG::2014-05-16 18:30:36,988::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56262::DEBUG::2014-05-16 18:30:36,988::task::974::TaskManager.Task::(_decref) Task=`3c53c33e-e143-45e1-bc31-690984517523`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:30:38,896::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:38,963::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310719 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:30:39,938::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:30:39,948::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000869404 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:40,974::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:41,043::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315977 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:43,054::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:43,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0389266 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:45,146::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:45,219::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313201 s, 32.7 MB/s\n'; <rc> = 0 >Thread-56266::DEBUG::2014-05-16 18:30:45,851::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56266::DEBUG::2014-05-16 18:30:45,852::task::579::TaskManager.Task::(_updateState) Task=`4d7b3d64-b464-4a74-8b6b-ee8b342f3084`::moving from state init -> state preparing >Thread-56266::INFO::2014-05-16 18:30:45,852::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56266::INFO::2014-05-16 18:30:45,853::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56266::DEBUG::2014-05-16 18:30:45,853::task::1168::TaskManager.Task::(prepare) Task=`4d7b3d64-b464-4a74-8b6b-ee8b342f3084`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56266::DEBUG::2014-05-16 18:30:45,853::task::579::TaskManager.Task::(_updateState) Task=`4d7b3d64-b464-4a74-8b6b-ee8b342f3084`::moving from state preparing -> state finished >Thread-56266::DEBUG::2014-05-16 18:30:45,853::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56266::DEBUG::2014-05-16 18:30:45,853::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56266::DEBUG::2014-05-16 18:30:45,853::task::974::TaskManager.Task::(_decref) Task=`4d7b3d64-b464-4a74-8b6b-ee8b342f3084`::ref 0 aborting False >Thread-56267::DEBUG::2014-05-16 18:30:45,862::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56267::DEBUG::2014-05-16 18:30:45,862::task::579::TaskManager.Task::(_updateState) Task=`78002e7b-c4e5-48ff-8c8a-ad807ec421c1`::moving from state init -> state preparing >Thread-56267::INFO::2014-05-16 18:30:45,863::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56267::DEBUG::2014-05-16 18:30:45,863::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9565ebe6-8d56-4863-a654-c91886c33fb2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56267::DEBUG::2014-05-16 18:30:45,863::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56267::DEBUG::2014-05-16 18:30:45,863::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56267::DEBUG::2014-05-16 18:30:45,864::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9565ebe6-8d56-4863-a654-c91886c33fb2`::Granted request >Thread-56267::DEBUG::2014-05-16 18:30:45,864::task::811::TaskManager.Task::(resourceAcquired) Task=`78002e7b-c4e5-48ff-8c8a-ad807ec421c1`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56267::DEBUG::2014-05-16 18:30:45,864::task::974::TaskManager.Task::(_decref) Task=`78002e7b-c4e5-48ff-8c8a-ad807ec421c1`::ref 1 aborting False >Thread-56267::INFO::2014-05-16 18:30:45,865::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56267::DEBUG::2014-05-16 18:30:45,865::task::1168::TaskManager.Task::(prepare) Task=`78002e7b-c4e5-48ff-8c8a-ad807ec421c1`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56267::DEBUG::2014-05-16 18:30:45,865::task::579::TaskManager.Task::(_updateState) Task=`78002e7b-c4e5-48ff-8c8a-ad807ec421c1`::moving from state preparing -> state finished >Thread-56267::DEBUG::2014-05-16 18:30:45,865::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56267::DEBUG::2014-05-16 18:30:45,865::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56267::DEBUG::2014-05-16 18:30:45,866::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56267::DEBUG::2014-05-16 18:30:45,866::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56267::DEBUG::2014-05-16 18:30:45,866::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56267::DEBUG::2014-05-16 18:30:45,866::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56267::DEBUG::2014-05-16 18:30:45,866::task::974::TaskManager.Task::(_decref) Task=`78002e7b-c4e5-48ff-8c8a-ad807ec421c1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:30:47,230::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:47,297::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313084 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:49,309::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:49,380::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035585 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:30:49,986::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:30:49,996::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000755933 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:51,392::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:51,463::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354112 s, 28.9 MB/s\n'; <rc> = 0 >Thread-56270::DEBUG::2014-05-16 18:30:52,212::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317612.000000 / 8.011171 / 262500000.000000 = 0.205314 >Thread-56270::DEBUG::2014-05-16 18:30:52,212::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053813427014779017, 'statsAge': 1.0070087909698486, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20531387363707657, 'rxDropped': 0} >Thread-56270::DEBUG::2014-05-16 18:30:52,213::task::579::TaskManager.Task::(_updateState) Task=`28460f0d-d9c8-47f9-802e-8c2f54f7d8c9`::moving from state init -> state preparing >Thread-56270::INFO::2014-05-16 18:30:52,213::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56270::INFO::2014-05-16 18:30:52,213::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000755933', 'lastCheck': '2.2', 'valid': True}} >Thread-56270::DEBUG::2014-05-16 18:30:52,213::task::1168::TaskManager.Task::(prepare) Task=`28460f0d-d9c8-47f9-802e-8c2f54f7d8c9`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000755933', 'lastCheck': '2.2', 'valid': True}} >Thread-56270::DEBUG::2014-05-16 18:30:52,214::task::579::TaskManager.Task::(_updateState) Task=`28460f0d-d9c8-47f9-802e-8c2f54f7d8c9`::moving from state preparing -> state finished >Thread-56270::DEBUG::2014-05-16 18:30:52,214::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56270::DEBUG::2014-05-16 18:30:52,214::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56270::DEBUG::2014-05-16 18:30:52,214::task::974::TaskManager.Task::(_decref) Task=`28460f0d-d9c8-47f9-802e-8c2f54f7d8c9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:30:53,475::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:53,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312777 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:55,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:55,628::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358631 s, 28.6 MB/s\n'; <rc> = 0 >Thread-56273::DEBUG::2014-05-16 18:30:55,903::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56273::DEBUG::2014-05-16 18:30:55,903::task::579::TaskManager.Task::(_updateState) Task=`e35b8a09-1e7a-4a04-963e-225bf21b2330`::moving from state init -> state preparing >Thread-56273::INFO::2014-05-16 18:30:55,903::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56273::INFO::2014-05-16 18:30:55,904::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56273::DEBUG::2014-05-16 18:30:55,904::task::1168::TaskManager.Task::(prepare) Task=`e35b8a09-1e7a-4a04-963e-225bf21b2330`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56273::DEBUG::2014-05-16 18:30:55,904::task::579::TaskManager.Task::(_updateState) Task=`e35b8a09-1e7a-4a04-963e-225bf21b2330`::moving from state preparing -> state finished >Thread-56273::DEBUG::2014-05-16 18:30:55,904::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56273::DEBUG::2014-05-16 18:30:55,904::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56273::DEBUG::2014-05-16 18:30:55,905::task::974::TaskManager.Task::(_decref) Task=`e35b8a09-1e7a-4a04-963e-225bf21b2330`::ref 0 aborting False >Thread-56274::DEBUG::2014-05-16 18:30:55,915::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56274::DEBUG::2014-05-16 18:30:55,915::task::579::TaskManager.Task::(_updateState) Task=`cf504af6-7839-441c-8119-5e5fc7f9e8e9`::moving from state init -> state preparing >Thread-56274::INFO::2014-05-16 18:30:55,915::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56274::DEBUG::2014-05-16 18:30:55,916::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7204d62b-bef1-4548-95bd-f164b801178e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56274::DEBUG::2014-05-16 18:30:55,916::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56274::DEBUG::2014-05-16 18:30:55,917::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56274::DEBUG::2014-05-16 18:30:55,917::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7204d62b-bef1-4548-95bd-f164b801178e`::Granted request >Thread-56274::DEBUG::2014-05-16 18:30:55,918::task::811::TaskManager.Task::(resourceAcquired) Task=`cf504af6-7839-441c-8119-5e5fc7f9e8e9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56274::DEBUG::2014-05-16 18:30:55,918::task::974::TaskManager.Task::(_decref) Task=`cf504af6-7839-441c-8119-5e5fc7f9e8e9`::ref 1 aborting False >Thread-56274::INFO::2014-05-16 18:30:55,919::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56274::DEBUG::2014-05-16 18:30:55,919::task::1168::TaskManager.Task::(prepare) Task=`cf504af6-7839-441c-8119-5e5fc7f9e8e9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56274::DEBUG::2014-05-16 18:30:55,919::task::579::TaskManager.Task::(_updateState) Task=`cf504af6-7839-441c-8119-5e5fc7f9e8e9`::moving from state preparing -> state finished >Thread-56274::DEBUG::2014-05-16 18:30:55,919::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56274::DEBUG::2014-05-16 18:30:55,919::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56274::DEBUG::2014-05-16 18:30:55,919::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56274::DEBUG::2014-05-16 18:30:55,920::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56274::DEBUG::2014-05-16 18:30:55,920::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56274::DEBUG::2014-05-16 18:30:55,920::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56274::DEBUG::2014-05-16 18:30:55,920::task::974::TaskManager.Task::(_decref) Task=`cf504af6-7839-441c-8119-5e5fc7f9e8e9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:30:57,640::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:57,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294776 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:30:59,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:30:59,784::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315105 s, 32.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:31:00,031::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:31:00,041::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000788672 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:01,796::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:01,870::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360094 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:03,882::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:03,950::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313996 s, 32.6 MB/s\n'; <rc> = 0 >Thread-56278::DEBUG::2014-05-16 18:31:05,959::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56278::DEBUG::2014-05-16 18:31:05,959::task::579::TaskManager.Task::(_updateState) Task=`ab1d12dc-13e8-4f20-9522-ee82fa69a906`::moving from state init -> state preparing >Thread-56278::INFO::2014-05-16 18:31:05,960::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56278::INFO::2014-05-16 18:31:05,960::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56278::DEBUG::2014-05-16 18:31:05,960::task::1168::TaskManager.Task::(prepare) Task=`ab1d12dc-13e8-4f20-9522-ee82fa69a906`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56278::DEBUG::2014-05-16 18:31:05,960::task::579::TaskManager.Task::(_updateState) Task=`ab1d12dc-13e8-4f20-9522-ee82fa69a906`::moving from state preparing -> state finished >Thread-56278::DEBUG::2014-05-16 18:31:05,961::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56278::DEBUG::2014-05-16 18:31:05,961::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56278::DEBUG::2014-05-16 18:31:05,961::task::974::TaskManager.Task::(_decref) Task=`ab1d12dc-13e8-4f20-9522-ee82fa69a906`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:31:05,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-56279::DEBUG::2014-05-16 18:31:06,017::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56279::DEBUG::2014-05-16 18:31:06,019::task::579::TaskManager.Task::(_updateState) Task=`e19e9a92-d805-4002-bd1a-6f2bbec4cb35`::moving from state init -> state preparing >Thread-56279::INFO::2014-05-16 18:31:06,020::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56279::DEBUG::2014-05-16 18:31:06,022::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3b9371a4-13dd-4bb1-93ca-86d3638d3f1e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56279::DEBUG::2014-05-16 18:31:06,023::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56279::DEBUG::2014-05-16 18:31:06,024::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56279::DEBUG::2014-05-16 18:31:06,025::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`3b9371a4-13dd-4bb1-93ca-86d3638d3f1e`::Granted request >Thread-56279::DEBUG::2014-05-16 18:31:06,027::task::811::TaskManager.Task::(resourceAcquired) Task=`e19e9a92-d805-4002-bd1a-6f2bbec4cb35`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56279::DEBUG::2014-05-16 18:31:06,028::task::974::TaskManager.Task::(_decref) Task=`e19e9a92-d805-4002-bd1a-6f2bbec4cb35`::ref 1 aborting False >Thread-56279::INFO::2014-05-16 18:31:06,032::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56279::DEBUG::2014-05-16 18:31:06,032::task::1168::TaskManager.Task::(prepare) Task=`e19e9a92-d805-4002-bd1a-6f2bbec4cb35`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56279::DEBUG::2014-05-16 18:31:06,033::task::579::TaskManager.Task::(_updateState) Task=`e19e9a92-d805-4002-bd1a-6f2bbec4cb35`::moving from state preparing -> state finished >Thread-56279::DEBUG::2014-05-16 18:31:06,034::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56279::DEBUG::2014-05-16 18:31:06,035::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56279::DEBUG::2014-05-16 18:31:06,036::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56279::DEBUG::2014-05-16 18:31:06,037::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56279::DEBUG::2014-05-16 18:31:06,038::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56279::DEBUG::2014-05-16 18:31:06,039::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56279::DEBUG::2014-05-16 18:31:06,040::task::974::TaskManager.Task::(_decref) Task=`e19e9a92-d805-4002-bd1a-6f2bbec4cb35`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:31:06,063::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353791 s, 28.9 MB/s\n'; <rc> = 0 >Thread-56280::DEBUG::2014-05-16 18:31:07,434::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4313812.000000 / 8.008329 / 262500000.000000 = 0.205206 >Thread-56280::DEBUG::2014-05-16 18:31:07,434::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053024795125933607, 'statsAge': 0.21227002143859863, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20520597616517197, 'rxDropped': 0} >Thread-56280::DEBUG::2014-05-16 18:31:07,435::task::579::TaskManager.Task::(_updateState) Task=`98091cc3-1349-4bff-8bd7-d4ea4afef1d8`::moving from state init -> state preparing >Thread-56280::INFO::2014-05-16 18:31:07,435::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56280::INFO::2014-05-16 18:31:07,435::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788672', 'lastCheck': '7.4', 'valid': True}} >Thread-56280::DEBUG::2014-05-16 18:31:07,435::task::1168::TaskManager.Task::(prepare) Task=`98091cc3-1349-4bff-8bd7-d4ea4afef1d8`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788672', 'lastCheck': '7.4', 'valid': True}} >Thread-56280::DEBUG::2014-05-16 18:31:07,435::task::579::TaskManager.Task::(_updateState) Task=`98091cc3-1349-4bff-8bd7-d4ea4afef1d8`::moving from state preparing -> state finished >Thread-56280::DEBUG::2014-05-16 18:31:07,436::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56280::DEBUG::2014-05-16 18:31:07,436::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56280::DEBUG::2014-05-16 18:31:07,436::task::974::TaskManager.Task::(_decref) Task=`98091cc3-1349-4bff-8bd7-d4ea4afef1d8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:31:08,075::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:08,142::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031035 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:31:10,079::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:31:10,089::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000825449 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:10,155::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:10,226::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353966 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:12,238::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:12,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307768 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:14,316::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:14,384::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315201 s, 32.5 MB/s\n'; <rc> = 0 >Thread-56284::DEBUG::2014-05-16 18:31:16,105::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56284::DEBUG::2014-05-16 18:31:16,106::task::579::TaskManager.Task::(_updateState) Task=`032f076e-dabb-43cc-b3ee-b3b0535fc1c5`::moving from state init -> state preparing >Thread-56284::INFO::2014-05-16 18:31:16,106::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56284::INFO::2014-05-16 18:31:16,106::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56284::DEBUG::2014-05-16 18:31:16,106::task::1168::TaskManager.Task::(prepare) Task=`032f076e-dabb-43cc-b3ee-b3b0535fc1c5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56284::DEBUG::2014-05-16 18:31:16,106::task::579::TaskManager.Task::(_updateState) Task=`032f076e-dabb-43cc-b3ee-b3b0535fc1c5`::moving from state preparing -> state finished >Thread-56284::DEBUG::2014-05-16 18:31:16,107::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56284::DEBUG::2014-05-16 18:31:16,107::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56284::DEBUG::2014-05-16 18:31:16,107::task::974::TaskManager.Task::(_decref) Task=`032f076e-dabb-43cc-b3ee-b3b0535fc1c5`::ref 0 aborting False >Thread-56285::DEBUG::2014-05-16 18:31:16,115::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56285::DEBUG::2014-05-16 18:31:16,116::task::579::TaskManager.Task::(_updateState) Task=`53db39ca-d3b0-47ed-8fc2-100362dc76a1`::moving from state init -> state preparing >Thread-56285::INFO::2014-05-16 18:31:16,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56285::DEBUG::2014-05-16 18:31:16,116::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c46797e3-f4ab-41ef-8c5d-0837ddc693a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56285::DEBUG::2014-05-16 18:31:16,116::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56285::DEBUG::2014-05-16 18:31:16,117::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56285::DEBUG::2014-05-16 18:31:16,117::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c46797e3-f4ab-41ef-8c5d-0837ddc693a0`::Granted request >Thread-56285::DEBUG::2014-05-16 18:31:16,117::task::811::TaskManager.Task::(resourceAcquired) Task=`53db39ca-d3b0-47ed-8fc2-100362dc76a1`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56285::DEBUG::2014-05-16 18:31:16,117::task::974::TaskManager.Task::(_decref) Task=`53db39ca-d3b0-47ed-8fc2-100362dc76a1`::ref 1 aborting False >Thread-56285::INFO::2014-05-16 18:31:16,118::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56285::DEBUG::2014-05-16 18:31:16,118::task::1168::TaskManager.Task::(prepare) Task=`53db39ca-d3b0-47ed-8fc2-100362dc76a1`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56285::DEBUG::2014-05-16 18:31:16,118::task::579::TaskManager.Task::(_updateState) Task=`53db39ca-d3b0-47ed-8fc2-100362dc76a1`::moving from state preparing -> state finished >Thread-56285::DEBUG::2014-05-16 18:31:16,118::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56285::DEBUG::2014-05-16 18:31:16,119::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56285::DEBUG::2014-05-16 18:31:16,119::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56285::DEBUG::2014-05-16 18:31:16,119::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56285::DEBUG::2014-05-16 18:31:16,119::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56285::DEBUG::2014-05-16 18:31:16,119::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56285::DEBUG::2014-05-16 18:31:16,119::task::974::TaskManager.Task::(_decref) Task=`53db39ca-d3b0-47ed-8fc2-100362dc76a1`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:31:16,395::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:16,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03539 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:18,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:18,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304491 s, 33.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:31:20,122::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:31:20,133::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103097 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:20,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:20,634::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355129 s, 28.8 MB/s\n'; <rc> = 0 >Thread-56288::DEBUG::2014-05-16 18:31:22,613::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5421267.000000 / 8.008566 / 262500000.000000 = 0.257879 >Thread-56288::DEBUG::2014-05-16 18:31:22,613::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066417455745551484, 'statsAge': 1.3757271766662598, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25787945014346803, 'rxDropped': 0} >Thread-56288::DEBUG::2014-05-16 18:31:22,613::task::579::TaskManager.Task::(_updateState) Task=`e93d14a3-ed99-485e-a33e-da6aa57b8d13`::moving from state init -> state preparing >Thread-56288::INFO::2014-05-16 18:31:22,614::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56288::INFO::2014-05-16 18:31:22,614::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103097', 'lastCheck': '2.5', 'valid': True}} >Thread-56288::DEBUG::2014-05-16 18:31:22,614::task::1168::TaskManager.Task::(prepare) Task=`e93d14a3-ed99-485e-a33e-da6aa57b8d13`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103097', 'lastCheck': '2.5', 'valid': True}} >Thread-56288::DEBUG::2014-05-16 18:31:22,614::task::579::TaskManager.Task::(_updateState) Task=`e93d14a3-ed99-485e-a33e-da6aa57b8d13`::moving from state preparing -> state finished >Thread-56288::DEBUG::2014-05-16 18:31:22,614::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56288::DEBUG::2014-05-16 18:31:22,614::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56288::DEBUG::2014-05-16 18:31:22,615::task::974::TaskManager.Task::(_decref) Task=`e93d14a3-ed99-485e-a33e-da6aa57b8d13`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:31:22,648::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:22,719::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352873 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:24,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:24,799::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314095 s, 32.6 MB/s\n'; <rc> = 0 >Thread-56291::DEBUG::2014-05-16 18:31:26,182::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56291::DEBUG::2014-05-16 18:31:26,182::task::579::TaskManager.Task::(_updateState) Task=`a2a0e8ed-39d2-46b8-b0ae-ef9243d79c4e`::moving from state init -> state preparing >Thread-56291::INFO::2014-05-16 18:31:26,182::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56291::INFO::2014-05-16 18:31:26,183::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56291::DEBUG::2014-05-16 18:31:26,183::task::1168::TaskManager.Task::(prepare) Task=`a2a0e8ed-39d2-46b8-b0ae-ef9243d79c4e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56291::DEBUG::2014-05-16 18:31:26,183::task::579::TaskManager.Task::(_updateState) Task=`a2a0e8ed-39d2-46b8-b0ae-ef9243d79c4e`::moving from state preparing -> state finished >Thread-56291::DEBUG::2014-05-16 18:31:26,183::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56291::DEBUG::2014-05-16 18:31:26,183::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56291::DEBUG::2014-05-16 18:31:26,183::task::974::TaskManager.Task::(_decref) Task=`a2a0e8ed-39d2-46b8-b0ae-ef9243d79c4e`::ref 0 aborting False >Thread-56292::DEBUG::2014-05-16 18:31:26,209::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56292::DEBUG::2014-05-16 18:31:26,209::task::579::TaskManager.Task::(_updateState) Task=`2ef88ad7-61da-430b-bbf4-35451f1a040e`::moving from state init -> state preparing >Thread-56292::INFO::2014-05-16 18:31:26,210::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56292::DEBUG::2014-05-16 18:31:26,210::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bf80b550-47be-4e89-9e44-3520f740f2e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56292::DEBUG::2014-05-16 18:31:26,210::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56292::DEBUG::2014-05-16 18:31:26,210::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56292::DEBUG::2014-05-16 18:31:26,210::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bf80b550-47be-4e89-9e44-3520f740f2e0`::Granted request >Thread-56292::DEBUG::2014-05-16 18:31:26,211::task::811::TaskManager.Task::(resourceAcquired) Task=`2ef88ad7-61da-430b-bbf4-35451f1a040e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56292::DEBUG::2014-05-16 18:31:26,211::task::974::TaskManager.Task::(_decref) Task=`2ef88ad7-61da-430b-bbf4-35451f1a040e`::ref 1 aborting False >Thread-56292::INFO::2014-05-16 18:31:26,211::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56292::DEBUG::2014-05-16 18:31:26,212::task::1168::TaskManager.Task::(prepare) Task=`2ef88ad7-61da-430b-bbf4-35451f1a040e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56292::DEBUG::2014-05-16 18:31:26,212::task::579::TaskManager.Task::(_updateState) Task=`2ef88ad7-61da-430b-bbf4-35451f1a040e`::moving from state preparing -> state finished >Thread-56292::DEBUG::2014-05-16 18:31:26,212::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56292::DEBUG::2014-05-16 18:31:26,212::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56292::DEBUG::2014-05-16 18:31:26,212::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56292::DEBUG::2014-05-16 18:31:26,212::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56292::DEBUG::2014-05-16 18:31:26,212::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56292::DEBUG::2014-05-16 18:31:26,213::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56292::DEBUG::2014-05-16 18:31:26,213::task::974::TaskManager.Task::(_decref) Task=`2ef88ad7-61da-430b-bbf4-35451f1a040e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:31:26,810::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:26,878::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309467 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:28,889::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:28,960::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349904 s, 29.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:31:30,166::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:31:30,176::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669437 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:30,972::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:31,043::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351265 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:33,055::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:33,122::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312998 s, 32.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:35,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:35,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315915 s, 32.4 MB/s\n'; <rc> = 0 >Thread-56296::DEBUG::2014-05-16 18:31:36,252::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56296::DEBUG::2014-05-16 18:31:36,253::task::579::TaskManager.Task::(_updateState) Task=`70dc68d3-4e94-4f80-91f0-99c3be725d33`::moving from state init -> state preparing >Thread-56296::INFO::2014-05-16 18:31:36,253::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56296::INFO::2014-05-16 18:31:36,253::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56296::DEBUG::2014-05-16 18:31:36,253::task::1168::TaskManager.Task::(prepare) Task=`70dc68d3-4e94-4f80-91f0-99c3be725d33`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56296::DEBUG::2014-05-16 18:31:36,254::task::579::TaskManager.Task::(_updateState) Task=`70dc68d3-4e94-4f80-91f0-99c3be725d33`::moving from state preparing -> state finished >Thread-56296::DEBUG::2014-05-16 18:31:36,254::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56296::DEBUG::2014-05-16 18:31:36,254::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56296::DEBUG::2014-05-16 18:31:36,254::task::974::TaskManager.Task::(_decref) Task=`70dc68d3-4e94-4f80-91f0-99c3be725d33`::ref 0 aborting False >Thread-56297::DEBUG::2014-05-16 18:31:36,277::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56297::DEBUG::2014-05-16 18:31:36,277::task::579::TaskManager.Task::(_updateState) Task=`ff5dca16-8952-4767-a042-78b16ab60e1f`::moving from state init -> state preparing >Thread-56297::INFO::2014-05-16 18:31:36,277::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56297::DEBUG::2014-05-16 18:31:36,278::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0f8fe8a2-3cf2-40a3-bb12-c61f02826624`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56297::DEBUG::2014-05-16 18:31:36,278::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56297::DEBUG::2014-05-16 18:31:36,278::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56297::DEBUG::2014-05-16 18:31:36,278::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0f8fe8a2-3cf2-40a3-bb12-c61f02826624`::Granted request >Thread-56297::DEBUG::2014-05-16 18:31:36,279::task::811::TaskManager.Task::(resourceAcquired) Task=`ff5dca16-8952-4767-a042-78b16ab60e1f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56297::DEBUG::2014-05-16 18:31:36,279::task::974::TaskManager.Task::(_decref) Task=`ff5dca16-8952-4767-a042-78b16ab60e1f`::ref 1 aborting False >Thread-56297::INFO::2014-05-16 18:31:36,279::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56297::DEBUG::2014-05-16 18:31:36,280::task::1168::TaskManager.Task::(prepare) Task=`ff5dca16-8952-4767-a042-78b16ab60e1f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56297::DEBUG::2014-05-16 18:31:36,280::task::579::TaskManager.Task::(_updateState) Task=`ff5dca16-8952-4767-a042-78b16ab60e1f`::moving from state preparing -> state finished >Thread-56297::DEBUG::2014-05-16 18:31:36,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56297::DEBUG::2014-05-16 18:31:36,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56297::DEBUG::2014-05-16 18:31:36,280::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56297::DEBUG::2014-05-16 18:31:36,281::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56297::DEBUG::2014-05-16 18:31:36,281::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56297::DEBUG::2014-05-16 18:31:36,281::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56297::DEBUG::2014-05-16 18:31:36,281::task::974::TaskManager.Task::(_decref) Task=`ff5dca16-8952-4767-a042-78b16ab60e1f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:31:37,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:37,288::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379396 s, 27.0 MB/s\n'; <rc> = 0 >Thread-56298::DEBUG::2014-05-16 18:31:38,469::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4316652.000000 / 8.008625 / 262500000.000000 = 0.205333 >Thread-56298::DEBUG::2014-05-16 18:31:38,469::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053738255316207332, 'statsAge': 1.2147140502929688, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20533348731297754, 'rxDropped': 0} >Thread-56298::DEBUG::2014-05-16 18:31:38,470::task::579::TaskManager.Task::(_updateState) Task=`fd14ffcb-cece-4b62-a7a7-5f9ea9f1965e`::moving from state init -> state preparing >Thread-56298::INFO::2014-05-16 18:31:38,470::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56298::INFO::2014-05-16 18:31:38,470::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669437', 'lastCheck': '8.3', 'valid': True}} >Thread-56298::DEBUG::2014-05-16 18:31:38,470::task::1168::TaskManager.Task::(prepare) Task=`fd14ffcb-cece-4b62-a7a7-5f9ea9f1965e`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669437', 'lastCheck': '8.3', 'valid': True}} >Thread-56298::DEBUG::2014-05-16 18:31:38,470::task::579::TaskManager.Task::(_updateState) Task=`fd14ffcb-cece-4b62-a7a7-5f9ea9f1965e`::moving from state preparing -> state finished >Thread-56298::DEBUG::2014-05-16 18:31:38,470::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56298::DEBUG::2014-05-16 18:31:38,470::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56298::DEBUG::2014-05-16 18:31:38,471::task::974::TaskManager.Task::(_decref) Task=`fd14ffcb-cece-4b62-a7a7-5f9ea9f1965e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:31:39,300::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:39,366::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304293 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:31:40,212::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:31:40,222::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000735165 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:41,378::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:41,447::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312179 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:43,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:43,532::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356357 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:45,543::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:45,611::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321095 s, 31.9 MB/s\n'; <rc> = 0 >Thread-56302::DEBUG::2014-05-16 18:31:46,348::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56302::DEBUG::2014-05-16 18:31:46,349::task::579::TaskManager.Task::(_updateState) Task=`6d1ffda3-b797-4145-8b42-e01f7e56201c`::moving from state init -> state preparing >Thread-56302::INFO::2014-05-16 18:31:46,349::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56302::INFO::2014-05-16 18:31:46,349::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56302::DEBUG::2014-05-16 18:31:46,349::task::1168::TaskManager.Task::(prepare) Task=`6d1ffda3-b797-4145-8b42-e01f7e56201c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56302::DEBUG::2014-05-16 18:31:46,350::task::579::TaskManager.Task::(_updateState) Task=`6d1ffda3-b797-4145-8b42-e01f7e56201c`::moving from state preparing -> state finished >Thread-56302::DEBUG::2014-05-16 18:31:46,350::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56302::DEBUG::2014-05-16 18:31:46,350::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56302::DEBUG::2014-05-16 18:31:46,350::task::974::TaskManager.Task::(_decref) Task=`6d1ffda3-b797-4145-8b42-e01f7e56201c`::ref 0 aborting False >Thread-56303::DEBUG::2014-05-16 18:31:46,358::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56303::DEBUG::2014-05-16 18:31:46,359::task::579::TaskManager.Task::(_updateState) Task=`b1ead0e1-a55b-4c5e-9d37-71b0d2aaf2cd`::moving from state init -> state preparing >Thread-56303::INFO::2014-05-16 18:31:46,359::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56303::DEBUG::2014-05-16 18:31:46,359::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`46621b09-9eeb-4e5a-8ce9-30022194d426`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56303::DEBUG::2014-05-16 18:31:46,359::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56303::DEBUG::2014-05-16 18:31:46,360::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56303::DEBUG::2014-05-16 18:31:46,360::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`46621b09-9eeb-4e5a-8ce9-30022194d426`::Granted request >Thread-56303::DEBUG::2014-05-16 18:31:46,361::task::811::TaskManager.Task::(resourceAcquired) Task=`b1ead0e1-a55b-4c5e-9d37-71b0d2aaf2cd`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56303::DEBUG::2014-05-16 18:31:46,361::task::974::TaskManager.Task::(_decref) Task=`b1ead0e1-a55b-4c5e-9d37-71b0d2aaf2cd`::ref 1 aborting False >Thread-56303::INFO::2014-05-16 18:31:46,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56303::DEBUG::2014-05-16 18:31:46,362::task::1168::TaskManager.Task::(prepare) Task=`b1ead0e1-a55b-4c5e-9d37-71b0d2aaf2cd`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56303::DEBUG::2014-05-16 18:31:46,362::task::579::TaskManager.Task::(_updateState) Task=`b1ead0e1-a55b-4c5e-9d37-71b0d2aaf2cd`::moving from state preparing -> state finished >Thread-56303::DEBUG::2014-05-16 18:31:46,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56303::DEBUG::2014-05-16 18:31:46,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56303::DEBUG::2014-05-16 18:31:46,363::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56303::DEBUG::2014-05-16 18:31:46,363::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56303::DEBUG::2014-05-16 18:31:46,363::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56303::DEBUG::2014-05-16 18:31:46,363::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56303::DEBUG::2014-05-16 18:31:46,363::task::974::TaskManager.Task::(_decref) Task=`b1ead0e1-a55b-4c5e-9d37-71b0d2aaf2cd`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:31:47,623::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:47,690::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307215 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:49,701::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:49,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356506 s, 28.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:31:50,243::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 18:31:50,243::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:31:50,258::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:31:50,266::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000588411 s, 3.5 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:31:50,266::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000588411 s, 3.5 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 18:31:50,267::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 18:31:50,267::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 18:31:50,267::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:31:50,267::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:31:50,268::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:31:50,268::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:31:50,268::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:31:50,268::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:31:50,269::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:31:50,442::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:31:50,443::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:31:50,444::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 18:31:50,445::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 18:31:50,445::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 18:31:50,445::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 18:31:50,446::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:31:50,589::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:31:50,610::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:31:50,621::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580452 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:51,784::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:51,857::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346691 s, 29.5 MB/s\n'; <rc> = 0 >Thread-56306::DEBUG::2014-05-16 18:31:53,674::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4436419.000000 / 8.008491 / 262500000.000000 = 0.211034 >Thread-56306::DEBUG::2014-05-16 18:31:53,674::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005795372717353457, 'statsAge': 0.40003204345703125, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.21103406030721408, 'rxDropped': 0} >Thread-56306::DEBUG::2014-05-16 18:31:53,675::task::579::TaskManager.Task::(_updateState) Task=`1fbeb3c9-6028-4307-b704-9ba39b236514`::moving from state init -> state preparing >Thread-56306::INFO::2014-05-16 18:31:53,675::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56306::INFO::2014-05-16 18:31:53,675::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580452', 'lastCheck': '3.0', 'valid': True}} >Thread-56306::DEBUG::2014-05-16 18:31:53,675::task::1168::TaskManager.Task::(prepare) Task=`1fbeb3c9-6028-4307-b704-9ba39b236514`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580452', 'lastCheck': '3.0', 'valid': True}} >Thread-56306::DEBUG::2014-05-16 18:31:53,675::task::579::TaskManager.Task::(_updateState) Task=`1fbeb3c9-6028-4307-b704-9ba39b236514`::moving from state preparing -> state finished >Thread-56306::DEBUG::2014-05-16 18:31:53,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56306::DEBUG::2014-05-16 18:31:53,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56306::DEBUG::2014-05-16 18:31:53,676::task::974::TaskManager.Task::(_decref) Task=`1fbeb3c9-6028-4307-b704-9ba39b236514`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:31:53,869::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:53,937::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308443 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:31:55,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:56,020::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361043 s, 28.4 MB/s\n'; <rc> = 0 >Thread-56308::DEBUG::2014-05-16 18:31:56,410::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56308::DEBUG::2014-05-16 18:31:56,410::task::579::TaskManager.Task::(_updateState) Task=`e2774e5b-5711-4b13-a084-5ba471d105bd`::moving from state init -> state preparing >Thread-56308::INFO::2014-05-16 18:31:56,410::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56308::INFO::2014-05-16 18:31:56,411::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56308::DEBUG::2014-05-16 18:31:56,411::task::1168::TaskManager.Task::(prepare) Task=`e2774e5b-5711-4b13-a084-5ba471d105bd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56308::DEBUG::2014-05-16 18:31:56,411::task::579::TaskManager.Task::(_updateState) Task=`e2774e5b-5711-4b13-a084-5ba471d105bd`::moving from state preparing -> state finished >Thread-56308::DEBUG::2014-05-16 18:31:56,411::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56308::DEBUG::2014-05-16 18:31:56,411::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56308::DEBUG::2014-05-16 18:31:56,411::task::974::TaskManager.Task::(_decref) Task=`e2774e5b-5711-4b13-a084-5ba471d105bd`::ref 0 aborting False >Thread-56309::DEBUG::2014-05-16 18:31:56,419::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56309::DEBUG::2014-05-16 18:31:56,420::task::579::TaskManager.Task::(_updateState) Task=`ea632248-ded3-4090-a662-46850a9e7e2a`::moving from state init -> state preparing >Thread-56309::INFO::2014-05-16 18:31:56,420::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56309::DEBUG::2014-05-16 18:31:56,420::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`330b6373-df83-45bd-89a4-79158466c3ff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56309::DEBUG::2014-05-16 18:31:56,420::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56309::DEBUG::2014-05-16 18:31:56,420::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56309::DEBUG::2014-05-16 18:31:56,421::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`330b6373-df83-45bd-89a4-79158466c3ff`::Granted request >Thread-56309::DEBUG::2014-05-16 18:31:56,421::task::811::TaskManager.Task::(resourceAcquired) Task=`ea632248-ded3-4090-a662-46850a9e7e2a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56309::DEBUG::2014-05-16 18:31:56,421::task::974::TaskManager.Task::(_decref) Task=`ea632248-ded3-4090-a662-46850a9e7e2a`::ref 1 aborting False >Thread-56309::INFO::2014-05-16 18:31:56,422::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56309::DEBUG::2014-05-16 18:31:56,422::task::1168::TaskManager.Task::(prepare) Task=`ea632248-ded3-4090-a662-46850a9e7e2a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56309::DEBUG::2014-05-16 18:31:56,422::task::579::TaskManager.Task::(_updateState) Task=`ea632248-ded3-4090-a662-46850a9e7e2a`::moving from state preparing -> state finished >Thread-56309::DEBUG::2014-05-16 18:31:56,422::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56309::DEBUG::2014-05-16 18:31:56,422::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56309::DEBUG::2014-05-16 18:31:56,422::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56309::DEBUG::2014-05-16 18:31:56,423::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56309::DEBUG::2014-05-16 18:31:56,423::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56309::DEBUG::2014-05-16 18:31:56,423::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56309::DEBUG::2014-05-16 18:31:56,423::task::974::TaskManager.Task::(_decref) Task=`ea632248-ded3-4090-a662-46850a9e7e2a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:31:58,032::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:31:58,099::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308662 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:00,110::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:00,178::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314371 s, 32.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:32:00,657::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:32:00,667::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760418 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:02,190::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:02,256::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.030571 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:04,268::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:04,340::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354249 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:06,352::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:06,424::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364337 s, 28.1 MB/s\n'; <rc> = 0 >Thread-56314::DEBUG::2014-05-16 18:32:06,512::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56314::DEBUG::2014-05-16 18:32:06,512::task::579::TaskManager.Task::(_updateState) Task=`e78d7d6f-6785-4d85-8a21-b4173c1bd8af`::moving from state init -> state preparing >Thread-56314::INFO::2014-05-16 18:32:06,512::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56314::INFO::2014-05-16 18:32:06,513::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56314::DEBUG::2014-05-16 18:32:06,513::task::1168::TaskManager.Task::(prepare) Task=`e78d7d6f-6785-4d85-8a21-b4173c1bd8af`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56314::DEBUG::2014-05-16 18:32:06,513::task::579::TaskManager.Task::(_updateState) Task=`e78d7d6f-6785-4d85-8a21-b4173c1bd8af`::moving from state preparing -> state finished >Thread-56314::DEBUG::2014-05-16 18:32:06,513::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56314::DEBUG::2014-05-16 18:32:06,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56314::DEBUG::2014-05-16 18:32:06,513::task::974::TaskManager.Task::(_decref) Task=`e78d7d6f-6785-4d85-8a21-b4173c1bd8af`::ref 0 aborting False >Thread-56315::DEBUG::2014-05-16 18:32:06,557::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56315::DEBUG::2014-05-16 18:32:06,557::task::579::TaskManager.Task::(_updateState) Task=`4b5b4863-3cf0-4079-8873-ea04f93c17ba`::moving from state init -> state preparing >Thread-56315::INFO::2014-05-16 18:32:06,557::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56315::DEBUG::2014-05-16 18:32:06,558::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9bb74d55-83b5-4938-97d7-c1780769db22`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56315::DEBUG::2014-05-16 18:32:06,558::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56315::DEBUG::2014-05-16 18:32:06,558::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56315::DEBUG::2014-05-16 18:32:06,558::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`9bb74d55-83b5-4938-97d7-c1780769db22`::Granted request >Thread-56315::DEBUG::2014-05-16 18:32:06,558::task::811::TaskManager.Task::(resourceAcquired) Task=`4b5b4863-3cf0-4079-8873-ea04f93c17ba`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56315::DEBUG::2014-05-16 18:32:06,559::task::974::TaskManager.Task::(_decref) Task=`4b5b4863-3cf0-4079-8873-ea04f93c17ba`::ref 1 aborting False >Thread-56315::INFO::2014-05-16 18:32:06,559::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56315::DEBUG::2014-05-16 18:32:06,559::task::1168::TaskManager.Task::(prepare) Task=`4b5b4863-3cf0-4079-8873-ea04f93c17ba`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56315::DEBUG::2014-05-16 18:32:06,560::task::579::TaskManager.Task::(_updateState) Task=`4b5b4863-3cf0-4079-8873-ea04f93c17ba`::moving from state preparing -> state finished >Thread-56315::DEBUG::2014-05-16 18:32:06,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56315::DEBUG::2014-05-16 18:32:06,560::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56315::DEBUG::2014-05-16 18:32:06,560::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56315::DEBUG::2014-05-16 18:32:06,560::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56315::DEBUG::2014-05-16 18:32:06,560::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56315::DEBUG::2014-05-16 18:32:06,561::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56315::DEBUG::2014-05-16 18:32:06,561::task::974::TaskManager.Task::(_decref) Task=`4b5b4863-3cf0-4079-8873-ea04f93c17ba`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:32:08,435::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:08,504::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312516 s, 32.8 MB/s\n'; <rc> = 0 >Thread-56316::DEBUG::2014-05-16 18:32:08,921::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5418241.000000 / 8.008556 / 262500000.000000 = 0.257736 >Thread-56316::DEBUG::2014-05-16 18:32:08,922::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066517429976688898, 'statsAge': 1.6326689720153809, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25773582361789876, 'rxDropped': 0} >Thread-56316::DEBUG::2014-05-16 18:32:08,922::task::579::TaskManager.Task::(_updateState) Task=`85b06884-a6ee-410d-ab77-56f0621b0fa0`::moving from state init -> state preparing >Thread-56316::INFO::2014-05-16 18:32:08,922::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56316::INFO::2014-05-16 18:32:08,923::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760418', 'lastCheck': '8.2', 'valid': True}} >Thread-56316::DEBUG::2014-05-16 18:32:08,923::task::1168::TaskManager.Task::(prepare) Task=`85b06884-a6ee-410d-ab77-56f0621b0fa0`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760418', 'lastCheck': '8.2', 'valid': True}} >Thread-56316::DEBUG::2014-05-16 18:32:08,923::task::579::TaskManager.Task::(_updateState) Task=`85b06884-a6ee-410d-ab77-56f0621b0fa0`::moving from state preparing -> state finished >Thread-56316::DEBUG::2014-05-16 18:32:08,923::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56316::DEBUG::2014-05-16 18:32:08,923::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56316::DEBUG::2014-05-16 18:32:08,923::task::974::TaskManager.Task::(_decref) Task=`85b06884-a6ee-410d-ab77-56f0621b0fa0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:32:10,516::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:10,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356597 s, 28.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:32:10,705::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:32:10,715::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00076163 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:12,599::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:12,778::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305776 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:14,808::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:14,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317467 s, 32.3 MB/s\n'; <rc> = 0 >Thread-56320::DEBUG::2014-05-16 18:32:16,632::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56320::DEBUG::2014-05-16 18:32:16,633::task::579::TaskManager.Task::(_updateState) Task=`1cb517da-6bd9-4a50-a875-8eb87e098944`::moving from state init -> state preparing >Thread-56320::INFO::2014-05-16 18:32:16,633::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56320::INFO::2014-05-16 18:32:16,633::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56320::DEBUG::2014-05-16 18:32:16,633::task::1168::TaskManager.Task::(prepare) Task=`1cb517da-6bd9-4a50-a875-8eb87e098944`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56320::DEBUG::2014-05-16 18:32:16,634::task::579::TaskManager.Task::(_updateState) Task=`1cb517da-6bd9-4a50-a875-8eb87e098944`::moving from state preparing -> state finished >Thread-56320::DEBUG::2014-05-16 18:32:16,634::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56320::DEBUG::2014-05-16 18:32:16,634::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56320::DEBUG::2014-05-16 18:32:16,634::task::974::TaskManager.Task::(_decref) Task=`1cb517da-6bd9-4a50-a875-8eb87e098944`::ref 0 aborting False >Thread-56321::DEBUG::2014-05-16 18:32:16,675::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56321::DEBUG::2014-05-16 18:32:16,675::task::579::TaskManager.Task::(_updateState) Task=`a4dea8a6-11c7-407e-9f8d-60ceca2a7906`::moving from state init -> state preparing >Thread-56321::INFO::2014-05-16 18:32:16,675::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56321::DEBUG::2014-05-16 18:32:16,676::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`592e9721-924e-4933-add8-d2d1028824b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56321::DEBUG::2014-05-16 18:32:16,676::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56321::DEBUG::2014-05-16 18:32:16,676::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56321::DEBUG::2014-05-16 18:32:16,676::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`592e9721-924e-4933-add8-d2d1028824b2`::Granted request >Thread-56321::DEBUG::2014-05-16 18:32:16,677::task::811::TaskManager.Task::(resourceAcquired) Task=`a4dea8a6-11c7-407e-9f8d-60ceca2a7906`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56321::DEBUG::2014-05-16 18:32:16,677::task::974::TaskManager.Task::(_decref) Task=`a4dea8a6-11c7-407e-9f8d-60ceca2a7906`::ref 1 aborting False >Thread-56321::INFO::2014-05-16 18:32:16,678::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56321::DEBUG::2014-05-16 18:32:16,678::task::1168::TaskManager.Task::(prepare) Task=`a4dea8a6-11c7-407e-9f8d-60ceca2a7906`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56321::DEBUG::2014-05-16 18:32:16,678::task::579::TaskManager.Task::(_updateState) Task=`a4dea8a6-11c7-407e-9f8d-60ceca2a7906`::moving from state preparing -> state finished >Thread-56321::DEBUG::2014-05-16 18:32:16,678::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56321::DEBUG::2014-05-16 18:32:16,678::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56321::DEBUG::2014-05-16 18:32:16,678::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56321::DEBUG::2014-05-16 18:32:16,679::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56321::DEBUG::2014-05-16 18:32:16,679::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56321::DEBUG::2014-05-16 18:32:16,679::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56321::DEBUG::2014-05-16 18:32:16,679::task::974::TaskManager.Task::(_decref) Task=`a4dea8a6-11c7-407e-9f8d-60ceca2a7906`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:32:16,888::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:16,959::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351768 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:18,970::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:19,038::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313097 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:32:20,750::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:32:20,760::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000947538 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:21,049::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:21,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355465 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:23,133::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:23,200::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310539 s, 33.0 MB/s\n'; <rc> = 0 >Thread-56324::DEBUG::2014-05-16 18:32:24,209::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5415056.000000 / 8.008596 / 262500000.000000 = 0.257583 >Thread-56324::DEBUG::2014-05-16 18:32:24,209::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0067626383547951504, 'statsAge': 0.90351200103759766, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25758303836984137, 'rxDropped': 0} >Thread-56324::DEBUG::2014-05-16 18:32:24,210::task::579::TaskManager.Task::(_updateState) Task=`39a5b910-d225-4cdd-854b-ff0f8c523f85`::moving from state init -> state preparing >Thread-56324::INFO::2014-05-16 18:32:24,210::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56324::INFO::2014-05-16 18:32:24,210::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000947538', 'lastCheck': '3.4', 'valid': True}} >Thread-56324::DEBUG::2014-05-16 18:32:24,211::task::1168::TaskManager.Task::(prepare) Task=`39a5b910-d225-4cdd-854b-ff0f8c523f85`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000947538', 'lastCheck': '3.4', 'valid': True}} >Thread-56324::DEBUG::2014-05-16 18:32:24,211::task::579::TaskManager.Task::(_updateState) Task=`39a5b910-d225-4cdd-854b-ff0f8c523f85`::moving from state preparing -> state finished >Thread-56324::DEBUG::2014-05-16 18:32:24,211::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56324::DEBUG::2014-05-16 18:32:24,211::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56324::DEBUG::2014-05-16 18:32:24,211::task::974::TaskManager.Task::(_decref) Task=`39a5b910-d225-4cdd-854b-ff0f8c523f85`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:32:25,211::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:25,283::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355758 s, 28.8 MB/s\n'; <rc> = 0 >Thread-56326::DEBUG::2014-05-16 18:32:26,734::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56326::DEBUG::2014-05-16 18:32:26,734::task::579::TaskManager.Task::(_updateState) Task=`3ba60645-9dbf-40b4-bdf1-7edfededdb74`::moving from state init -> state preparing >Thread-56326::INFO::2014-05-16 18:32:26,734::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56326::INFO::2014-05-16 18:32:26,735::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56326::DEBUG::2014-05-16 18:32:26,735::task::1168::TaskManager.Task::(prepare) Task=`3ba60645-9dbf-40b4-bdf1-7edfededdb74`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56326::DEBUG::2014-05-16 18:32:26,735::task::579::TaskManager.Task::(_updateState) Task=`3ba60645-9dbf-40b4-bdf1-7edfededdb74`::moving from state preparing -> state finished >Thread-56326::DEBUG::2014-05-16 18:32:26,735::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56326::DEBUG::2014-05-16 18:32:26,735::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56326::DEBUG::2014-05-16 18:32:26,735::task::974::TaskManager.Task::(_decref) Task=`3ba60645-9dbf-40b4-bdf1-7edfededdb74`::ref 0 aborting False >Thread-56327::DEBUG::2014-05-16 18:32:26,765::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56327::DEBUG::2014-05-16 18:32:26,765::task::579::TaskManager.Task::(_updateState) Task=`ef3c81b3-27db-4b82-912d-e5946e46948a`::moving from state init -> state preparing >Thread-56327::INFO::2014-05-16 18:32:26,765::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56327::DEBUG::2014-05-16 18:32:26,766::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f6b1a30e-e43a-4765-98da-01217f1ac776`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56327::DEBUG::2014-05-16 18:32:26,766::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56327::DEBUG::2014-05-16 18:32:26,766::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56327::DEBUG::2014-05-16 18:32:26,766::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f6b1a30e-e43a-4765-98da-01217f1ac776`::Granted request >Thread-56327::DEBUG::2014-05-16 18:32:26,767::task::811::TaskManager.Task::(resourceAcquired) Task=`ef3c81b3-27db-4b82-912d-e5946e46948a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56327::DEBUG::2014-05-16 18:32:26,767::task::974::TaskManager.Task::(_decref) Task=`ef3c81b3-27db-4b82-912d-e5946e46948a`::ref 1 aborting False >Thread-56327::INFO::2014-05-16 18:32:26,767::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56327::DEBUG::2014-05-16 18:32:26,767::task::1168::TaskManager.Task::(prepare) Task=`ef3c81b3-27db-4b82-912d-e5946e46948a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56327::DEBUG::2014-05-16 18:32:26,768::task::579::TaskManager.Task::(_updateState) Task=`ef3c81b3-27db-4b82-912d-e5946e46948a`::moving from state preparing -> state finished >Thread-56327::DEBUG::2014-05-16 18:32:26,768::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56327::DEBUG::2014-05-16 18:32:26,768::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56327::DEBUG::2014-05-16 18:32:26,768::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56327::DEBUG::2014-05-16 18:32:26,768::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56327::DEBUG::2014-05-16 18:32:26,768::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56327::DEBUG::2014-05-16 18:32:26,768::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56327::DEBUG::2014-05-16 18:32:26,769::task::974::TaskManager.Task::(_decref) Task=`ef3c81b3-27db-4b82-912d-e5946e46948a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:32:27,294::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:27,367::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326706 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:29,379::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:29,447::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316924 s, 32.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:32:30,798::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:32:30,808::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000859015 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:31,458::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:31,529::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351086 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:33,541::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:33,608::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310699 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:35,620::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:35,687::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314537 s, 32.6 MB/s\n'; <rc> = 0 >Thread-56332::DEBUG::2014-05-16 18:32:36,810::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56332::DEBUG::2014-05-16 18:32:36,812::task::579::TaskManager.Task::(_updateState) Task=`0a1e59da-9a4b-47bd-90c0-7645adbb408b`::moving from state init -> state preparing >Thread-56332::INFO::2014-05-16 18:32:36,812::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56332::INFO::2014-05-16 18:32:36,812::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56332::DEBUG::2014-05-16 18:32:36,812::task::1168::TaskManager.Task::(prepare) Task=`0a1e59da-9a4b-47bd-90c0-7645adbb408b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56332::DEBUG::2014-05-16 18:32:36,813::task::579::TaskManager.Task::(_updateState) Task=`0a1e59da-9a4b-47bd-90c0-7645adbb408b`::moving from state preparing -> state finished >Thread-56332::DEBUG::2014-05-16 18:32:36,813::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56332::DEBUG::2014-05-16 18:32:36,813::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56332::DEBUG::2014-05-16 18:32:36,813::task::974::TaskManager.Task::(_decref) Task=`0a1e59da-9a4b-47bd-90c0-7645adbb408b`::ref 0 aborting False >Thread-56333::DEBUG::2014-05-16 18:32:36,821::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56333::DEBUG::2014-05-16 18:32:36,822::task::579::TaskManager.Task::(_updateState) Task=`96f3f50a-78bb-486e-9420-056476aa39a6`::moving from state init -> state preparing >Thread-56333::INFO::2014-05-16 18:32:36,822::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56333::DEBUG::2014-05-16 18:32:36,822::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0b83b997-a0e0-4a39-b53c-96d483403edb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56333::DEBUG::2014-05-16 18:32:36,822::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56333::DEBUG::2014-05-16 18:32:36,823::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56333::DEBUG::2014-05-16 18:32:36,823::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0b83b997-a0e0-4a39-b53c-96d483403edb`::Granted request >Thread-56333::DEBUG::2014-05-16 18:32:36,823::task::811::TaskManager.Task::(resourceAcquired) Task=`96f3f50a-78bb-486e-9420-056476aa39a6`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56333::DEBUG::2014-05-16 18:32:36,823::task::974::TaskManager.Task::(_decref) Task=`96f3f50a-78bb-486e-9420-056476aa39a6`::ref 1 aborting False >Thread-56333::INFO::2014-05-16 18:32:36,824::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56333::DEBUG::2014-05-16 18:32:36,824::task::1168::TaskManager.Task::(prepare) Task=`96f3f50a-78bb-486e-9420-056476aa39a6`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56333::DEBUG::2014-05-16 18:32:36,824::task::579::TaskManager.Task::(_updateState) Task=`96f3f50a-78bb-486e-9420-056476aa39a6`::moving from state preparing -> state finished >Thread-56333::DEBUG::2014-05-16 18:32:36,824::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56333::DEBUG::2014-05-16 18:32:36,825::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56333::DEBUG::2014-05-16 18:32:36,825::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56333::DEBUG::2014-05-16 18:32:36,825::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56333::DEBUG::2014-05-16 18:32:36,825::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56333::DEBUG::2014-05-16 18:32:36,825::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56333::DEBUG::2014-05-16 18:32:36,826::task::974::TaskManager.Task::(_decref) Task=`96f3f50a-78bb-486e-9420-056476aa39a6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:32:37,698::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:37,770::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352687 s, 29.0 MB/s\n'; <rc> = 0 >Thread-56334::DEBUG::2014-05-16 18:32:39,452::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4314142.000000 / 8.008335 / 262500000.000000 = 0.205222 >Thread-56334::DEBUG::2014-05-16 18:32:39,452::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053129408531685605, 'statsAge': 0.12957406044006348, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20522152136460783, 'rxDropped': 0} >Thread-56334::DEBUG::2014-05-16 18:32:39,453::task::579::TaskManager.Task::(_updateState) Task=`877a9b9b-2f7e-4b2a-aee8-157c9dc35c0c`::moving from state init -> state preparing >Thread-56334::INFO::2014-05-16 18:32:39,453::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56334::INFO::2014-05-16 18:32:39,453::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000859015', 'lastCheck': '8.6', 'valid': True}} >Thread-56334::DEBUG::2014-05-16 18:32:39,453::task::1168::TaskManager.Task::(prepare) Task=`877a9b9b-2f7e-4b2a-aee8-157c9dc35c0c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000859015', 'lastCheck': '8.6', 'valid': True}} >Thread-56334::DEBUG::2014-05-16 18:32:39,454::task::579::TaskManager.Task::(_updateState) Task=`877a9b9b-2f7e-4b2a-aee8-157c9dc35c0c`::moving from state preparing -> state finished >Thread-56334::DEBUG::2014-05-16 18:32:39,454::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56334::DEBUG::2014-05-16 18:32:39,454::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56334::DEBUG::2014-05-16 18:32:39,454::task::974::TaskManager.Task::(_decref) Task=`877a9b9b-2f7e-4b2a-aee8-157c9dc35c0c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:32:39,781::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:39,855::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319989 s, 32.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:32:40,846::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:32:40,856::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599628 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:41,867::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:41,934::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306045 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:43,946::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:44,018::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03581 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:46,030::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:46,102::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036074 s, 28.4 MB/s\n'; <rc> = 0 >Thread-56338::DEBUG::2014-05-16 18:32:46,971::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56338::DEBUG::2014-05-16 18:32:46,972::task::579::TaskManager.Task::(_updateState) Task=`540bdddd-79b4-48cf-956b-116f74cf3849`::moving from state init -> state preparing >Thread-56338::INFO::2014-05-16 18:32:46,972::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56338::INFO::2014-05-16 18:32:46,972::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56338::DEBUG::2014-05-16 18:32:46,972::task::1168::TaskManager.Task::(prepare) Task=`540bdddd-79b4-48cf-956b-116f74cf3849`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56338::DEBUG::2014-05-16 18:32:46,973::task::579::TaskManager.Task::(_updateState) Task=`540bdddd-79b4-48cf-956b-116f74cf3849`::moving from state preparing -> state finished >Thread-56338::DEBUG::2014-05-16 18:32:46,973::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56338::DEBUG::2014-05-16 18:32:46,973::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56338::DEBUG::2014-05-16 18:32:46,973::task::974::TaskManager.Task::(_decref) Task=`540bdddd-79b4-48cf-956b-116f74cf3849`::ref 0 aborting False >Thread-56339::DEBUG::2014-05-16 18:32:47,009::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56339::DEBUG::2014-05-16 18:32:47,009::task::579::TaskManager.Task::(_updateState) Task=`cfb08598-7cd4-4b80-a9ff-593f838db10b`::moving from state init -> state preparing >Thread-56339::INFO::2014-05-16 18:32:47,009::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56339::DEBUG::2014-05-16 18:32:47,010::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7bb2007d-e501-412c-b2c4-5ef8ebb6d8df`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56339::DEBUG::2014-05-16 18:32:47,010::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56339::DEBUG::2014-05-16 18:32:47,010::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56339::DEBUG::2014-05-16 18:32:47,010::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`7bb2007d-e501-412c-b2c4-5ef8ebb6d8df`::Granted request >Thread-56339::DEBUG::2014-05-16 18:32:47,010::task::811::TaskManager.Task::(resourceAcquired) Task=`cfb08598-7cd4-4b80-a9ff-593f838db10b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56339::DEBUG::2014-05-16 18:32:47,011::task::974::TaskManager.Task::(_decref) Task=`cfb08598-7cd4-4b80-a9ff-593f838db10b`::ref 1 aborting False >Thread-56339::INFO::2014-05-16 18:32:47,011::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56339::DEBUG::2014-05-16 18:32:47,011::task::1168::TaskManager.Task::(prepare) Task=`cfb08598-7cd4-4b80-a9ff-593f838db10b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56339::DEBUG::2014-05-16 18:32:47,012::task::579::TaskManager.Task::(_updateState) Task=`cfb08598-7cd4-4b80-a9ff-593f838db10b`::moving from state preparing -> state finished >Thread-56339::DEBUG::2014-05-16 18:32:47,012::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56339::DEBUG::2014-05-16 18:32:47,012::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56339::DEBUG::2014-05-16 18:32:47,012::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56339::DEBUG::2014-05-16 18:32:47,012::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56339::DEBUG::2014-05-16 18:32:47,012::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56339::DEBUG::2014-05-16 18:32:47,013::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56339::DEBUG::2014-05-16 18:32:47,013::task::974::TaskManager.Task::(_decref) Task=`cfb08598-7cd4-4b80-a9ff-593f838db10b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:32:48,113::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:48,180::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310791 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:50,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:50,261::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313238 s, 32.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:32:50,893::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:32:50,903::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000844421 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:52,273::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:52,346::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367707 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:32:54,358::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:54,424::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311664 s, 32.9 MB/s\n'; <rc> = 0 >Thread-56342::DEBUG::2014-05-16 18:32:54,801::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317030.000000 / 8.008606 / 262500000.000000 = 0.205352 >Thread-56342::DEBUG::2014-05-16 18:32:54,801::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '18.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053422530999215016, 'statsAge': 1.4636240005493164, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20535195088465755, 'rxDropped': 0} >Thread-56342::DEBUG::2014-05-16 18:32:54,802::task::579::TaskManager.Task::(_updateState) Task=`c82fdf5c-897c-475d-89dd-f71f341170d0`::moving from state init -> state preparing >Thread-56342::INFO::2014-05-16 18:32:54,802::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56342::INFO::2014-05-16 18:32:54,802::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000844421', 'lastCheck': '3.9', 'valid': True}} >Thread-56342::DEBUG::2014-05-16 18:32:54,803::task::1168::TaskManager.Task::(prepare) Task=`c82fdf5c-897c-475d-89dd-f71f341170d0`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000844421', 'lastCheck': '3.9', 'valid': True}} >Thread-56342::DEBUG::2014-05-16 18:32:54,803::task::579::TaskManager.Task::(_updateState) Task=`c82fdf5c-897c-475d-89dd-f71f341170d0`::moving from state preparing -> state finished >Thread-56342::DEBUG::2014-05-16 18:32:54,803::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56342::DEBUG::2014-05-16 18:32:54,803::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56342::DEBUG::2014-05-16 18:32:54,803::task::974::TaskManager.Task::(_decref) Task=`c82fdf5c-897c-475d-89dd-f71f341170d0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:32:56,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:56,505::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316314 s, 32.4 MB/s\n'; <rc> = 0 >Thread-56344::DEBUG::2014-05-16 18:32:57,095::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56344::DEBUG::2014-05-16 18:32:57,095::task::579::TaskManager.Task::(_updateState) Task=`296ddf57-67a6-4de6-ad1b-5070666acd0c`::moving from state init -> state preparing >Thread-56344::INFO::2014-05-16 18:32:57,096::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56344::INFO::2014-05-16 18:32:57,096::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56344::DEBUG::2014-05-16 18:32:57,096::task::1168::TaskManager.Task::(prepare) Task=`296ddf57-67a6-4de6-ad1b-5070666acd0c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56344::DEBUG::2014-05-16 18:32:57,096::task::579::TaskManager.Task::(_updateState) Task=`296ddf57-67a6-4de6-ad1b-5070666acd0c`::moving from state preparing -> state finished >Thread-56344::DEBUG::2014-05-16 18:32:57,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56344::DEBUG::2014-05-16 18:32:57,097::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56344::DEBUG::2014-05-16 18:32:57,097::task::974::TaskManager.Task::(_decref) Task=`296ddf57-67a6-4de6-ad1b-5070666acd0c`::ref 0 aborting False >Thread-56345::DEBUG::2014-05-16 18:32:57,133::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56345::DEBUG::2014-05-16 18:32:57,133::task::579::TaskManager.Task::(_updateState) Task=`4ba86e32-673c-41ba-acd7-73421c9eec85`::moving from state init -> state preparing >Thread-56345::INFO::2014-05-16 18:32:57,133::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56345::DEBUG::2014-05-16 18:32:57,134::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a8f5e196-05ee-48ff-882f-954d7890b10e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56345::DEBUG::2014-05-16 18:32:57,134::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56345::DEBUG::2014-05-16 18:32:57,134::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56345::DEBUG::2014-05-16 18:32:57,134::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`a8f5e196-05ee-48ff-882f-954d7890b10e`::Granted request >Thread-56345::DEBUG::2014-05-16 18:32:57,135::task::811::TaskManager.Task::(resourceAcquired) Task=`4ba86e32-673c-41ba-acd7-73421c9eec85`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56345::DEBUG::2014-05-16 18:32:57,135::task::974::TaskManager.Task::(_decref) Task=`4ba86e32-673c-41ba-acd7-73421c9eec85`::ref 1 aborting False >Thread-56345::INFO::2014-05-16 18:32:57,135::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56345::DEBUG::2014-05-16 18:32:57,135::task::1168::TaskManager.Task::(prepare) Task=`4ba86e32-673c-41ba-acd7-73421c9eec85`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56345::DEBUG::2014-05-16 18:32:57,136::task::579::TaskManager.Task::(_updateState) Task=`4ba86e32-673c-41ba-acd7-73421c9eec85`::moving from state preparing -> state finished >Thread-56345::DEBUG::2014-05-16 18:32:57,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56345::DEBUG::2014-05-16 18:32:57,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56345::DEBUG::2014-05-16 18:32:57,136::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56345::DEBUG::2014-05-16 18:32:57,136::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56345::DEBUG::2014-05-16 18:32:57,137::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56345::DEBUG::2014-05-16 18:32:57,137::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56345::DEBUG::2014-05-16 18:32:57,137::task::974::TaskManager.Task::(_decref) Task=`4ba86e32-673c-41ba-acd7-73421c9eec85`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:32:58,517::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:32:58,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350959 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:00,599::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:00,665::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299811 s, 34.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:33:00,941::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:33:00,952::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703481 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:02,677::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:02,744::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306625 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:04,755::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:04,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357811 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:06,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:06,910::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354573 s, 28.9 MB/s\n'; <rc> = 0 >Thread-56350::DEBUG::2014-05-16 18:33:07,218::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56350::DEBUG::2014-05-16 18:33:07,219::task::579::TaskManager.Task::(_updateState) Task=`db96c8a2-9f50-49d0-9628-06eedd387bf3`::moving from state init -> state preparing >Thread-56350::INFO::2014-05-16 18:33:07,219::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56350::INFO::2014-05-16 18:33:07,219::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56350::DEBUG::2014-05-16 18:33:07,219::task::1168::TaskManager.Task::(prepare) Task=`db96c8a2-9f50-49d0-9628-06eedd387bf3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56350::DEBUG::2014-05-16 18:33:07,220::task::579::TaskManager.Task::(_updateState) Task=`db96c8a2-9f50-49d0-9628-06eedd387bf3`::moving from state preparing -> state finished >Thread-56350::DEBUG::2014-05-16 18:33:07,220::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56350::DEBUG::2014-05-16 18:33:07,220::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56350::DEBUG::2014-05-16 18:33:07,220::task::974::TaskManager.Task::(_decref) Task=`db96c8a2-9f50-49d0-9628-06eedd387bf3`::ref 0 aborting False >Thread-56351::DEBUG::2014-05-16 18:33:07,229::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56351::DEBUG::2014-05-16 18:33:07,230::task::579::TaskManager.Task::(_updateState) Task=`610abd50-b5a7-4258-867f-3bbd591d28d2`::moving from state init -> state preparing >Thread-56351::INFO::2014-05-16 18:33:07,230::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56351::DEBUG::2014-05-16 18:33:07,230::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4b328184-6594-46aa-b1c4-d2d00225c03b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56351::DEBUG::2014-05-16 18:33:07,230::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56351::DEBUG::2014-05-16 18:33:07,231::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56351::DEBUG::2014-05-16 18:33:07,231::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`4b328184-6594-46aa-b1c4-d2d00225c03b`::Granted request >Thread-56351::DEBUG::2014-05-16 18:33:07,231::task::811::TaskManager.Task::(resourceAcquired) Task=`610abd50-b5a7-4258-867f-3bbd591d28d2`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56351::DEBUG::2014-05-16 18:33:07,231::task::974::TaskManager.Task::(_decref) Task=`610abd50-b5a7-4258-867f-3bbd591d28d2`::ref 1 aborting False >Thread-56351::INFO::2014-05-16 18:33:07,232::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56351::DEBUG::2014-05-16 18:33:07,232::task::1168::TaskManager.Task::(prepare) Task=`610abd50-b5a7-4258-867f-3bbd591d28d2`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56351::DEBUG::2014-05-16 18:33:07,232::task::579::TaskManager.Task::(_updateState) Task=`610abd50-b5a7-4258-867f-3bbd591d28d2`::moving from state preparing -> state finished >Thread-56351::DEBUG::2014-05-16 18:33:07,232::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56351::DEBUG::2014-05-16 18:33:07,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56351::DEBUG::2014-05-16 18:33:07,233::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56351::DEBUG::2014-05-16 18:33:07,233::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56351::DEBUG::2014-05-16 18:33:07,233::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56351::DEBUG::2014-05-16 18:33:07,233::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56351::DEBUG::2014-05-16 18:33:07,233::task::974::TaskManager.Task::(_decref) Task=`610abd50-b5a7-4258-867f-3bbd591d28d2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:33:08,921::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:08,988::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310574 s, 33.0 MB/s\n'; <rc> = 0 >Thread-56352::DEBUG::2014-05-16 18:33:10,128::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3241770.000000 / 8.008512 / 262500000.000000 = 0.154206 >Thread-56352::DEBUG::2014-05-16 18:33:10,128::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041575763283349804, 'statsAge': 0.77377414703369141, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15420592450866674, 'rxDropped': 0} >Thread-56352::DEBUG::2014-05-16 18:33:10,129::task::579::TaskManager.Task::(_updateState) Task=`88dfb7a1-c81e-4724-909c-cc12cd1dbb85`::moving from state init -> state preparing >Thread-56352::INFO::2014-05-16 18:33:10,129::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56352::INFO::2014-05-16 18:33:10,129::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703481', 'lastCheck': '9.2', 'valid': True}} >Thread-56352::DEBUG::2014-05-16 18:33:10,129::task::1168::TaskManager.Task::(prepare) Task=`88dfb7a1-c81e-4724-909c-cc12cd1dbb85`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703481', 'lastCheck': '9.2', 'valid': True}} >Thread-56352::DEBUG::2014-05-16 18:33:10,130::task::579::TaskManager.Task::(_updateState) Task=`88dfb7a1-c81e-4724-909c-cc12cd1dbb85`::moving from state preparing -> state finished >Thread-56352::DEBUG::2014-05-16 18:33:10,130::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56352::DEBUG::2014-05-16 18:33:10,130::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56352::DEBUG::2014-05-16 18:33:10,130::task::974::TaskManager.Task::(_decref) Task=`88dfb7a1-c81e-4724-909c-cc12cd1dbb85`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:33:10,993::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:11,002::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 18:33:11,015::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105119 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:11,184::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.142997 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:13,196::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:13,275::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347133 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:15,286::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:15,353::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031191 s, 32.8 MB/s\n'; <rc> = 0 >Thread-56356::DEBUG::2014-05-16 18:33:17,302::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56356::DEBUG::2014-05-16 18:33:17,302::task::579::TaskManager.Task::(_updateState) Task=`13e61bfd-b239-45d5-af2d-2f91404c02fa`::moving from state init -> state preparing >Thread-56356::INFO::2014-05-16 18:33:17,302::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56356::INFO::2014-05-16 18:33:17,303::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56356::DEBUG::2014-05-16 18:33:17,303::task::1168::TaskManager.Task::(prepare) Task=`13e61bfd-b239-45d5-af2d-2f91404c02fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56356::DEBUG::2014-05-16 18:33:17,303::task::579::TaskManager.Task::(_updateState) Task=`13e61bfd-b239-45d5-af2d-2f91404c02fa`::moving from state preparing -> state finished >Thread-56356::DEBUG::2014-05-16 18:33:17,303::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56356::DEBUG::2014-05-16 18:33:17,303::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56356::DEBUG::2014-05-16 18:33:17,303::task::974::TaskManager.Task::(_decref) Task=`13e61bfd-b239-45d5-af2d-2f91404c02fa`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:33:17,369::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:17,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307401 s, 33.3 MB/s\n'; <rc> = 0 >Thread-56357::DEBUG::2014-05-16 18:33:17,455::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56357::DEBUG::2014-05-16 18:33:17,455::task::579::TaskManager.Task::(_updateState) Task=`2a99cb71-d8e9-40a0-8c25-44bb211666b3`::moving from state init -> state preparing >Thread-56357::INFO::2014-05-16 18:33:17,456::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56357::DEBUG::2014-05-16 18:33:17,456::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`925d9176-1daf-4fde-92a2-a926180c3161`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56357::DEBUG::2014-05-16 18:33:17,456::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56357::DEBUG::2014-05-16 18:33:17,457::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56357::DEBUG::2014-05-16 18:33:17,457::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`925d9176-1daf-4fde-92a2-a926180c3161`::Granted request >Thread-56357::DEBUG::2014-05-16 18:33:17,457::task::811::TaskManager.Task::(resourceAcquired) Task=`2a99cb71-d8e9-40a0-8c25-44bb211666b3`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56357::DEBUG::2014-05-16 18:33:17,457::task::974::TaskManager.Task::(_decref) Task=`2a99cb71-d8e9-40a0-8c25-44bb211666b3`::ref 1 aborting False >Thread-56357::INFO::2014-05-16 18:33:17,458::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56357::DEBUG::2014-05-16 18:33:17,458::task::1168::TaskManager.Task::(prepare) Task=`2a99cb71-d8e9-40a0-8c25-44bb211666b3`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56357::DEBUG::2014-05-16 18:33:17,458::task::579::TaskManager.Task::(_updateState) Task=`2a99cb71-d8e9-40a0-8c25-44bb211666b3`::moving from state preparing -> state finished >Thread-56357::DEBUG::2014-05-16 18:33:17,458::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56357::DEBUG::2014-05-16 18:33:17,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56357::DEBUG::2014-05-16 18:33:17,459::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56357::DEBUG::2014-05-16 18:33:17,459::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56357::DEBUG::2014-05-16 18:33:17,459::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56357::DEBUG::2014-05-16 18:33:17,459::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56357::DEBUG::2014-05-16 18:33:17,460::task::974::TaskManager.Task::(_decref) Task=`2a99cb71-d8e9-40a0-8c25-44bb211666b3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:33:19,448::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:19,520::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035644 s, 28.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:33:21,156::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:33:21,173::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548865 s, 7.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:21,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:21,601::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340393 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:23,611::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:23,677::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308199 s, 33.2 MB/s\n'; <rc> = 0 >Thread-56360::DEBUG::2014-05-16 18:33:25,527::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5415660.000000 / 8.008469 / 262500000.000000 = 0.257616 >Thread-56360::DEBUG::2014-05-16 18:33:25,527::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066049125498596857, 'statsAge': 0.15327978134155273, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25761584947621968, 'rxDropped': 0} >Thread-56360::DEBUG::2014-05-16 18:33:25,529::task::579::TaskManager.Task::(_updateState) Task=`55008027-d337-43b9-854e-b3fd8d16c665`::moving from state init -> state preparing >Thread-56360::INFO::2014-05-16 18:33:25,529::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56360::INFO::2014-05-16 18:33:25,529::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548865', 'lastCheck': '4.3', 'valid': True}} >Thread-56360::DEBUG::2014-05-16 18:33:25,529::task::1168::TaskManager.Task::(prepare) Task=`55008027-d337-43b9-854e-b3fd8d16c665`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548865', 'lastCheck': '4.3', 'valid': True}} >Thread-56360::DEBUG::2014-05-16 18:33:25,530::task::579::TaskManager.Task::(_updateState) Task=`55008027-d337-43b9-854e-b3fd8d16c665`::moving from state preparing -> state finished >Thread-56360::DEBUG::2014-05-16 18:33:25,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56360::DEBUG::2014-05-16 18:33:25,530::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56360::DEBUG::2014-05-16 18:33:25,530::task::974::TaskManager.Task::(_decref) Task=`55008027-d337-43b9-854e-b3fd8d16c665`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:33:25,689::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:25,760::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354881 s, 28.9 MB/s\n'; <rc> = 0 >Thread-56362::DEBUG::2014-05-16 18:33:27,534::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56362::DEBUG::2014-05-16 18:33:27,535::task::579::TaskManager.Task::(_updateState) Task=`db6c3176-3a6f-4660-9b26-6fc6ab9f51bb`::moving from state init -> state preparing >Thread-56362::INFO::2014-05-16 18:33:27,535::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56362::INFO::2014-05-16 18:33:27,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56362::DEBUG::2014-05-16 18:33:27,536::task::1168::TaskManager.Task::(prepare) Task=`db6c3176-3a6f-4660-9b26-6fc6ab9f51bb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56362::DEBUG::2014-05-16 18:33:27,536::task::579::TaskManager.Task::(_updateState) Task=`db6c3176-3a6f-4660-9b26-6fc6ab9f51bb`::moving from state preparing -> state finished >Thread-56362::DEBUG::2014-05-16 18:33:27,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56362::DEBUG::2014-05-16 18:33:27,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56362::DEBUG::2014-05-16 18:33:27,536::task::974::TaskManager.Task::(_decref) Task=`db6c3176-3a6f-4660-9b26-6fc6ab9f51bb`::ref 0 aborting False >Thread-56363::DEBUG::2014-05-16 18:33:27,548::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56363::DEBUG::2014-05-16 18:33:27,548::task::579::TaskManager.Task::(_updateState) Task=`2c6b8aff-24ae-4664-be41-fce7e297a5e7`::moving from state init -> state preparing >Thread-56363::INFO::2014-05-16 18:33:27,548::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56363::DEBUG::2014-05-16 18:33:27,549::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d8ee87e7-c811-44ca-aa76-51cedfb66ba5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56363::DEBUG::2014-05-16 18:33:27,549::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56363::DEBUG::2014-05-16 18:33:27,549::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56363::DEBUG::2014-05-16 18:33:27,549::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d8ee87e7-c811-44ca-aa76-51cedfb66ba5`::Granted request >Thread-56363::DEBUG::2014-05-16 18:33:27,550::task::811::TaskManager.Task::(resourceAcquired) Task=`2c6b8aff-24ae-4664-be41-fce7e297a5e7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56363::DEBUG::2014-05-16 18:33:27,550::task::974::TaskManager.Task::(_decref) Task=`2c6b8aff-24ae-4664-be41-fce7e297a5e7`::ref 1 aborting False >Thread-56363::INFO::2014-05-16 18:33:27,551::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56363::DEBUG::2014-05-16 18:33:27,551::task::1168::TaskManager.Task::(prepare) Task=`2c6b8aff-24ae-4664-be41-fce7e297a5e7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56363::DEBUG::2014-05-16 18:33:27,551::task::579::TaskManager.Task::(_updateState) Task=`2c6b8aff-24ae-4664-be41-fce7e297a5e7`::moving from state preparing -> state finished >Thread-56363::DEBUG::2014-05-16 18:33:27,551::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56363::DEBUG::2014-05-16 18:33:27,551::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56363::DEBUG::2014-05-16 18:33:27,551::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56363::DEBUG::2014-05-16 18:33:27,552::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56363::DEBUG::2014-05-16 18:33:27,552::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56363::DEBUG::2014-05-16 18:33:27,552::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56363::DEBUG::2014-05-16 18:33:27,552::task::974::TaskManager.Task::(_decref) Task=`2c6b8aff-24ae-4664-be41-fce7e297a5e7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:33:27,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:27,844::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357327 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:29,856::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:29,924::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031091 s, 32.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:33:31,223::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:33:31,234::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107249 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:31,936::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:32,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349537 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:34,018::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:34,085::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302261 s, 33.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:36,096::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:36,164::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313926 s, 32.6 MB/s\n'; <rc> = 0 >Thread-56367::DEBUG::2014-05-16 18:33:37,601::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56367::DEBUG::2014-05-16 18:33:37,602::task::579::TaskManager.Task::(_updateState) Task=`a2d91145-1bf2-47d3-9555-ddd4b879ff03`::moving from state init -> state preparing >Thread-56367::INFO::2014-05-16 18:33:37,602::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56367::INFO::2014-05-16 18:33:37,602::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56367::DEBUG::2014-05-16 18:33:37,603::task::1168::TaskManager.Task::(prepare) Task=`a2d91145-1bf2-47d3-9555-ddd4b879ff03`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56367::DEBUG::2014-05-16 18:33:37,603::task::579::TaskManager.Task::(_updateState) Task=`a2d91145-1bf2-47d3-9555-ddd4b879ff03`::moving from state preparing -> state finished >Thread-56367::DEBUG::2014-05-16 18:33:37,603::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56367::DEBUG::2014-05-16 18:33:37,603::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56367::DEBUG::2014-05-16 18:33:37,603::task::974::TaskManager.Task::(_decref) Task=`a2d91145-1bf2-47d3-9555-ddd4b879ff03`::ref 0 aborting False >Thread-56368::DEBUG::2014-05-16 18:33:37,704::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56368::DEBUG::2014-05-16 18:33:37,705::task::579::TaskManager.Task::(_updateState) Task=`695e12b9-bfda-4cec-b718-20f078275a03`::moving from state init -> state preparing >Thread-56368::INFO::2014-05-16 18:33:37,705::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56368::DEBUG::2014-05-16 18:33:37,705::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`66ad768c-483a-45f7-bdf9-c1333b36265a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56368::DEBUG::2014-05-16 18:33:37,705::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56368::DEBUG::2014-05-16 18:33:37,706::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56368::DEBUG::2014-05-16 18:33:37,706::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`66ad768c-483a-45f7-bdf9-c1333b36265a`::Granted request >Thread-56368::DEBUG::2014-05-16 18:33:37,706::task::811::TaskManager.Task::(resourceAcquired) Task=`695e12b9-bfda-4cec-b718-20f078275a03`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56368::DEBUG::2014-05-16 18:33:37,706::task::974::TaskManager.Task::(_decref) Task=`695e12b9-bfda-4cec-b718-20f078275a03`::ref 1 aborting False >Thread-56368::INFO::2014-05-16 18:33:37,707::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56368::DEBUG::2014-05-16 18:33:37,707::task::1168::TaskManager.Task::(prepare) Task=`695e12b9-bfda-4cec-b718-20f078275a03`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56368::DEBUG::2014-05-16 18:33:37,707::task::579::TaskManager.Task::(_updateState) Task=`695e12b9-bfda-4cec-b718-20f078275a03`::moving from state preparing -> state finished >Thread-56368::DEBUG::2014-05-16 18:33:37,707::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56368::DEBUG::2014-05-16 18:33:37,707::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56368::DEBUG::2014-05-16 18:33:37,708::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56368::DEBUG::2014-05-16 18:33:37,708::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56368::DEBUG::2014-05-16 18:33:37,708::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56368::DEBUG::2014-05-16 18:33:37,708::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56368::DEBUG::2014-05-16 18:33:37,708::task::974::TaskManager.Task::(_decref) Task=`695e12b9-bfda-4cec-b718-20f078275a03`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:33:38,175::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:38,242::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310628 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:40,254::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:40,325::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355604 s, 28.8 MB/s\n'; <rc> = 0 >Thread-56370::DEBUG::2014-05-16 18:33:40,837::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4321237.000000 / 8.008554 / 262500000.000000 = 0.205553 >Thread-56370::DEBUG::2014-05-16 18:33:40,837::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '72.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053968009114873563, 'statsAge': 1.4484081268310547, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20555340296818878, 'rxDropped': 0} >Thread-56370::DEBUG::2014-05-16 18:33:40,838::task::579::TaskManager.Task::(_updateState) Task=`3add632f-879a-476c-8c50-fd0a2cf468f5`::moving from state init -> state preparing >Thread-56370::INFO::2014-05-16 18:33:40,838::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56370::INFO::2014-05-16 18:33:40,838::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107249', 'lastCheck': '9.6', 'valid': True}} >Thread-56370::DEBUG::2014-05-16 18:33:40,839::task::1168::TaskManager.Task::(prepare) Task=`3add632f-879a-476c-8c50-fd0a2cf468f5`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107249', 'lastCheck': '9.6', 'valid': True}} >Thread-56370::DEBUG::2014-05-16 18:33:40,839::task::579::TaskManager.Task::(_updateState) Task=`3add632f-879a-476c-8c50-fd0a2cf468f5`::moving from state preparing -> state finished >Thread-56370::DEBUG::2014-05-16 18:33:40,839::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56370::DEBUG::2014-05-16 18:33:40,839::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56370::DEBUG::2014-05-16 18:33:40,839::task::974::TaskManager.Task::(_decref) Task=`3add632f-879a-476c-8c50-fd0a2cf468f5`::ref 0 aborting False >Thread-30::DEBUG::2014-05-16 18:33:41,277::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:33:41,287::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000766402 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:42,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:42,407::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344089 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:44,419::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:44,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307338 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:46,499::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:46,570::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351542 s, 29.1 MB/s\n'; <rc> = 0 >Thread-56374::DEBUG::2014-05-16 18:33:47,762::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56374::DEBUG::2014-05-16 18:33:47,762::task::579::TaskManager.Task::(_updateState) Task=`5364bb08-e873-4714-8a87-3114eb3f076d`::moving from state init -> state preparing >Thread-56374::INFO::2014-05-16 18:33:47,762::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56374::INFO::2014-05-16 18:33:47,763::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56374::DEBUG::2014-05-16 18:33:47,763::task::1168::TaskManager.Task::(prepare) Task=`5364bb08-e873-4714-8a87-3114eb3f076d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56374::DEBUG::2014-05-16 18:33:47,763::task::579::TaskManager.Task::(_updateState) Task=`5364bb08-e873-4714-8a87-3114eb3f076d`::moving from state preparing -> state finished >Thread-56374::DEBUG::2014-05-16 18:33:47,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56374::DEBUG::2014-05-16 18:33:47,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56374::DEBUG::2014-05-16 18:33:47,763::task::974::TaskManager.Task::(_decref) Task=`5364bb08-e873-4714-8a87-3114eb3f076d`::ref 0 aborting False >Thread-56375::DEBUG::2014-05-16 18:33:47,779::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56375::DEBUG::2014-05-16 18:33:47,779::task::579::TaskManager.Task::(_updateState) Task=`4e296585-16dd-494e-b114-40c9fdd879e6`::moving from state init -> state preparing >Thread-56375::INFO::2014-05-16 18:33:47,780::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56375::DEBUG::2014-05-16 18:33:47,780::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`26477076-4d6c-4502-bb00-8a4c450fc5c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56375::DEBUG::2014-05-16 18:33:47,780::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56375::DEBUG::2014-05-16 18:33:47,780::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56375::DEBUG::2014-05-16 18:33:47,780::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`26477076-4d6c-4502-bb00-8a4c450fc5c8`::Granted request >Thread-56375::DEBUG::2014-05-16 18:33:47,781::task::811::TaskManager.Task::(resourceAcquired) Task=`4e296585-16dd-494e-b114-40c9fdd879e6`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56375::DEBUG::2014-05-16 18:33:47,781::task::974::TaskManager.Task::(_decref) Task=`4e296585-16dd-494e-b114-40c9fdd879e6`::ref 1 aborting False >Thread-56375::INFO::2014-05-16 18:33:47,781::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56375::DEBUG::2014-05-16 18:33:47,782::task::1168::TaskManager.Task::(prepare) Task=`4e296585-16dd-494e-b114-40c9fdd879e6`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56375::DEBUG::2014-05-16 18:33:47,782::task::579::TaskManager.Task::(_updateState) Task=`4e296585-16dd-494e-b114-40c9fdd879e6`::moving from state preparing -> state finished >Thread-56375::DEBUG::2014-05-16 18:33:47,782::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56375::DEBUG::2014-05-16 18:33:47,782::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56375::DEBUG::2014-05-16 18:33:47,782::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56375::DEBUG::2014-05-16 18:33:47,782::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56375::DEBUG::2014-05-16 18:33:47,783::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56375::DEBUG::2014-05-16 18:33:47,783::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56375::DEBUG::2014-05-16 18:33:47,783::task::974::TaskManager.Task::(_decref) Task=`4e296585-16dd-494e-b114-40c9fdd879e6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:33:48,581::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:48,648::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312021 s, 32.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:50,660::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:50,727::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316485 s, 32.4 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:33:51,328::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:33:51,338::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000820102 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:52,739::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:52,810::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347478 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:33:54,822::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:54,889::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315555 s, 32.5 MB/s\n'; <rc> = 0 >Thread-56378::DEBUG::2014-05-16 18:33:56,115::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 3244985.000000 / 8.008178 / 262500000.000000 = 0.154365 >Thread-56378::DEBUG::2014-05-16 18:33:56,115::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0041826766420128073, 'statsAge': 0.70934700965881348, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.15436529539819768, 'rxDropped': 0} >Thread-56378::DEBUG::2014-05-16 18:33:56,116::task::579::TaskManager.Task::(_updateState) Task=`92c562c2-9784-4a24-a87c-3598cda64b6a`::moving from state init -> state preparing >Thread-56378::INFO::2014-05-16 18:33:56,116::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56378::INFO::2014-05-16 18:33:56,116::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000820102', 'lastCheck': '4.8', 'valid': True}} >Thread-56378::DEBUG::2014-05-16 18:33:56,117::task::1168::TaskManager.Task::(prepare) Task=`92c562c2-9784-4a24-a87c-3598cda64b6a`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000820102', 'lastCheck': '4.8', 'valid': True}} >Thread-56378::DEBUG::2014-05-16 18:33:56,117::task::579::TaskManager.Task::(_updateState) Task=`92c562c2-9784-4a24-a87c-3598cda64b6a`::moving from state preparing -> state finished >Thread-56378::DEBUG::2014-05-16 18:33:56,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56378::DEBUG::2014-05-16 18:33:56,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56378::DEBUG::2014-05-16 18:33:56,117::task::974::TaskManager.Task::(_decref) Task=`92c562c2-9784-4a24-a87c-3598cda64b6a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:33:56,901::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:56,976::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391229 s, 26.2 MB/s\n'; <rc> = 0 >Thread-56380::DEBUG::2014-05-16 18:33:57,861::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56380::DEBUG::2014-05-16 18:33:57,862::task::579::TaskManager.Task::(_updateState) Task=`c2994456-803d-4b5d-8029-dc1e905822dd`::moving from state init -> state preparing >Thread-56380::INFO::2014-05-16 18:33:57,862::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56380::INFO::2014-05-16 18:33:57,862::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56380::DEBUG::2014-05-16 18:33:57,863::task::1168::TaskManager.Task::(prepare) Task=`c2994456-803d-4b5d-8029-dc1e905822dd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56380::DEBUG::2014-05-16 18:33:57,863::task::579::TaskManager.Task::(_updateState) Task=`c2994456-803d-4b5d-8029-dc1e905822dd`::moving from state preparing -> state finished >Thread-56380::DEBUG::2014-05-16 18:33:57,863::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56380::DEBUG::2014-05-16 18:33:57,863::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56380::DEBUG::2014-05-16 18:33:57,863::task::974::TaskManager.Task::(_decref) Task=`c2994456-803d-4b5d-8029-dc1e905822dd`::ref 0 aborting False >Thread-56381::DEBUG::2014-05-16 18:33:57,921::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56381::DEBUG::2014-05-16 18:33:57,921::task::579::TaskManager.Task::(_updateState) Task=`d8acfc00-d8ee-44e5-ad6b-10e9456b6dff`::moving from state init -> state preparing >Thread-56381::INFO::2014-05-16 18:33:57,922::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56381::DEBUG::2014-05-16 18:33:57,922::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8626a0c9-7963-445e-8bbb-8e2e10a54ff9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56381::DEBUG::2014-05-16 18:33:57,922::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56381::DEBUG::2014-05-16 18:33:57,922::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56381::DEBUG::2014-05-16 18:33:57,923::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8626a0c9-7963-445e-8bbb-8e2e10a54ff9`::Granted request >Thread-56381::DEBUG::2014-05-16 18:33:57,923::task::811::TaskManager.Task::(resourceAcquired) Task=`d8acfc00-d8ee-44e5-ad6b-10e9456b6dff`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56381::DEBUG::2014-05-16 18:33:57,923::task::974::TaskManager.Task::(_decref) Task=`d8acfc00-d8ee-44e5-ad6b-10e9456b6dff`::ref 1 aborting False >Thread-56381::INFO::2014-05-16 18:33:57,924::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56381::DEBUG::2014-05-16 18:33:57,924::task::1168::TaskManager.Task::(prepare) Task=`d8acfc00-d8ee-44e5-ad6b-10e9456b6dff`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56381::DEBUG::2014-05-16 18:33:57,924::task::579::TaskManager.Task::(_updateState) Task=`d8acfc00-d8ee-44e5-ad6b-10e9456b6dff`::moving from state preparing -> state finished >Thread-56381::DEBUG::2014-05-16 18:33:57,924::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56381::DEBUG::2014-05-16 18:33:57,924::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56381::DEBUG::2014-05-16 18:33:57,925::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56381::DEBUG::2014-05-16 18:33:57,925::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56381::DEBUG::2014-05-16 18:33:57,925::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56381::DEBUG::2014-05-16 18:33:57,925::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56381::DEBUG::2014-05-16 18:33:57,925::task::974::TaskManager.Task::(_decref) Task=`d8acfc00-d8ee-44e5-ad6b-10e9456b6dff`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:33:58,988::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:33:59,059::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348651 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:01,071::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:01,138::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310538 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:34:01,378::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:34:01,388::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00078553 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:03,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:03,217::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305567 s, 33.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:05,228::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:05,296::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315625 s, 32.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:07,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:07,379::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356628 s, 28.7 MB/s\n'; <rc> = 0 >Thread-56385::DEBUG::2014-05-16 18:34:07,991::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56385::DEBUG::2014-05-16 18:34:07,991::task::579::TaskManager.Task::(_updateState) Task=`db831526-64cf-47e8-844d-77eb48a9057d`::moving from state init -> state preparing >Thread-56385::INFO::2014-05-16 18:34:07,991::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56385::INFO::2014-05-16 18:34:07,992::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56385::DEBUG::2014-05-16 18:34:07,992::task::1168::TaskManager.Task::(prepare) Task=`db831526-64cf-47e8-844d-77eb48a9057d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56385::DEBUG::2014-05-16 18:34:07,992::task::579::TaskManager.Task::(_updateState) Task=`db831526-64cf-47e8-844d-77eb48a9057d`::moving from state preparing -> state finished >Thread-56385::DEBUG::2014-05-16 18:34:07,992::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56385::DEBUG::2014-05-16 18:34:07,992::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56385::DEBUG::2014-05-16 18:34:07,992::task::974::TaskManager.Task::(_decref) Task=`db831526-64cf-47e8-844d-77eb48a9057d`::ref 0 aborting False >Thread-56386::DEBUG::2014-05-16 18:34:08,002::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56386::DEBUG::2014-05-16 18:34:08,002::task::579::TaskManager.Task::(_updateState) Task=`81678000-0065-494d-95b4-203325a772b0`::moving from state init -> state preparing >Thread-56386::INFO::2014-05-16 18:34:08,003::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56386::DEBUG::2014-05-16 18:34:08,003::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8b88bc2f-810b-4783-8244-22e6a45f41df`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56386::DEBUG::2014-05-16 18:34:08,003::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56386::DEBUG::2014-05-16 18:34:08,003::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56386::DEBUG::2014-05-16 18:34:08,004::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8b88bc2f-810b-4783-8244-22e6a45f41df`::Granted request >Thread-56386::DEBUG::2014-05-16 18:34:08,004::task::811::TaskManager.Task::(resourceAcquired) Task=`81678000-0065-494d-95b4-203325a772b0`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56386::DEBUG::2014-05-16 18:34:08,004::task::974::TaskManager.Task::(_decref) Task=`81678000-0065-494d-95b4-203325a772b0`::ref 1 aborting False >Thread-56386::INFO::2014-05-16 18:34:08,005::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56386::DEBUG::2014-05-16 18:34:08,005::task::1168::TaskManager.Task::(prepare) Task=`81678000-0065-494d-95b4-203325a772b0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56386::DEBUG::2014-05-16 18:34:08,005::task::579::TaskManager.Task::(_updateState) Task=`81678000-0065-494d-95b4-203325a772b0`::moving from state preparing -> state finished >Thread-56386::DEBUG::2014-05-16 18:34:08,005::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56386::DEBUG::2014-05-16 18:34:08,005::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56386::DEBUG::2014-05-16 18:34:08,006::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56386::DEBUG::2014-05-16 18:34:08,006::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56386::DEBUG::2014-05-16 18:34:08,006::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56386::DEBUG::2014-05-16 18:34:08,006::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56386::DEBUG::2014-05-16 18:34:08,006::task::974::TaskManager.Task::(_decref) Task=`81678000-0065-494d-95b4-203325a772b0`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:34:09,391::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:09,461::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338643 s, 30.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:34:11,434::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:34:11,445::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109324 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:11,472::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:11,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362538 s, 28.2 MB/s\n'; <rc> = 0 >Thread-56388::DEBUG::2014-05-16 18:34:11,573::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4308813.000000 / 8.010422 / 262500000.000000 = 0.204915 >Thread-56388::DEBUG::2014-05-16 18:34:11,573::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0052948164692850925, 'statsAge': 0.14849185943603516, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20491461913010803, 'rxDropped': 0} >Thread-56388::DEBUG::2014-05-16 18:34:11,574::task::579::TaskManager.Task::(_updateState) Task=`20490470-5bb1-4b00-b372-a2b88bb22035`::moving from state init -> state preparing >Thread-56388::INFO::2014-05-16 18:34:11,574::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56388::INFO::2014-05-16 18:34:11,574::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109324', 'lastCheck': '0.1', 'valid': True}} >Thread-56388::DEBUG::2014-05-16 18:34:11,574::task::1168::TaskManager.Task::(prepare) Task=`20490470-5bb1-4b00-b372-a2b88bb22035`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109324', 'lastCheck': '0.1', 'valid': True}} >Thread-56388::DEBUG::2014-05-16 18:34:11,575::task::579::TaskManager.Task::(_updateState) Task=`20490470-5bb1-4b00-b372-a2b88bb22035`::moving from state preparing -> state finished >Thread-56388::DEBUG::2014-05-16 18:34:11,575::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56388::DEBUG::2014-05-16 18:34:11,575::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56388::DEBUG::2014-05-16 18:34:11,575::task::974::TaskManager.Task::(_decref) Task=`20490470-5bb1-4b00-b372-a2b88bb22035`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:34:13,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:13,628::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360771 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:15,639::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:15,706::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309659 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:17,718::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:17,787::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313428 s, 32.7 MB/s\n'; <rc> = 0 >Thread-56392::DEBUG::2014-05-16 18:34:18,059::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56392::DEBUG::2014-05-16 18:34:18,060::task::579::TaskManager.Task::(_updateState) Task=`b68d7182-e17e-4399-b762-609d8935379a`::moving from state init -> state preparing >Thread-56392::INFO::2014-05-16 18:34:18,060::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56392::INFO::2014-05-16 18:34:18,060::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56392::DEBUG::2014-05-16 18:34:18,061::task::1168::TaskManager.Task::(prepare) Task=`b68d7182-e17e-4399-b762-609d8935379a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56392::DEBUG::2014-05-16 18:34:18,061::task::579::TaskManager.Task::(_updateState) Task=`b68d7182-e17e-4399-b762-609d8935379a`::moving from state preparing -> state finished >Thread-56392::DEBUG::2014-05-16 18:34:18,061::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56392::DEBUG::2014-05-16 18:34:18,061::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56392::DEBUG::2014-05-16 18:34:18,061::task::974::TaskManager.Task::(_decref) Task=`b68d7182-e17e-4399-b762-609d8935379a`::ref 0 aborting False >Thread-56393::DEBUG::2014-05-16 18:34:18,076::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56393::DEBUG::2014-05-16 18:34:18,076::task::579::TaskManager.Task::(_updateState) Task=`844690cc-929f-430b-8ecd-b6f8cbe5565e`::moving from state init -> state preparing >Thread-56393::INFO::2014-05-16 18:34:18,076::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56393::DEBUG::2014-05-16 18:34:18,078::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6da3f0d5-4bbb-4ddd-af1a-30a5b40b1558`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56393::DEBUG::2014-05-16 18:34:18,078::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56393::DEBUG::2014-05-16 18:34:18,078::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56393::DEBUG::2014-05-16 18:34:18,078::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6da3f0d5-4bbb-4ddd-af1a-30a5b40b1558`::Granted request >Thread-56393::DEBUG::2014-05-16 18:34:18,079::task::811::TaskManager.Task::(resourceAcquired) Task=`844690cc-929f-430b-8ecd-b6f8cbe5565e`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56393::DEBUG::2014-05-16 18:34:18,079::task::974::TaskManager.Task::(_decref) Task=`844690cc-929f-430b-8ecd-b6f8cbe5565e`::ref 1 aborting False >Thread-56393::INFO::2014-05-16 18:34:18,079::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56393::DEBUG::2014-05-16 18:34:18,080::task::1168::TaskManager.Task::(prepare) Task=`844690cc-929f-430b-8ecd-b6f8cbe5565e`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56393::DEBUG::2014-05-16 18:34:18,080::task::579::TaskManager.Task::(_updateState) Task=`844690cc-929f-430b-8ecd-b6f8cbe5565e`::moving from state preparing -> state finished >Thread-56393::DEBUG::2014-05-16 18:34:18,080::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56393::DEBUG::2014-05-16 18:34:18,080::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56393::DEBUG::2014-05-16 18:34:18,080::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56393::DEBUG::2014-05-16 18:34:18,081::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56393::DEBUG::2014-05-16 18:34:18,081::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56393::DEBUG::2014-05-16 18:34:18,081::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56393::DEBUG::2014-05-16 18:34:18,081::task::974::TaskManager.Task::(_decref) Task=`844690cc-929f-430b-8ecd-b6f8cbe5565e`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:34:19,799::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:19,871::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354462 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:34:21,482::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:34:21,493::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000979341 s, 4.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:21,883::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:21,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351911 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:23,966::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:24,034::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310786 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:26,046::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:26,118::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356505 s, 28.7 MB/s\n'; <rc> = 0 >Thread-56396::DEBUG::2014-05-16 18:34:26,939::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5417805.000000 / 8.009253 / 262500000.000000 = 0.257693 >Thread-56396::DEBUG::2014-05-16 18:34:26,939::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066790367429712151, 'statsAge': 1.4957060813903809, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25769265970612271, 'rxDropped': 0} >Thread-56396::DEBUG::2014-05-16 18:34:26,940::task::579::TaskManager.Task::(_updateState) Task=`d6e7039c-9cf3-4392-8a3b-2ee992b71921`::moving from state init -> state preparing >Thread-56396::INFO::2014-05-16 18:34:26,940::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56396::INFO::2014-05-16 18:34:26,940::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000979341', 'lastCheck': '5.4', 'valid': True}} >Thread-56396::DEBUG::2014-05-16 18:34:26,941::task::1168::TaskManager.Task::(prepare) Task=`d6e7039c-9cf3-4392-8a3b-2ee992b71921`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000979341', 'lastCheck': '5.4', 'valid': True}} >Thread-56396::DEBUG::2014-05-16 18:34:26,941::task::579::TaskManager.Task::(_updateState) Task=`d6e7039c-9cf3-4392-8a3b-2ee992b71921`::moving from state preparing -> state finished >Thread-56396::DEBUG::2014-05-16 18:34:26,941::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56396::DEBUG::2014-05-16 18:34:26,941::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56396::DEBUG::2014-05-16 18:34:26,941::task::974::TaskManager.Task::(_decref) Task=`d6e7039c-9cf3-4392-8a3b-2ee992b71921`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:34:28,130::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-56398::DEBUG::2014-05-16 18:34:28,139::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56398::DEBUG::2014-05-16 18:34:28,140::task::579::TaskManager.Task::(_updateState) Task=`ebccf40f-54bc-4abf-a40d-67ed55da1080`::moving from state init -> state preparing >Thread-56398::INFO::2014-05-16 18:34:28,140::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56398::INFO::2014-05-16 18:34:28,141::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56398::DEBUG::2014-05-16 18:34:28,141::task::1168::TaskManager.Task::(prepare) Task=`ebccf40f-54bc-4abf-a40d-67ed55da1080`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56398::DEBUG::2014-05-16 18:34:28,141::task::579::TaskManager.Task::(_updateState) Task=`ebccf40f-54bc-4abf-a40d-67ed55da1080`::moving from state preparing -> state finished >Thread-56398::DEBUG::2014-05-16 18:34:28,141::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56398::DEBUG::2014-05-16 18:34:28,141::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56398::DEBUG::2014-05-16 18:34:28,141::task::974::TaskManager.Task::(_decref) Task=`ebccf40f-54bc-4abf-a40d-67ed55da1080`::ref 0 aborting False >Thread-56399::DEBUG::2014-05-16 18:34:28,169::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56399::DEBUG::2014-05-16 18:34:28,170::task::579::TaskManager.Task::(_updateState) Task=`267b3b03-359e-48b9-b683-1c7a88f5f9b8`::moving from state init -> state preparing >Thread-56399::INFO::2014-05-16 18:34:28,171::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56399::DEBUG::2014-05-16 18:34:28,173::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bc595d0e-ebac-4cd3-a9ce-8ba96e87faa3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56399::DEBUG::2014-05-16 18:34:28,174::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56399::DEBUG::2014-05-16 18:34:28,176::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56399::DEBUG::2014-05-16 18:34:28,176::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`bc595d0e-ebac-4cd3-a9ce-8ba96e87faa3`::Granted request >Thread-56399::DEBUG::2014-05-16 18:34:28,178::task::811::TaskManager.Task::(resourceAcquired) Task=`267b3b03-359e-48b9-b683-1c7a88f5f9b8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56399::DEBUG::2014-05-16 18:34:28,179::task::974::TaskManager.Task::(_decref) Task=`267b3b03-359e-48b9-b683-1c7a88f5f9b8`::ref 1 aborting False >Thread-56399::INFO::2014-05-16 18:34:28,183::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56399::DEBUG::2014-05-16 18:34:28,184::task::1168::TaskManager.Task::(prepare) Task=`267b3b03-359e-48b9-b683-1c7a88f5f9b8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56399::DEBUG::2014-05-16 18:34:28,184::task::579::TaskManager.Task::(_updateState) Task=`267b3b03-359e-48b9-b683-1c7a88f5f9b8`::moving from state preparing -> state finished >Thread-56399::DEBUG::2014-05-16 18:34:28,185::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56399::DEBUG::2014-05-16 18:34:28,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56399::DEBUG::2014-05-16 18:34:28,187::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56399::DEBUG::2014-05-16 18:34:28,189::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56399::DEBUG::2014-05-16 18:34:28,189::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56399::DEBUG::2014-05-16 18:34:28,190::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56399::DEBUG::2014-05-16 18:34:28,191::task::974::TaskManager.Task::(_decref) Task=`267b3b03-359e-48b9-b683-1c7a88f5f9b8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:34:28,228::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0584333 s, 17.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:30,239::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:30,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317768 s, 32.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:34:31,529::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:34:31,540::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111132 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:32,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:32,385::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03065 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:34,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:34,467::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344639 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:36,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:36,553::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372454 s, 27.5 MB/s\n'; <rc> = 0 >Thread-56403::DEBUG::2014-05-16 18:34:38,410::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56403::DEBUG::2014-05-16 18:34:38,411::task::579::TaskManager.Task::(_updateState) Task=`fbfbf67d-4e52-4bd1-ba07-d29918fad7f5`::moving from state init -> state preparing >Thread-56403::INFO::2014-05-16 18:34:38,411::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56403::INFO::2014-05-16 18:34:38,411::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56403::DEBUG::2014-05-16 18:34:38,412::task::1168::TaskManager.Task::(prepare) Task=`fbfbf67d-4e52-4bd1-ba07-d29918fad7f5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56403::DEBUG::2014-05-16 18:34:38,412::task::579::TaskManager.Task::(_updateState) Task=`fbfbf67d-4e52-4bd1-ba07-d29918fad7f5`::moving from state preparing -> state finished >Thread-56403::DEBUG::2014-05-16 18:34:38,412::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56403::DEBUG::2014-05-16 18:34:38,412::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56403::DEBUG::2014-05-16 18:34:38,412::task::974::TaskManager.Task::(_decref) Task=`fbfbf67d-4e52-4bd1-ba07-d29918fad7f5`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:34:38,565::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-56404::DEBUG::2014-05-16 18:34:38,608::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56404::DEBUG::2014-05-16 18:34:38,610::task::579::TaskManager.Task::(_updateState) Task=`511c9f9a-9827-4f38-b03c-e5f6b27bea50`::moving from state init -> state preparing >Thread-56404::INFO::2014-05-16 18:34:38,612::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56404::DEBUG::2014-05-16 18:34:38,614::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`86635c54-cf0a-4bff-a7e1-53ce629587d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56404::DEBUG::2014-05-16 18:34:38,615::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56404::DEBUG::2014-05-16 18:34:38,616::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56404::DEBUG::2014-05-16 18:34:38,617::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`86635c54-cf0a-4bff-a7e1-53ce629587d9`::Granted request >Thread-56404::DEBUG::2014-05-16 18:34:38,619::task::811::TaskManager.Task::(resourceAcquired) Task=`511c9f9a-9827-4f38-b03c-e5f6b27bea50`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56404::DEBUG::2014-05-16 18:34:38,620::task::974::TaskManager.Task::(_decref) Task=`511c9f9a-9827-4f38-b03c-e5f6b27bea50`::ref 1 aborting False >Thread-56404::INFO::2014-05-16 18:34:38,624::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56404::DEBUG::2014-05-16 18:34:38,625::task::1168::TaskManager.Task::(prepare) Task=`511c9f9a-9827-4f38-b03c-e5f6b27bea50`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56404::DEBUG::2014-05-16 18:34:38,626::task::579::TaskManager.Task::(_updateState) Task=`511c9f9a-9827-4f38-b03c-e5f6b27bea50`::moving from state preparing -> state finished >Thread-56404::DEBUG::2014-05-16 18:34:38,627::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56404::DEBUG::2014-05-16 18:34:38,628::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56404::DEBUG::2014-05-16 18:34:38,629::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56404::DEBUG::2014-05-16 18:34:38,630::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56404::DEBUG::2014-05-16 18:34:38,631::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56404::DEBUG::2014-05-16 18:34:38,632::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56404::DEBUG::2014-05-16 18:34:38,633::task::974::TaskManager.Task::(_decref) Task=`511c9f9a-9827-4f38-b03c-e5f6b27bea50`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:34:38,661::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309541 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:40,673::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:40,745::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354711 s, 28.9 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:34:41,578::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:34:41,588::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000821004 s, 5.0 MB/s\n'; <rc> = 0 >Thread-56406::DEBUG::2014-05-16 18:34:42,402::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4312594.000000 / 8.008371 / 262500000.000000 = 0.205147 >Thread-56406::DEBUG::2014-05-16 18:34:42,402::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053602958055073728, 'statsAge': 0.94163203239440918, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20514695546001441, 'rxDropped': 0} >Thread-56406::DEBUG::2014-05-16 18:34:42,402::task::579::TaskManager.Task::(_updateState) Task=`1940fbaa-59b9-467c-83c2-476acce220ec`::moving from state init -> state preparing >Thread-56406::INFO::2014-05-16 18:34:42,403::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56406::INFO::2014-05-16 18:34:42,403::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000821004', 'lastCheck': '0.8', 'valid': True}} >Thread-56406::DEBUG::2014-05-16 18:34:42,403::task::1168::TaskManager.Task::(prepare) Task=`1940fbaa-59b9-467c-83c2-476acce220ec`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000821004', 'lastCheck': '0.8', 'valid': True}} >Thread-56406::DEBUG::2014-05-16 18:34:42,403::task::579::TaskManager.Task::(_updateState) Task=`1940fbaa-59b9-467c-83c2-476acce220ec`::moving from state preparing -> state finished >Thread-56406::DEBUG::2014-05-16 18:34:42,403::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56406::DEBUG::2014-05-16 18:34:42,403::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56406::DEBUG::2014-05-16 18:34:42,404::task::974::TaskManager.Task::(_decref) Task=`1940fbaa-59b9-467c-83c2-476acce220ec`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:34:42,756::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:42,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348132 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:44,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:44,906::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310845 s, 32.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:46,917::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:46,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349095 s, 29.3 MB/s\n'; <rc> = 0 >Thread-56410::DEBUG::2014-05-16 18:34:48,912::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56410::DEBUG::2014-05-16 18:34:48,912::task::579::TaskManager.Task::(_updateState) Task=`fba7b755-71ec-4f0b-a437-0bfff41475df`::moving from state init -> state preparing >Thread-56410::INFO::2014-05-16 18:34:48,912::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56410::INFO::2014-05-16 18:34:48,913::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56410::DEBUG::2014-05-16 18:34:48,913::task::1168::TaskManager.Task::(prepare) Task=`fba7b755-71ec-4f0b-a437-0bfff41475df`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56410::DEBUG::2014-05-16 18:34:48,913::task::579::TaskManager.Task::(_updateState) Task=`fba7b755-71ec-4f0b-a437-0bfff41475df`::moving from state preparing -> state finished >Thread-56410::DEBUG::2014-05-16 18:34:48,913::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56410::DEBUG::2014-05-16 18:34:48,913::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56410::DEBUG::2014-05-16 18:34:48,913::task::974::TaskManager.Task::(_decref) Task=`fba7b755-71ec-4f0b-a437-0bfff41475df`::ref 0 aborting False >Thread-56411::DEBUG::2014-05-16 18:34:48,947::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56411::DEBUG::2014-05-16 18:34:48,947::task::579::TaskManager.Task::(_updateState) Task=`d99c4e0a-b120-4862-a5cd-062199950d7a`::moving from state init -> state preparing >Thread-56411::INFO::2014-05-16 18:34:48,948::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56411::DEBUG::2014-05-16 18:34:48,948::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d28c2ec9-83be-485f-a9ad-7af32df3fc4c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56411::DEBUG::2014-05-16 18:34:48,948::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56411::DEBUG::2014-05-16 18:34:48,948::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56411::DEBUG::2014-05-16 18:34:48,948::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`d28c2ec9-83be-485f-a9ad-7af32df3fc4c`::Granted request >Thread-56411::DEBUG::2014-05-16 18:34:48,949::task::811::TaskManager.Task::(resourceAcquired) Task=`d99c4e0a-b120-4862-a5cd-062199950d7a`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56411::DEBUG::2014-05-16 18:34:48,949::task::974::TaskManager.Task::(_decref) Task=`d99c4e0a-b120-4862-a5cd-062199950d7a`::ref 1 aborting False >Thread-56411::INFO::2014-05-16 18:34:48,949::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56411::DEBUG::2014-05-16 18:34:48,950::task::1168::TaskManager.Task::(prepare) Task=`d99c4e0a-b120-4862-a5cd-062199950d7a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56411::DEBUG::2014-05-16 18:34:48,950::task::579::TaskManager.Task::(_updateState) Task=`d99c4e0a-b120-4862-a5cd-062199950d7a`::moving from state preparing -> state finished >Thread-56411::DEBUG::2014-05-16 18:34:48,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56411::DEBUG::2014-05-16 18:34:48,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56411::DEBUG::2014-05-16 18:34:48,950::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56411::DEBUG::2014-05-16 18:34:48,950::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56411::DEBUG::2014-05-16 18:34:48,950::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56411::DEBUG::2014-05-16 18:34:48,951::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56411::DEBUG::2014-05-16 18:34:48,951::task::974::TaskManager.Task::(_decref) Task=`d99c4e0a-b120-4862-a5cd-062199950d7a`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:34:49,001::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:49,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313825 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:51,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:51,147::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317111 s, 32.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:34:51,623::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:34:51,634::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722535 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:53,159::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:53,277::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349195 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:55,284::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:55,352::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323481 s, 31.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:34:57,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:57,435::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354368 s, 28.9 MB/s\n'; <rc> = 0 >Thread-56414::DEBUG::2014-05-16 18:34:57,678::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315237.000000 / 8.008285 / 262500000.000000 = 0.205275 >Thread-56414::DEBUG::2014-05-16 18:34:57,678::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053035550945567901, 'statsAge': 0.20139694213867188, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20527488721472742, 'rxDropped': 0} >Thread-56414::DEBUG::2014-05-16 18:34:57,679::task::579::TaskManager.Task::(_updateState) Task=`992ae299-e106-4dc0-b4b1-42a4bc25481c`::moving from state init -> state preparing >Thread-56414::INFO::2014-05-16 18:34:57,679::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56414::INFO::2014-05-16 18:34:57,679::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722535', 'lastCheck': '6.0', 'valid': True}} >Thread-56414::DEBUG::2014-05-16 18:34:57,679::task::1168::TaskManager.Task::(prepare) Task=`992ae299-e106-4dc0-b4b1-42a4bc25481c`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722535', 'lastCheck': '6.0', 'valid': True}} >Thread-56414::DEBUG::2014-05-16 18:34:57,680::task::579::TaskManager.Task::(_updateState) Task=`992ae299-e106-4dc0-b4b1-42a4bc25481c`::moving from state preparing -> state finished >Thread-56414::DEBUG::2014-05-16 18:34:57,680::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56414::DEBUG::2014-05-16 18:34:57,680::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56414::DEBUG::2014-05-16 18:34:57,680::task::974::TaskManager.Task::(_decref) Task=`992ae299-e106-4dc0-b4b1-42a4bc25481c`::ref 0 aborting False >Thread-56416::DEBUG::2014-05-16 18:34:59,016::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56416::DEBUG::2014-05-16 18:34:59,017::task::579::TaskManager.Task::(_updateState) Task=`55e83fe8-db44-4199-9e57-6c43553888f1`::moving from state init -> state preparing >Thread-56416::INFO::2014-05-16 18:34:59,017::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56416::INFO::2014-05-16 18:34:59,017::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56416::DEBUG::2014-05-16 18:34:59,017::task::1168::TaskManager.Task::(prepare) Task=`55e83fe8-db44-4199-9e57-6c43553888f1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56416::DEBUG::2014-05-16 18:34:59,018::task::579::TaskManager.Task::(_updateState) Task=`55e83fe8-db44-4199-9e57-6c43553888f1`::moving from state preparing -> state finished >Thread-56416::DEBUG::2014-05-16 18:34:59,018::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56416::DEBUG::2014-05-16 18:34:59,018::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56416::DEBUG::2014-05-16 18:34:59,018::task::974::TaskManager.Task::(_decref) Task=`55e83fe8-db44-4199-9e57-6c43553888f1`::ref 0 aborting False >Thread-56417::DEBUG::2014-05-16 18:34:59,048::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56417::DEBUG::2014-05-16 18:34:59,049::task::579::TaskManager.Task::(_updateState) Task=`9e92403f-6c4d-4f83-8e38-32970b74f49f`::moving from state init -> state preparing >Thread-56417::INFO::2014-05-16 18:34:59,049::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56417::DEBUG::2014-05-16 18:34:59,049::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c6cc98ef-e05a-4f92-9b8a-8ef6d46f49fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56417::DEBUG::2014-05-16 18:34:59,049::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56417::DEBUG::2014-05-16 18:34:59,050::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56417::DEBUG::2014-05-16 18:34:59,050::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`c6cc98ef-e05a-4f92-9b8a-8ef6d46f49fb`::Granted request >Thread-56417::DEBUG::2014-05-16 18:34:59,050::task::811::TaskManager.Task::(resourceAcquired) Task=`9e92403f-6c4d-4f83-8e38-32970b74f49f`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56417::DEBUG::2014-05-16 18:34:59,050::task::974::TaskManager.Task::(_decref) Task=`9e92403f-6c4d-4f83-8e38-32970b74f49f`::ref 1 aborting False >Thread-56417::INFO::2014-05-16 18:34:59,051::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56417::DEBUG::2014-05-16 18:34:59,051::task::1168::TaskManager.Task::(prepare) Task=`9e92403f-6c4d-4f83-8e38-32970b74f49f`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56417::DEBUG::2014-05-16 18:34:59,051::task::579::TaskManager.Task::(_updateState) Task=`9e92403f-6c4d-4f83-8e38-32970b74f49f`::moving from state preparing -> state finished >Thread-56417::DEBUG::2014-05-16 18:34:59,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56417::DEBUG::2014-05-16 18:34:59,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56417::DEBUG::2014-05-16 18:34:59,052::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56417::DEBUG::2014-05-16 18:34:59,052::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56417::DEBUG::2014-05-16 18:34:59,052::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56417::DEBUG::2014-05-16 18:34:59,052::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56417::DEBUG::2014-05-16 18:34:59,052::task::974::TaskManager.Task::(_decref) Task=`9e92403f-6c4d-4f83-8e38-32970b74f49f`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:34:59,447::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:34:59,518::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335304 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:01,530::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:01,609::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356486 s, 28.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:35:01,676::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:35:01,686::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000814362 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:03,622::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:03,691::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304876 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:05,703::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:05,770::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313962 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:07,782::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:07,853::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346981 s, 29.5 MB/s\n'; <rc> = 0 >Thread-56421::DEBUG::2014-05-16 18:35:09,076::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56421::DEBUG::2014-05-16 18:35:09,076::task::579::TaskManager.Task::(_updateState) Task=`23356532-4214-41b9-9470-9782dd8b5c01`::moving from state init -> state preparing >Thread-56421::INFO::2014-05-16 18:35:09,077::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56421::INFO::2014-05-16 18:35:09,077::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56421::DEBUG::2014-05-16 18:35:09,077::task::1168::TaskManager.Task::(prepare) Task=`23356532-4214-41b9-9470-9782dd8b5c01`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56421::DEBUG::2014-05-16 18:35:09,077::task::579::TaskManager.Task::(_updateState) Task=`23356532-4214-41b9-9470-9782dd8b5c01`::moving from state preparing -> state finished >Thread-56421::DEBUG::2014-05-16 18:35:09,077::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56421::DEBUG::2014-05-16 18:35:09,078::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56421::DEBUG::2014-05-16 18:35:09,078::task::974::TaskManager.Task::(_decref) Task=`23356532-4214-41b9-9470-9782dd8b5c01`::ref 0 aborting False >Thread-56422::DEBUG::2014-05-16 18:35:09,086::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56422::DEBUG::2014-05-16 18:35:09,086::task::579::TaskManager.Task::(_updateState) Task=`d10760eb-f976-4745-bbcd-f82a998a6445`::moving from state init -> state preparing >Thread-56422::INFO::2014-05-16 18:35:09,086::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56422::DEBUG::2014-05-16 18:35:09,086::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ac1045ba-7239-4952-8a03-4cc2bff24efe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56422::DEBUG::2014-05-16 18:35:09,087::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56422::DEBUG::2014-05-16 18:35:09,087::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56422::DEBUG::2014-05-16 18:35:09,087::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ac1045ba-7239-4952-8a03-4cc2bff24efe`::Granted request >Thread-56422::DEBUG::2014-05-16 18:35:09,116::task::811::TaskManager.Task::(resourceAcquired) Task=`d10760eb-f976-4745-bbcd-f82a998a6445`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56422::DEBUG::2014-05-16 18:35:09,116::task::974::TaskManager.Task::(_decref) Task=`d10760eb-f976-4745-bbcd-f82a998a6445`::ref 1 aborting False >Thread-56422::INFO::2014-05-16 18:35:09,117::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56422::DEBUG::2014-05-16 18:35:09,117::task::1168::TaskManager.Task::(prepare) Task=`d10760eb-f976-4745-bbcd-f82a998a6445`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56422::DEBUG::2014-05-16 18:35:09,117::task::579::TaskManager.Task::(_updateState) Task=`d10760eb-f976-4745-bbcd-f82a998a6445`::moving from state preparing -> state finished >Thread-56422::DEBUG::2014-05-16 18:35:09,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56422::DEBUG::2014-05-16 18:35:09,118::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56422::DEBUG::2014-05-16 18:35:09,118::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56422::DEBUG::2014-05-16 18:35:09,118::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56422::DEBUG::2014-05-16 18:35:09,118::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56422::DEBUG::2014-05-16 18:35:09,118::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56422::DEBUG::2014-05-16 18:35:09,118::task::974::TaskManager.Task::(_decref) Task=`d10760eb-f976-4745-bbcd-f82a998a6445`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:35:09,864::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:09,931::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310622 s, 33.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:35:11,724::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:35:11,735::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106217 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:11,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:12,014::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035032 s, 29.2 MB/s\n'; <rc> = 0 >Thread-56424::DEBUG::2014-05-16 18:35:13,195::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5417666.000000 / 8.008121 / 262500000.000000 = 0.257722 >Thread-56424::DEBUG::2014-05-16 18:35:13,195::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '19.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.006994613866386167, 'statsAge': 1.7020108699798584, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25772247427193939, 'rxDropped': 0} >Thread-56424::DEBUG::2014-05-16 18:35:13,196::task::579::TaskManager.Task::(_updateState) Task=`92739047-9b63-49fe-b744-8ce1c05cd6fb`::moving from state init -> state preparing >Thread-56424::INFO::2014-05-16 18:35:13,196::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56424::INFO::2014-05-16 18:35:13,196::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106217', 'lastCheck': '1.4', 'valid': True}} >Thread-56424::DEBUG::2014-05-16 18:35:13,196::task::1168::TaskManager.Task::(prepare) Task=`92739047-9b63-49fe-b744-8ce1c05cd6fb`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106217', 'lastCheck': '1.4', 'valid': True}} >Thread-56424::DEBUG::2014-05-16 18:35:13,196::task::579::TaskManager.Task::(_updateState) Task=`92739047-9b63-49fe-b744-8ce1c05cd6fb`::moving from state preparing -> state finished >Thread-56424::DEBUG::2014-05-16 18:35:13,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56424::DEBUG::2014-05-16 18:35:13,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56424::DEBUG::2014-05-16 18:35:13,197::task::974::TaskManager.Task::(_decref) Task=`92739047-9b63-49fe-b744-8ce1c05cd6fb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:35:14,026::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:14,098::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364202 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:16,109::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:16,177::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313772 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:18,188::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:18,255::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308772 s, 33.2 MB/s\n'; <rc> = 0 >Thread-56427::DEBUG::2014-05-16 18:35:19,183::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56427::DEBUG::2014-05-16 18:35:19,183::task::579::TaskManager.Task::(_updateState) Task=`79173834-1607-4274-80a2-aecbdc3df6ae`::moving from state init -> state preparing >Thread-56427::INFO::2014-05-16 18:35:19,183::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56427::INFO::2014-05-16 18:35:19,184::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56427::DEBUG::2014-05-16 18:35:19,184::task::1168::TaskManager.Task::(prepare) Task=`79173834-1607-4274-80a2-aecbdc3df6ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56427::DEBUG::2014-05-16 18:35:19,184::task::579::TaskManager.Task::(_updateState) Task=`79173834-1607-4274-80a2-aecbdc3df6ae`::moving from state preparing -> state finished >Thread-56427::DEBUG::2014-05-16 18:35:19,184::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56427::DEBUG::2014-05-16 18:35:19,184::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56427::DEBUG::2014-05-16 18:35:19,185::task::974::TaskManager.Task::(_decref) Task=`79173834-1607-4274-80a2-aecbdc3df6ae`::ref 0 aborting False >Thread-56428::DEBUG::2014-05-16 18:35:19,194::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56428::DEBUG::2014-05-16 18:35:19,194::task::579::TaskManager.Task::(_updateState) Task=`6022fb7f-4611-47f1-adf3-2e9be80efa1c`::moving from state init -> state preparing >Thread-56428::INFO::2014-05-16 18:35:19,194::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56428::DEBUG::2014-05-16 18:35:19,194::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8452ae90-4ac1-478b-833b-f8e242fd5013`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56428::DEBUG::2014-05-16 18:35:19,195::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56428::DEBUG::2014-05-16 18:35:19,195::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56428::DEBUG::2014-05-16 18:35:19,195::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`8452ae90-4ac1-478b-833b-f8e242fd5013`::Granted request >Thread-56428::DEBUG::2014-05-16 18:35:19,195::task::811::TaskManager.Task::(resourceAcquired) Task=`6022fb7f-4611-47f1-adf3-2e9be80efa1c`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56428::DEBUG::2014-05-16 18:35:19,196::task::974::TaskManager.Task::(_decref) Task=`6022fb7f-4611-47f1-adf3-2e9be80efa1c`::ref 1 aborting False >Thread-56428::INFO::2014-05-16 18:35:19,196::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56428::DEBUG::2014-05-16 18:35:19,196::task::1168::TaskManager.Task::(prepare) Task=`6022fb7f-4611-47f1-adf3-2e9be80efa1c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56428::DEBUG::2014-05-16 18:35:19,196::task::579::TaskManager.Task::(_updateState) Task=`6022fb7f-4611-47f1-adf3-2e9be80efa1c`::moving from state preparing -> state finished >Thread-56428::DEBUG::2014-05-16 18:35:19,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56428::DEBUG::2014-05-16 18:35:19,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56428::DEBUG::2014-05-16 18:35:19,197::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56428::DEBUG::2014-05-16 18:35:19,197::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56428::DEBUG::2014-05-16 18:35:19,197::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56428::DEBUG::2014-05-16 18:35:19,197::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56428::DEBUG::2014-05-16 18:35:19,198::task::974::TaskManager.Task::(_decref) Task=`6022fb7f-4611-47f1-adf3-2e9be80efa1c`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:35:20,267::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:20,335::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0316651 s, 32.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:35:21,773::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:35:21,783::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109879 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:22,347::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:22,417::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348498 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:24,429::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:24,496::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303064 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:26,507::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:26,576::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318592 s, 32.1 MB/s\n'; <rc> = 0 >Thread-56432::DEBUG::2014-05-16 18:35:28,494::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5420126.000000 / 8.008426 / 262500000.000000 = 0.257830 >Thread-56432::DEBUG::2014-05-16 18:35:28,494::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '70.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066718298800615417, 'statsAge': 0.98484301567077637, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25782967288742331, 'rxDropped': 0} >Thread-56432::DEBUG::2014-05-16 18:35:28,495::task::579::TaskManager.Task::(_updateState) Task=`665e8286-e418-444c-9664-daf522bdd265`::moving from state init -> state preparing >Thread-56432::INFO::2014-05-16 18:35:28,495::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56432::INFO::2014-05-16 18:35:28,495::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109879', 'lastCheck': '6.7', 'valid': True}} >Thread-56432::DEBUG::2014-05-16 18:35:28,496::task::1168::TaskManager.Task::(prepare) Task=`665e8286-e418-444c-9664-daf522bdd265`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109879', 'lastCheck': '6.7', 'valid': True}} >Thread-56432::DEBUG::2014-05-16 18:35:28,496::task::579::TaskManager.Task::(_updateState) Task=`665e8286-e418-444c-9664-daf522bdd265`::moving from state preparing -> state finished >Thread-56432::DEBUG::2014-05-16 18:35:28,496::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56432::DEBUG::2014-05-16 18:35:28,496::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56432::DEBUG::2014-05-16 18:35:28,496::task::974::TaskManager.Task::(_decref) Task=`665e8286-e418-444c-9664-daf522bdd265`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:35:28,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:28,658::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351323 s, 29.1 MB/s\n'; <rc> = 0 >Thread-56434::DEBUG::2014-05-16 18:35:29,234::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56434::DEBUG::2014-05-16 18:35:29,234::task::579::TaskManager.Task::(_updateState) Task=`0219ac81-57b2-445d-8843-f0156b2b88d8`::moving from state init -> state preparing >Thread-56434::INFO::2014-05-16 18:35:29,235::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56434::INFO::2014-05-16 18:35:29,235::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56434::DEBUG::2014-05-16 18:35:29,235::task::1168::TaskManager.Task::(prepare) Task=`0219ac81-57b2-445d-8843-f0156b2b88d8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56434::DEBUG::2014-05-16 18:35:29,235::task::579::TaskManager.Task::(_updateState) Task=`0219ac81-57b2-445d-8843-f0156b2b88d8`::moving from state preparing -> state finished >Thread-56434::DEBUG::2014-05-16 18:35:29,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56434::DEBUG::2014-05-16 18:35:29,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56434::DEBUG::2014-05-16 18:35:29,236::task::974::TaskManager.Task::(_decref) Task=`0219ac81-57b2-445d-8843-f0156b2b88d8`::ref 0 aborting False >Thread-56435::DEBUG::2014-05-16 18:35:29,259::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56435::DEBUG::2014-05-16 18:35:29,260::task::579::TaskManager.Task::(_updateState) Task=`322c7cff-6b45-44ff-af58-d732bc854895`::moving from state init -> state preparing >Thread-56435::INFO::2014-05-16 18:35:29,260::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56435::DEBUG::2014-05-16 18:35:29,260::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1ae3b58c-6857-4602-b73e-6c8daa319acc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56435::DEBUG::2014-05-16 18:35:29,260::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56435::DEBUG::2014-05-16 18:35:29,261::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56435::DEBUG::2014-05-16 18:35:29,261::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`1ae3b58c-6857-4602-b73e-6c8daa319acc`::Granted request >Thread-56435::DEBUG::2014-05-16 18:35:29,261::task::811::TaskManager.Task::(resourceAcquired) Task=`322c7cff-6b45-44ff-af58-d732bc854895`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56435::DEBUG::2014-05-16 18:35:29,261::task::974::TaskManager.Task::(_decref) Task=`322c7cff-6b45-44ff-af58-d732bc854895`::ref 1 aborting False >Thread-56435::INFO::2014-05-16 18:35:29,262::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56435::DEBUG::2014-05-16 18:35:29,262::task::1168::TaskManager.Task::(prepare) Task=`322c7cff-6b45-44ff-af58-d732bc854895`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56435::DEBUG::2014-05-16 18:35:29,262::task::579::TaskManager.Task::(_updateState) Task=`322c7cff-6b45-44ff-af58-d732bc854895`::moving from state preparing -> state finished >Thread-56435::DEBUG::2014-05-16 18:35:29,262::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56435::DEBUG::2014-05-16 18:35:29,263::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56435::DEBUG::2014-05-16 18:35:29,263::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56435::DEBUG::2014-05-16 18:35:29,263::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56435::DEBUG::2014-05-16 18:35:29,263::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56435::DEBUG::2014-05-16 18:35:29,263::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56435::DEBUG::2014-05-16 18:35:29,264::task::974::TaskManager.Task::(_decref) Task=`322c7cff-6b45-44ff-af58-d732bc854895`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:35:30,670::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:30,739::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317742 s, 32.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:35:31,820::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:35:31,830::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780843 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:32,751::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:32,818::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308695 s, 33.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:34,829::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:34,909::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368211 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:36,921::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:36,991::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350305 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:39,003::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:39,070::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314281 s, 32.6 MB/s\n'; <rc> = 0 >Thread-56439::DEBUG::2014-05-16 18:35:39,405::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56439::DEBUG::2014-05-16 18:35:39,406::task::579::TaskManager.Task::(_updateState) Task=`a98d0e46-f088-4d9d-ad30-71306e52d3d2`::moving from state init -> state preparing >Thread-56439::INFO::2014-05-16 18:35:39,406::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56439::INFO::2014-05-16 18:35:39,406::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56439::DEBUG::2014-05-16 18:35:39,406::task::1168::TaskManager.Task::(prepare) Task=`a98d0e46-f088-4d9d-ad30-71306e52d3d2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56439::DEBUG::2014-05-16 18:35:39,406::task::579::TaskManager.Task::(_updateState) Task=`a98d0e46-f088-4d9d-ad30-71306e52d3d2`::moving from state preparing -> state finished >Thread-56439::DEBUG::2014-05-16 18:35:39,407::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56439::DEBUG::2014-05-16 18:35:39,407::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56439::DEBUG::2014-05-16 18:35:39,407::task::974::TaskManager.Task::(_decref) Task=`a98d0e46-f088-4d9d-ad30-71306e52d3d2`::ref 0 aborting False >Thread-56440::DEBUG::2014-05-16 18:35:39,502::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56440::DEBUG::2014-05-16 18:35:39,503::task::579::TaskManager.Task::(_updateState) Task=`7bfea7ce-6a13-4939-a42d-05b558fffea8`::moving from state init -> state preparing >Thread-56440::INFO::2014-05-16 18:35:39,503::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56440::DEBUG::2014-05-16 18:35:39,503::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`365f0f22-bd67-4204-99c2-75de029cb202`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56440::DEBUG::2014-05-16 18:35:39,504::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56440::DEBUG::2014-05-16 18:35:39,504::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56440::DEBUG::2014-05-16 18:35:39,504::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`365f0f22-bd67-4204-99c2-75de029cb202`::Granted request >Thread-56440::DEBUG::2014-05-16 18:35:39,504::task::811::TaskManager.Task::(resourceAcquired) Task=`7bfea7ce-6a13-4939-a42d-05b558fffea8`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56440::DEBUG::2014-05-16 18:35:39,504::task::974::TaskManager.Task::(_decref) Task=`7bfea7ce-6a13-4939-a42d-05b558fffea8`::ref 1 aborting False >Thread-56440::INFO::2014-05-16 18:35:39,505::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56440::DEBUG::2014-05-16 18:35:39,505::task::1168::TaskManager.Task::(prepare) Task=`7bfea7ce-6a13-4939-a42d-05b558fffea8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56440::DEBUG::2014-05-16 18:35:39,505::task::579::TaskManager.Task::(_updateState) Task=`7bfea7ce-6a13-4939-a42d-05b558fffea8`::moving from state preparing -> state finished >Thread-56440::DEBUG::2014-05-16 18:35:39,506::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56440::DEBUG::2014-05-16 18:35:39,506::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56440::DEBUG::2014-05-16 18:35:39,506::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56440::DEBUG::2014-05-16 18:35:39,506::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56440::DEBUG::2014-05-16 18:35:39,506::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56440::DEBUG::2014-05-16 18:35:39,506::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56440::DEBUG::2014-05-16 18:35:39,507::task::974::TaskManager.Task::(_decref) Task=`7bfea7ce-6a13-4939-a42d-05b558fffea8`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:35:41,082::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:41,154::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365167 s, 28.0 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:35:41,868::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:35:41,879::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000835601 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:43,166::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:43,237::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350084 s, 29.3 MB/s\n'; <rc> = 0 >Thread-56442::DEBUG::2014-05-16 18:35:43,962::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4315871.000000 / 8.008336 / 262500000.000000 = 0.205304 >Thread-56442::DEBUG::2014-05-16 18:35:43,962::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '74.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053840088651560779, 'statsAge': 0.43546795845031738, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20530373844666136, 'rxDropped': 0} >Thread-56442::DEBUG::2014-05-16 18:35:43,962::task::579::TaskManager.Task::(_updateState) Task=`6e270d79-463d-4087-a920-9d4c2d489fe3`::moving from state init -> state preparing >Thread-56442::INFO::2014-05-16 18:35:43,962::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56442::INFO::2014-05-16 18:35:43,963::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000835601', 'lastCheck': '2.1', 'valid': True}} >Thread-56442::DEBUG::2014-05-16 18:35:43,963::task::1168::TaskManager.Task::(prepare) Task=`6e270d79-463d-4087-a920-9d4c2d489fe3`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000835601', 'lastCheck': '2.1', 'valid': True}} >Thread-56442::DEBUG::2014-05-16 18:35:43,963::task::579::TaskManager.Task::(_updateState) Task=`6e270d79-463d-4087-a920-9d4c2d489fe3`::moving from state preparing -> state finished >Thread-56442::DEBUG::2014-05-16 18:35:43,963::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56442::DEBUG::2014-05-16 18:35:43,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56442::DEBUG::2014-05-16 18:35:43,963::task::974::TaskManager.Task::(_decref) Task=`6e270d79-463d-4087-a920-9d4c2d489fe3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:35:45,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:45,315::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299216 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:47,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:47,395::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032137 s, 31.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:49,407::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:49,477::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350593 s, 29.2 MB/s\n'; <rc> = 0 >Thread-56445::DEBUG::2014-05-16 18:35:49,548::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56445::DEBUG::2014-05-16 18:35:49,549::task::579::TaskManager.Task::(_updateState) Task=`2f3cd2bf-a184-45f6-809a-c7d69642cd8b`::moving from state init -> state preparing >Thread-56445::INFO::2014-05-16 18:35:49,549::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56445::INFO::2014-05-16 18:35:49,549::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56445::DEBUG::2014-05-16 18:35:49,549::task::1168::TaskManager.Task::(prepare) Task=`2f3cd2bf-a184-45f6-809a-c7d69642cd8b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56445::DEBUG::2014-05-16 18:35:49,549::task::579::TaskManager.Task::(_updateState) Task=`2f3cd2bf-a184-45f6-809a-c7d69642cd8b`::moving from state preparing -> state finished >Thread-56445::DEBUG::2014-05-16 18:35:49,550::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56445::DEBUG::2014-05-16 18:35:49,550::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56445::DEBUG::2014-05-16 18:35:49,550::task::974::TaskManager.Task::(_decref) Task=`2f3cd2bf-a184-45f6-809a-c7d69642cd8b`::ref 0 aborting False >Thread-56446::DEBUG::2014-05-16 18:35:49,597::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56446::DEBUG::2014-05-16 18:35:49,597::task::579::TaskManager.Task::(_updateState) Task=`61f2fd49-96b3-49fb-b42f-b826d36204f9`::moving from state init -> state preparing >Thread-56446::INFO::2014-05-16 18:35:49,597::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56446::DEBUG::2014-05-16 18:35:49,598::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f2f6cc35-3f89-457c-bc43-7ac394a9650a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56446::DEBUG::2014-05-16 18:35:49,598::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56446::DEBUG::2014-05-16 18:35:49,598::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56446::DEBUG::2014-05-16 18:35:49,599::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`f2f6cc35-3f89-457c-bc43-7ac394a9650a`::Granted request >Thread-56446::DEBUG::2014-05-16 18:35:49,599::task::811::TaskManager.Task::(resourceAcquired) Task=`61f2fd49-96b3-49fb-b42f-b826d36204f9`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56446::DEBUG::2014-05-16 18:35:49,600::task::974::TaskManager.Task::(_decref) Task=`61f2fd49-96b3-49fb-b42f-b826d36204f9`::ref 1 aborting False >Thread-56446::INFO::2014-05-16 18:35:49,600::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56446::DEBUG::2014-05-16 18:35:49,600::task::1168::TaskManager.Task::(prepare) Task=`61f2fd49-96b3-49fb-b42f-b826d36204f9`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56446::DEBUG::2014-05-16 18:35:49,601::task::579::TaskManager.Task::(_updateState) Task=`61f2fd49-96b3-49fb-b42f-b826d36204f9`::moving from state preparing -> state finished >Thread-56446::DEBUG::2014-05-16 18:35:49,601::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56446::DEBUG::2014-05-16 18:35:49,601::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56446::DEBUG::2014-05-16 18:35:49,601::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56446::DEBUG::2014-05-16 18:35:49,601::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56446::DEBUG::2014-05-16 18:35:49,601::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56446::DEBUG::2014-05-16 18:35:49,602::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56446::DEBUG::2014-05-16 18:35:49,602::task::974::TaskManager.Task::(_decref) Task=`61f2fd49-96b3-49fb-b42f-b826d36204f9`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:35:51,489::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:51,562::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319172 s, 32.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:35:51,916::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:35:51,927::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780262 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:53,573::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:53,641::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031019 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:55,653::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:55,725::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355954 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:35:57,736::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:57,807::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352271 s, 29.1 MB/s\n'; <rc> = 0 >Thread-56450::DEBUG::2014-05-16 18:35:59,214::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4321437.000000 / 8.011352 / 262500000.000000 = 0.205491 >Thread-56450::DEBUG::2014-05-16 18:35:59,214::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '14.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '16.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0053878783682114956, 'statsAge': 1.6697838306427002, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.20549112078697318, 'rxDropped': 0} >Thread-56450::DEBUG::2014-05-16 18:35:59,215::task::579::TaskManager.Task::(_updateState) Task=`fce565db-81d1-4116-aa41-9b4b4d3a5beb`::moving from state init -> state preparing >Thread-56450::INFO::2014-05-16 18:35:59,215::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56450::INFO::2014-05-16 18:35:59,215::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780262', 'lastCheck': '7.3', 'valid': True}} >Thread-56450::DEBUG::2014-05-16 18:35:59,215::task::1168::TaskManager.Task::(prepare) Task=`fce565db-81d1-4116-aa41-9b4b4d3a5beb`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780262', 'lastCheck': '7.3', 'valid': True}} >Thread-56450::DEBUG::2014-05-16 18:35:59,215::task::579::TaskManager.Task::(_updateState) Task=`fce565db-81d1-4116-aa41-9b4b4d3a5beb`::moving from state preparing -> state finished >Thread-56450::DEBUG::2014-05-16 18:35:59,215::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56450::DEBUG::2014-05-16 18:35:59,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56450::DEBUG::2014-05-16 18:35:59,216::task::974::TaskManager.Task::(_decref) Task=`fce565db-81d1-4116-aa41-9b4b4d3a5beb`::ref 0 aborting False >Thread-56452::DEBUG::2014-05-16 18:35:59,632::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56452::DEBUG::2014-05-16 18:35:59,632::task::579::TaskManager.Task::(_updateState) Task=`99432706-7f9e-4e3b-8d4d-5ef10cdda6b9`::moving from state init -> state preparing >Thread-56452::INFO::2014-05-16 18:35:59,632::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56452::INFO::2014-05-16 18:35:59,633::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56452::DEBUG::2014-05-16 18:35:59,633::task::1168::TaskManager.Task::(prepare) Task=`99432706-7f9e-4e3b-8d4d-5ef10cdda6b9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56452::DEBUG::2014-05-16 18:35:59,633::task::579::TaskManager.Task::(_updateState) Task=`99432706-7f9e-4e3b-8d4d-5ef10cdda6b9`::moving from state preparing -> state finished >Thread-56452::DEBUG::2014-05-16 18:35:59,633::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56452::DEBUG::2014-05-16 18:35:59,633::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56452::DEBUG::2014-05-16 18:35:59,633::task::974::TaskManager.Task::(_decref) Task=`99432706-7f9e-4e3b-8d4d-5ef10cdda6b9`::ref 0 aborting False >Thread-56453::DEBUG::2014-05-16 18:35:59,641::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56453::DEBUG::2014-05-16 18:35:59,641::task::579::TaskManager.Task::(_updateState) Task=`c2979912-c403-4255-ae85-b3676c048996`::moving from state init -> state preparing >Thread-56453::INFO::2014-05-16 18:35:59,641::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56453::DEBUG::2014-05-16 18:35:59,642::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b351f75f-2c59-42d9-b40e-ef77e58a6690`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56453::DEBUG::2014-05-16 18:35:59,642::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56453::DEBUG::2014-05-16 18:35:59,642::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56453::DEBUG::2014-05-16 18:35:59,642::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`b351f75f-2c59-42d9-b40e-ef77e58a6690`::Granted request >Thread-56453::DEBUG::2014-05-16 18:35:59,642::task::811::TaskManager.Task::(resourceAcquired) Task=`c2979912-c403-4255-ae85-b3676c048996`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56453::DEBUG::2014-05-16 18:35:59,643::task::974::TaskManager.Task::(_decref) Task=`c2979912-c403-4255-ae85-b3676c048996`::ref 1 aborting False >Thread-56453::INFO::2014-05-16 18:35:59,643::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56453::DEBUG::2014-05-16 18:35:59,643::task::1168::TaskManager.Task::(prepare) Task=`c2979912-c403-4255-ae85-b3676c048996`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56453::DEBUG::2014-05-16 18:35:59,643::task::579::TaskManager.Task::(_updateState) Task=`c2979912-c403-4255-ae85-b3676c048996`::moving from state preparing -> state finished >Thread-56453::DEBUG::2014-05-16 18:35:59,644::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56453::DEBUG::2014-05-16 18:35:59,644::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56453::DEBUG::2014-05-16 18:35:59,644::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56453::DEBUG::2014-05-16 18:35:59,644::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56453::DEBUG::2014-05-16 18:35:59,644::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56453::DEBUG::2014-05-16 18:35:59,644::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56453::DEBUG::2014-05-16 18:35:59,644::task::974::TaskManager.Task::(_decref) Task=`c2979912-c403-4255-ae85-b3676c048996`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:35:59,819::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:35:59,887::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314533 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:01,899::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-30::DEBUG::2014-05-16 18:36:02,117::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:36:02,153::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000812778 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:02,285::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353342 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:04,297::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:04,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0302648 s, 33.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:06,375::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:06,442::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309256 s, 33.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:08,454::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:08,524::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311793 s, 32.8 MB/s\n'; <rc> = 0 >Thread-56457::DEBUG::2014-05-16 18:36:09,782::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56457::DEBUG::2014-05-16 18:36:09,783::task::579::TaskManager.Task::(_updateState) Task=`20032654-1d8e-4389-8ede-76c5533035b6`::moving from state init -> state preparing >Thread-56457::INFO::2014-05-16 18:36:09,783::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56457::INFO::2014-05-16 18:36:09,784::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56457::DEBUG::2014-05-16 18:36:09,784::task::1168::TaskManager.Task::(prepare) Task=`20032654-1d8e-4389-8ede-76c5533035b6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56457::DEBUG::2014-05-16 18:36:09,784::task::579::TaskManager.Task::(_updateState) Task=`20032654-1d8e-4389-8ede-76c5533035b6`::moving from state preparing -> state finished >Thread-56457::DEBUG::2014-05-16 18:36:09,784::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56457::DEBUG::2014-05-16 18:36:09,784::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56457::DEBUG::2014-05-16 18:36:09,784::task::974::TaskManager.Task::(_decref) Task=`20032654-1d8e-4389-8ede-76c5533035b6`::ref 0 aborting False >Thread-56458::DEBUG::2014-05-16 18:36:09,850::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56458::DEBUG::2014-05-16 18:36:09,850::task::579::TaskManager.Task::(_updateState) Task=`ea52600f-76ba-463c-b7d9-9104e91db574`::moving from state init -> state preparing >Thread-56458::INFO::2014-05-16 18:36:09,850::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56458::DEBUG::2014-05-16 18:36:09,851::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`52ec9142-2119-4d61-88cc-7bc92fcb73f2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56458::DEBUG::2014-05-16 18:36:09,851::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56458::DEBUG::2014-05-16 18:36:09,851::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56458::DEBUG::2014-05-16 18:36:09,851::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`52ec9142-2119-4d61-88cc-7bc92fcb73f2`::Granted request >Thread-56458::DEBUG::2014-05-16 18:36:09,852::task::811::TaskManager.Task::(resourceAcquired) Task=`ea52600f-76ba-463c-b7d9-9104e91db574`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56458::DEBUG::2014-05-16 18:36:09,852::task::974::TaskManager.Task::(_decref) Task=`ea52600f-76ba-463c-b7d9-9104e91db574`::ref 1 aborting False >Thread-56458::INFO::2014-05-16 18:36:09,852::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56458::DEBUG::2014-05-16 18:36:09,853::task::1168::TaskManager.Task::(prepare) Task=`ea52600f-76ba-463c-b7d9-9104e91db574`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56458::DEBUG::2014-05-16 18:36:09,853::task::579::TaskManager.Task::(_updateState) Task=`ea52600f-76ba-463c-b7d9-9104e91db574`::moving from state preparing -> state finished >Thread-56458::DEBUG::2014-05-16 18:36:09,853::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56458::DEBUG::2014-05-16 18:36:09,853::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56458::DEBUG::2014-05-16 18:36:09,853::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56458::DEBUG::2014-05-16 18:36:09,854::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56458::DEBUG::2014-05-16 18:36:09,854::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56458::DEBUG::2014-05-16 18:36:09,854::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56458::DEBUG::2014-05-16 18:36:09,854::task::974::TaskManager.Task::(_decref) Task=`ea52600f-76ba-463c-b7d9-9104e91db574`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:36:10,536::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:10,608::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355765 s, 28.8 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:36:12,297::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:36:12,307::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108583 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:12,619::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:12,690::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349136 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:14,703::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:14,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322144 s, 31.8 MB/s\n'; <rc> = 0 >Thread-56460::DEBUG::2014-05-16 18:36:14,858::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5415592.000000 / 8.008318 / 262500000.000000 = 0.257617 >Thread-56460::DEBUG::2014-05-16 18:36:14,858::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0066311053518201615, 'statsAge': 1.297166109085083, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.25761747725558798, 'rxDropped': 0} >Thread-56460::DEBUG::2014-05-16 18:36:14,859::task::579::TaskManager.Task::(_updateState) Task=`da335e63-0731-4eff-9251-e211371098c3`::moving from state init -> state preparing >Thread-56460::INFO::2014-05-16 18:36:14,859::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56460::INFO::2014-05-16 18:36:14,859::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108583', 'lastCheck': '2.5', 'valid': True}} >Thread-56460::DEBUG::2014-05-16 18:36:14,859::task::1168::TaskManager.Task::(prepare) Task=`da335e63-0731-4eff-9251-e211371098c3`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108583', 'lastCheck': '2.5', 'valid': True}} >Thread-56460::DEBUG::2014-05-16 18:36:14,859::task::579::TaskManager.Task::(_updateState) Task=`da335e63-0731-4eff-9251-e211371098c3`::moving from state preparing -> state finished >Thread-56460::DEBUG::2014-05-16 18:36:14,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56460::DEBUG::2014-05-16 18:36:14,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56460::DEBUG::2014-05-16 18:36:14,860::task::974::TaskManager.Task::(_decref) Task=`da335e63-0731-4eff-9251-e211371098c3`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:36:16,785::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:16,856::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348984 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:18,868::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:18,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031511 s, 32.5 MB/s\n'; <rc> = 0 >Thread-56463::DEBUG::2014-05-16 18:36:19,902::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56463::DEBUG::2014-05-16 18:36:19,902::task::579::TaskManager.Task::(_updateState) Task=`f48305bd-7ad0-456e-98c9-40fb08f30d3d`::moving from state init -> state preparing >Thread-56463::INFO::2014-05-16 18:36:19,903::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56463::INFO::2014-05-16 18:36:19,903::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56463::DEBUG::2014-05-16 18:36:19,903::task::1168::TaskManager.Task::(prepare) Task=`f48305bd-7ad0-456e-98c9-40fb08f30d3d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56463::DEBUG::2014-05-16 18:36:19,903::task::579::TaskManager.Task::(_updateState) Task=`f48305bd-7ad0-456e-98c9-40fb08f30d3d`::moving from state preparing -> state finished >Thread-56463::DEBUG::2014-05-16 18:36:19,903::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56463::DEBUG::2014-05-16 18:36:19,904::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56463::DEBUG::2014-05-16 18:36:19,904::task::974::TaskManager.Task::(_decref) Task=`f48305bd-7ad0-456e-98c9-40fb08f30d3d`::ref 0 aborting False >Thread-56464::DEBUG::2014-05-16 18:36:19,912::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56464::DEBUG::2014-05-16 18:36:19,913::task::579::TaskManager.Task::(_updateState) Task=`2b161502-8c85-448d-abf4-263bb5775fd7`::moving from state init -> state preparing >Thread-56464::INFO::2014-05-16 18:36:19,913::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56464::DEBUG::2014-05-16 18:36:19,913::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`43b91c8c-639e-46c7-908e-8475cbb2ae8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56464::DEBUG::2014-05-16 18:36:19,913::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56464::DEBUG::2014-05-16 18:36:19,914::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56464::DEBUG::2014-05-16 18:36:19,914::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`43b91c8c-639e-46c7-908e-8475cbb2ae8a`::Granted request >Thread-56464::DEBUG::2014-05-16 18:36:19,914::task::811::TaskManager.Task::(resourceAcquired) Task=`2b161502-8c85-448d-abf4-263bb5775fd7`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56464::DEBUG::2014-05-16 18:36:19,914::task::974::TaskManager.Task::(_decref) Task=`2b161502-8c85-448d-abf4-263bb5775fd7`::ref 1 aborting False >Thread-56464::INFO::2014-05-16 18:36:19,915::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56464::DEBUG::2014-05-16 18:36:19,915::task::1168::TaskManager.Task::(prepare) Task=`2b161502-8c85-448d-abf4-263bb5775fd7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56464::DEBUG::2014-05-16 18:36:19,915::task::579::TaskManager.Task::(_updateState) Task=`2b161502-8c85-448d-abf4-263bb5775fd7`::moving from state preparing -> state finished >Thread-56464::DEBUG::2014-05-16 18:36:19,915::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56464::DEBUG::2014-05-16 18:36:19,916::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56464::DEBUG::2014-05-16 18:36:19,916::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56464::DEBUG::2014-05-16 18:36:19,916::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56464::DEBUG::2014-05-16 18:36:19,916::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56464::DEBUG::2014-05-16 18:36:19,916::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56464::DEBUG::2014-05-16 18:36:19,916::task::974::TaskManager.Task::(_decref) Task=`2b161502-8c85-448d-abf4-263bb5775fd7`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:36:20,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:21,015::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317583 s, 32.2 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:36:22,344::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:36:22,355::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112063 s, 3.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:23,026::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:23,097::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035106 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:25,109::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:25,177::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318592 s, 32.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:27,188::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:27,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352655 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:29,272::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:29,343::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351066 s, 29.2 MB/s\n'; <rc> = 0 >Thread-56468::DEBUG::2014-05-16 18:36:29,977::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56468::DEBUG::2014-05-16 18:36:29,978::task::579::TaskManager.Task::(_updateState) Task=`de31dca4-abc6-4eec-896d-e435301d7008`::moving from state init -> state preparing >Thread-56468::INFO::2014-05-16 18:36:29,978::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56468::INFO::2014-05-16 18:36:29,978::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56468::DEBUG::2014-05-16 18:36:29,978::task::1168::TaskManager.Task::(prepare) Task=`de31dca4-abc6-4eec-896d-e435301d7008`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56468::DEBUG::2014-05-16 18:36:29,979::task::579::TaskManager.Task::(_updateState) Task=`de31dca4-abc6-4eec-896d-e435301d7008`::moving from state preparing -> state finished >Thread-56468::DEBUG::2014-05-16 18:36:29,979::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56468::DEBUG::2014-05-16 18:36:29,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56468::DEBUG::2014-05-16 18:36:29,979::task::974::TaskManager.Task::(_decref) Task=`de31dca4-abc6-4eec-896d-e435301d7008`::ref 0 aborting False >Thread-56469::DEBUG::2014-05-16 18:36:29,993::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56469::DEBUG::2014-05-16 18:36:29,993::task::579::TaskManager.Task::(_updateState) Task=`82b98a01-eaa7-45ba-bf1f-5f5e2d238a19`::moving from state init -> state preparing >Thread-56469::INFO::2014-05-16 18:36:29,993::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56469::DEBUG::2014-05-16 18:36:29,993::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`445ad1d0-2140-431f-9599-94def5b185e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56469::DEBUG::2014-05-16 18:36:29,993::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56469::DEBUG::2014-05-16 18:36:29,994::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56469::DEBUG::2014-05-16 18:36:29,994::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`445ad1d0-2140-431f-9599-94def5b185e3`::Granted request >Thread-56469::DEBUG::2014-05-16 18:36:29,994::task::811::TaskManager.Task::(resourceAcquired) Task=`82b98a01-eaa7-45ba-bf1f-5f5e2d238a19`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56469::DEBUG::2014-05-16 18:36:29,994::task::974::TaskManager.Task::(_decref) Task=`82b98a01-eaa7-45ba-bf1f-5f5e2d238a19`::ref 1 aborting False >Thread-56469::INFO::2014-05-16 18:36:29,995::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56469::DEBUG::2014-05-16 18:36:29,995::task::1168::TaskManager.Task::(prepare) Task=`82b98a01-eaa7-45ba-bf1f-5f5e2d238a19`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56469::DEBUG::2014-05-16 18:36:29,995::task::579::TaskManager.Task::(_updateState) Task=`82b98a01-eaa7-45ba-bf1f-5f5e2d238a19`::moving from state preparing -> state finished >Thread-56469::DEBUG::2014-05-16 18:36:29,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56469::DEBUG::2014-05-16 18:36:29,995::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56469::DEBUG::2014-05-16 18:36:29,995::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56469::DEBUG::2014-05-16 18:36:29,996::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56469::DEBUG::2014-05-16 18:36:29,996::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56469::DEBUG::2014-05-16 18:36:29,996::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56469::DEBUG::2014-05-16 18:36:29,996::task::974::TaskManager.Task::(_decref) Task=`82b98a01-eaa7-45ba-bf1f-5f5e2d238a19`::ref 0 aborting False >Thread-56470::DEBUG::2014-05-16 18:36:30,411::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 5416852.000000 / 8.008508 / 262500000.000000 = 0.257671 >Thread-56470::DEBUG::2014-05-16 18:36:30,411::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '13.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '10.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0067369779081539911, 'statsAge': 0.83413290977478027, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2576712932967567, 'rxDropped': 0} >Thread-56470::DEBUG::2014-05-16 18:36:30,412::task::579::TaskManager.Task::(_updateState) Task=`51a5d125-0d96-4faf-9f14-655f07176cbb`::moving from state init -> state preparing >Thread-56470::INFO::2014-05-16 18:36:30,412::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56470::INFO::2014-05-16 18:36:30,412::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112063', 'lastCheck': '8.0', 'valid': True}} >Thread-56470::DEBUG::2014-05-16 18:36:30,413::task::1168::TaskManager.Task::(prepare) Task=`51a5d125-0d96-4faf-9f14-655f07176cbb`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112063', 'lastCheck': '8.0', 'valid': True}} >Thread-56470::DEBUG::2014-05-16 18:36:30,413::task::579::TaskManager.Task::(_updateState) Task=`51a5d125-0d96-4faf-9f14-655f07176cbb`::moving from state preparing -> state finished >Thread-56470::DEBUG::2014-05-16 18:36:30,413::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56470::DEBUG::2014-05-16 18:36:30,413::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56470::DEBUG::2014-05-16 18:36:30,413::task::974::TaskManager.Task::(_decref) Task=`51a5d125-0d96-4faf-9f14-655f07176cbb`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:36:31,355::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:31,427::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317093 s, 32.3 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:36:32,390::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:36:32,400::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000810903 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:33,439::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:33,580::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034707 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:35,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:35,720::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315211 s, 32.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:37,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:37,802::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350256 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:39,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:39,881::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315414 s, 32.5 MB/s\n'; <rc> = 0 >Thread-56475::DEBUG::2014-05-16 18:36:40,041::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56475::DEBUG::2014-05-16 18:36:40,042::task::579::TaskManager.Task::(_updateState) Task=`b746f631-6a3c-4c69-8cc1-0b88adcfade1`::moving from state init -> state preparing >Thread-56475::INFO::2014-05-16 18:36:40,042::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56475::INFO::2014-05-16 18:36:40,042::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56475::DEBUG::2014-05-16 18:36:40,042::task::1168::TaskManager.Task::(prepare) Task=`b746f631-6a3c-4c69-8cc1-0b88adcfade1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56475::DEBUG::2014-05-16 18:36:40,043::task::579::TaskManager.Task::(_updateState) Task=`b746f631-6a3c-4c69-8cc1-0b88adcfade1`::moving from state preparing -> state finished >Thread-56475::DEBUG::2014-05-16 18:36:40,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56475::DEBUG::2014-05-16 18:36:40,043::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56475::DEBUG::2014-05-16 18:36:40,043::task::974::TaskManager.Task::(_decref) Task=`b746f631-6a3c-4c69-8cc1-0b88adcfade1`::ref 0 aborting False >Thread-56476::DEBUG::2014-05-16 18:36:40,082::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56476::DEBUG::2014-05-16 18:36:40,082::task::579::TaskManager.Task::(_updateState) Task=`8f5e237d-e8a2-4a25-9432-0727f241998b`::moving from state init -> state preparing >Thread-56476::INFO::2014-05-16 18:36:40,082::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56476::DEBUG::2014-05-16 18:36:40,082::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ab496331-b22f-46a9-bbf0-888f0e149c45`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56476::DEBUG::2014-05-16 18:36:40,083::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56476::DEBUG::2014-05-16 18:36:40,083::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56476::DEBUG::2014-05-16 18:36:40,083::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`ab496331-b22f-46a9-bbf0-888f0e149c45`::Granted request >Thread-56476::DEBUG::2014-05-16 18:36:40,083::task::811::TaskManager.Task::(resourceAcquired) Task=`8f5e237d-e8a2-4a25-9432-0727f241998b`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56476::DEBUG::2014-05-16 18:36:40,084::task::974::TaskManager.Task::(_decref) Task=`8f5e237d-e8a2-4a25-9432-0727f241998b`::ref 1 aborting False >Thread-56476::INFO::2014-05-16 18:36:40,084::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56476::DEBUG::2014-05-16 18:36:40,084::task::1168::TaskManager.Task::(prepare) Task=`8f5e237d-e8a2-4a25-9432-0727f241998b`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56476::DEBUG::2014-05-16 18:36:40,085::task::579::TaskManager.Task::(_updateState) Task=`8f5e237d-e8a2-4a25-9432-0727f241998b`::moving from state preparing -> state finished >Thread-56476::DEBUG::2014-05-16 18:36:40,085::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56476::DEBUG::2014-05-16 18:36:40,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56476::DEBUG::2014-05-16 18:36:40,085::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56476::DEBUG::2014-05-16 18:36:40,085::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56476::DEBUG::2014-05-16 18:36:40,085::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56476::DEBUG::2014-05-16 18:36:40,086::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56476::DEBUG::2014-05-16 18:36:40,086::task::974::TaskManager.Task::(_decref) Task=`8f5e237d-e8a2-4a25-9432-0727f241998b`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:36:41,893::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:41,960::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309546 s, 33.1 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:36:42,438::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:36:42,448::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000788998 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:43,972::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:44,044::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356053 s, 28.8 MB/s\n'; <rc> = 0 >Thread-56478::DEBUG::2014-05-16 18:36:45,639::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4317805.000000 / 8.008385 / 262500000.000000 = 0.205394 >Thread-56478::DEBUG::2014-05-16 18:36:45,639::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '12.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '73.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '15.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.0055290620341013957, 'statsAge': 0.03107905387878418, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2053944842741515, 'rxDropped': 0} >Thread-56478::DEBUG::2014-05-16 18:36:45,639::task::579::TaskManager.Task::(_updateState) Task=`063948b4-611c-421f-b4a8-cdac9beec8c2`::moving from state init -> state preparing >Thread-56478::INFO::2014-05-16 18:36:45,640::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56478::INFO::2014-05-16 18:36:45,640::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788998', 'lastCheck': '3.2', 'valid': True}} >Thread-56478::DEBUG::2014-05-16 18:36:45,640::task::1168::TaskManager.Task::(prepare) Task=`063948b4-611c-421f-b4a8-cdac9beec8c2`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788998', 'lastCheck': '3.2', 'valid': True}} >Thread-56478::DEBUG::2014-05-16 18:36:45,640::task::579::TaskManager.Task::(_updateState) Task=`063948b4-611c-421f-b4a8-cdac9beec8c2`::moving from state preparing -> state finished >Thread-56478::DEBUG::2014-05-16 18:36:45,640::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56478::DEBUG::2014-05-16 18:36:45,640::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56478::DEBUG::2014-05-16 18:36:45,641::task::974::TaskManager.Task::(_decref) Task=`063948b4-611c-421f-b4a8-cdac9beec8c2`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:36:46,056::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:46,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298283 s, 34.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:48,133::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:48,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313953 s, 32.6 MB/s\n'; <rc> = 0 >Thread-56481::DEBUG::2014-05-16 18:36:50,198::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56481::DEBUG::2014-05-16 18:36:50,198::task::579::TaskManager.Task::(_updateState) Task=`cf94395d-06b7-47f3-9ca3-c2b949528685`::moving from state init -> state preparing >Thread-56481::INFO::2014-05-16 18:36:50,199::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56481::INFO::2014-05-16 18:36:50,199::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56481::DEBUG::2014-05-16 18:36:50,199::task::1168::TaskManager.Task::(prepare) Task=`cf94395d-06b7-47f3-9ca3-c2b949528685`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56481::DEBUG::2014-05-16 18:36:50,199::task::579::TaskManager.Task::(_updateState) Task=`cf94395d-06b7-47f3-9ca3-c2b949528685`::moving from state preparing -> state finished >Thread-56481::DEBUG::2014-05-16 18:36:50,199::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56481::DEBUG::2014-05-16 18:36:50,199::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56481::DEBUG::2014-05-16 18:36:50,200::task::974::TaskManager.Task::(_decref) Task=`cf94395d-06b7-47f3-9ca3-c2b949528685`::ref 0 aborting False >Thread-56482::DEBUG::2014-05-16 18:36:50,208::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56482::DEBUG::2014-05-16 18:36:50,208::task::579::TaskManager.Task::(_updateState) Task=`1c690bae-d371-4ebe-a57b-a6b7740f7338`::moving from state init -> state preparing >Thread-56482::INFO::2014-05-16 18:36:50,208::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56482::DEBUG::2014-05-16 18:36:50,209::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0e8eed73-314b-44a0-aa54-350643f83f41`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56482::DEBUG::2014-05-16 18:36:50,209::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56482::DEBUG::2014-05-16 18:36:50,209::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56482::DEBUG::2014-05-16 18:36:50,209::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`0e8eed73-314b-44a0-aa54-350643f83f41`::Granted request >Thread-56482::DEBUG::2014-05-16 18:36:50,209::task::811::TaskManager.Task::(resourceAcquired) Task=`1c690bae-d371-4ebe-a57b-a6b7740f7338`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56482::DEBUG::2014-05-16 18:36:50,210::task::974::TaskManager.Task::(_decref) Task=`1c690bae-d371-4ebe-a57b-a6b7740f7338`::ref 1 aborting False >Thread-56482::INFO::2014-05-16 18:36:50,210::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56482::DEBUG::2014-05-16 18:36:50,210::task::1168::TaskManager.Task::(prepare) Task=`1c690bae-d371-4ebe-a57b-a6b7740f7338`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56482::DEBUG::2014-05-16 18:36:50,211::task::579::TaskManager.Task::(_updateState) Task=`1c690bae-d371-4ebe-a57b-a6b7740f7338`::moving from state preparing -> state finished >Thread-56482::DEBUG::2014-05-16 18:36:50,211::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56482::DEBUG::2014-05-16 18:36:50,211::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56482::DEBUG::2014-05-16 18:36:50,211::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56482::DEBUG::2014-05-16 18:36:50,211::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56482::DEBUG::2014-05-16 18:36:50,212::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56482::DEBUG::2014-05-16 18:36:50,212::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56482::DEBUG::2014-05-16 18:36:50,212::task::974::TaskManager.Task::(_decref) Task=`1c690bae-d371-4ebe-a57b-a6b7740f7338`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:36:50,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:50,285::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353361 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:52,297::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:52,368::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345694 s, 29.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:36:52,468::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f79908bf-a757-4a71-9ab5-3a12ede5f65c >Thread-30::DEBUG::2014-05-16 18:36:52,468::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:36:52,486::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:36:52,495::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000793277 s, 2.6 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:36:52,495::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000793277 s, 2.6 MB/s'], size: 2048 >Thread-30::DEBUG::2014-05-16 18:36:52,495::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-30::WARNING::2014-05-16 18:36:52,495::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-30::DEBUG::2014-05-16 18:36:52,496::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-30::DEBUG::2014-05-16 18:36:52,496::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:36:52,496::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:36:52,496::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:36:52,497::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:36:52,497::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-05-16 18:36:52,498::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1ATA_WDC_WD2500AAKX-753CA1_WD-WCAYW0680476|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:36:52,689::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:36:52,691::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-30::DEBUG::2014-05-16 18:36:52,691::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=iscsi', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'SDUUID=f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'VGUUID=BkWB1k-Jata-Bwwa-Qih0-AivC-FBeZ-5pv1wY', u'PV0=pv:360014052e61b03008c3d004000000000,uuid:oLh6aO-9xb8-8P8u-cebn-gli0-eLYQ-YILmTc,pestart:0,pecount:797,mapoffset:0', 'POOL_UUID=5849b030-626e-47cb-ad90-3ce782d831b3', 'POOL_DESCRIPTION=Default', 'ROLE=Master', 'MASTER_VERSION=1', u'PV1=pv:360014052e61b03008c3d007000000000,uuid:EQ64nE-uMxJ-Em1y-2iK5-mWfO-kUlC-PACWxa,pestart:0,pecount:797,mapoffset:797', u'POOL_DOMAINS=a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=50', '_SHA_CKSUM=64fa33f8221fc204b1cac3e12b4bef0e335e212a'] >Thread-30::INFO::2014-05-16 18:36:52,693::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_imageNS already registered >Thread-30::INFO::2014-05-16 18:36:52,693::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_volumeNS already registered >Thread-30::INFO::2014-05-16 18:36:52,693::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f79908bf-a757-4a71-9ab5-3a12ede5f65c_lvmActivationNS already registered >Thread-30::DEBUG::2014-05-16 18:36:52,694::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360014052e61b03008c3d004000000000|/dev/mapper/360014052e61b03008c3d007000000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " f79908bf-a757-4a71-9ab5-3a12ede5f65c' (cwd None) >Thread-30::DEBUG::2014-05-16 18:36:52,844::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:36:52,866::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:36:52,876::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000562827 s, 7.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:54,379::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:54,446::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031054 s, 33.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:56,457::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:56,527::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314264 s, 32.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:36:58,539::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:36:58,609::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344383 s, 29.7 MB/s\n'; <rc> = 0 >Thread-56486::DEBUG::2014-05-16 18:37:00,274::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56486::DEBUG::2014-05-16 18:37:00,274::task::579::TaskManager.Task::(_updateState) Task=`db0f0c1d-f825-428f-bf5e-bb8b01532507`::moving from state init -> state preparing >Thread-56486::INFO::2014-05-16 18:37:00,275::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56486::INFO::2014-05-16 18:37:00,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56486::DEBUG::2014-05-16 18:37:00,275::task::1168::TaskManager.Task::(prepare) Task=`db0f0c1d-f825-428f-bf5e-bb8b01532507`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 50}} >Thread-56486::DEBUG::2014-05-16 18:37:00,275::task::579::TaskManager.Task::(_updateState) Task=`db0f0c1d-f825-428f-bf5e-bb8b01532507`::moving from state preparing -> state finished >Thread-56486::DEBUG::2014-05-16 18:37:00,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56486::DEBUG::2014-05-16 18:37:00,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56486::DEBUG::2014-05-16 18:37:00,276::task::974::TaskManager.Task::(_decref) Task=`db0f0c1d-f825-428f-bf5e-bb8b01532507`::ref 0 aborting False >Thread-56487::DEBUG::2014-05-16 18:37:00,310::BindingXMLRPC::167::vds::(wrapper) client [192.168.2.50] >Thread-56487::DEBUG::2014-05-16 18:37:00,310::task::579::TaskManager.Task::(_updateState) Task=`466149e6-88df-475a-aeeb-b035fc0dc8b4`::moving from state init -> state preparing >Thread-56487::INFO::2014-05-16 18:37:00,310::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', options=None) >Thread-56487::DEBUG::2014-05-16 18:37:00,310::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6f926288-f1f9-4388-8f7a-de0c7a8288a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo' >Thread-56487::DEBUG::2014-05-16 18:37:00,310::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'shared' >Thread-56487::DEBUG::2014-05-16 18:37:00,311::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'shared' (1 active user) >Thread-56487::DEBUG::2014-05-16 18:37:00,311::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`6f926288-f1f9-4388-8f7a-de0c7a8288a5`::Granted request >Thread-56487::DEBUG::2014-05-16 18:37:00,311::task::811::TaskManager.Task::(resourceAcquired) Task=`466149e6-88df-475a-aeeb-b035fc0dc8b4`::_resourcesAcquired: Storage.5849b030-626e-47cb-ad90-3ce782d831b3 (shared) >Thread-56487::DEBUG::2014-05-16 18:37:00,311::task::974::TaskManager.Task::(_decref) Task=`466149e6-88df-475a-aeeb-b035fc0dc8b4`::ref 1 aborting False >Thread-56487::INFO::2014-05-16 18:37:00,312::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56487::DEBUG::2014-05-16 18:37:00,312::task::1168::TaskManager.Task::(prepare) Task=`466149e6-88df-475a-aeeb-b035fc0dc8b4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'f79908bf-a757-4a71-9ab5-3a12ede5f65c', 'name': 'Default', 'version': '3', 'domains': u'a63b0ab4-53fb-4804-a98d-a691c3e16fec:Attached,f79908bf-a757-4a71-9ab5-3a12ede5f65c:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 50}, 'dominfo': {u'a63b0ab4-53fb-4804-a98d-a691c3e16fec': {'status': u'Attached', 'isoprefix': '', 'alerts': []}, u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'status': u'Active', 'diskfree': '112340238336', 'isoprefix': '', 'alerts': [], 'disktotal': '213943058432', 'version': 3}}} >Thread-56487::DEBUG::2014-05-16 18:37:00,312::task::579::TaskManager.Task::(_updateState) Task=`466149e6-88df-475a-aeeb-b035fc0dc8b4`::moving from state preparing -> state finished >Thread-56487::DEBUG::2014-05-16 18:37:00,312::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.5849b030-626e-47cb-ad90-3ce782d831b3': < ResourceRef 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', isValid: 'True' obj: 'None'>} >Thread-56487::DEBUG::2014-05-16 18:37:00,312::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56487::DEBUG::2014-05-16 18:37:00,313::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' >Thread-56487::DEBUG::2014-05-16 18:37:00,313::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) >Thread-56487::DEBUG::2014-05-16 18:37:00,313::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. >Thread-56487::DEBUG::2014-05-16 18:37:00,313::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. >Thread-56487::DEBUG::2014-05-16 18:37:00,313::task::974::TaskManager.Task::(_decref) Task=`466149e6-88df-475a-aeeb-b035fc0dc8b4`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:37:00,621::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:37:00,688::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310432 s, 33.0 MB/s\n'; <rc> = 0 >Thread-56488::DEBUG::2014-05-16 18:37:01,214::sampling::479::root::(get) MONKEY: bond3 rxrate = 100 * 4435002.000000 / 8.009261 / 262500000.000000 = 0.210946 >Thread-56488::DEBUG::2014-05-16 18:37:01,214::sampling::489::root::(get) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth4': {'txErrors': '0', 'state': 'up', 'name': 'eth4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '100', 'rxRate': '71.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '11.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '17.0', 'rxDropped': '0'}}, 'txDropped': 0, 'cpuUser': 0.0, 'txRate': 0.005748963809044349, 'statsAge': 1.590709924697876, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 0.2109463711738368, 'rxDropped': 0} >Thread-56488::DEBUG::2014-05-16 18:37:01,215::task::579::TaskManager.Task::(_updateState) Task=`59efb770-0435-4fa7-9f28-6efbda7ccaf6`::moving from state init -> state preparing >Thread-56488::INFO::2014-05-16 18:37:01,215::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-56488::INFO::2014-05-16 18:37:01,215::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562827', 'lastCheck': '8.3', 'valid': True}} >Thread-56488::DEBUG::2014-05-16 18:37:01,216::task::1168::TaskManager.Task::(prepare) Task=`59efb770-0435-4fa7-9f28-6efbda7ccaf6`::finished: {u'f79908bf-a757-4a71-9ab5-3a12ede5f65c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562827', 'lastCheck': '8.3', 'valid': True}} >Thread-56488::DEBUG::2014-05-16 18:37:01,216::task::579::TaskManager.Task::(_updateState) Task=`59efb770-0435-4fa7-9f28-6efbda7ccaf6`::moving from state preparing -> state finished >Thread-56488::DEBUG::2014-05-16 18:37:01,216::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56488::DEBUG::2014-05-16 18:37:01,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56488::DEBUG::2014-05-16 18:37:01,216::task::974::TaskManager.Task::(_decref) Task=`59efb770-0435-4fa7-9f28-6efbda7ccaf6`::ref 0 aborting False >Dummy-51::DEBUG::2014-05-16 18:37:02,699::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:37:02,767::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303689 s, 33.7 MB/s\n'; <rc> = 0 >Thread-30::DEBUG::2014-05-16 18:37:02,912::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/f79908bf-a757-4a71-9ab5-3a12ede5f65c/metadata bs=4096 count=1' (cwd None) >Thread-30::DEBUG::2014-05-16 18:37:02,923::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765254 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:37:04,778::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:37:04,849::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348816 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-05-16 18:37:06,861::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/5849b030-626e-47cb-ad90-3ce782d831b3/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-51::DEBUG::2014-05-16 18:37:06,926::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292671 s, 35.0 MB/s\n'; <rc> = 0
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1098638
: 896504